Tim Sears

Happy to share that the new Haskell Meetup will be hosted at @GroqInc in their Mountain View HQ, this Friday 5:30pm partiful.com/e/McHtTURDtf4k… @csTimSears will share how Groq uses Haskell and @avi_press (founder @scarf_oss) will talk about his experience on running a startup with haskell

With over 284K+ developers using GroqCloud™, the Groq Speed Read focuses on developers and highlights new features, great apps, and what’s coming up. Sign up for the Speed Read here so you don't miss out - hubs.la/Q02GqlrH0 -

@YankeeWRLD @adaquano Backward cap, nose to nose, kicking dirt on his shoes and home plate.

@adaquano I don’t think we can comprehend how ugly they would’ve gotten

The agony that is Angel Hernandez’s umpiring has finally come to a close, so what better time to remember his legacy than right now Some of Angel Hernandez’s worst calls and most iconic moments, a thread🧵

Who wants to go all in on an LPU cluster with me?

I’m sorry to all the engineers at @GroqInc I should’ve waited till tomorrow to post about you… Hopefully the servers stay online till the morning!

Try groq.com now Hyperfast LLM running on custom built GPUs Answers in miliseconds, not seconds How? 🤯

The first public demo using Groq: a lightning-fast AI Answers Engine. It writes factual, cited answers with hundreds of words in less than a second. More than 3/4 of the time is spent searching, not generating! The LLM runs in a fraction of a second. …6591-00-1rsd2y84t464l.worf.replit.dev

@Uncensored_AI @levelsio Good guess, but nope. Completely original hardware / software solution built from the ground up. We say it's "sand to sky" because it's our custom silicon GroqChip, an LPU provided as a system via our cloud solution. We haven't even started with tricks used by others yet. :D

@TaliaGold @GroqInc We did that. It’s fun. You can talk to mixtral running on Groq in minutes with zero code over at vapi.ai.

Faster than thought. Now imagine this with real time voice 🤯 @GroqInc

oi, m8. @GroqInc fastest resp alive

@chamath @GroqInc I tried this with summarize book text with cross questioning and summary. It's faster and more accurate than big techs llms.

Wild tech you have to try: groq.com They are serving Mixtral at nearly 500 tok/s. Answers are pretty much instantaneous. Opens up new use-cases, and completely changes the UX possibilities of existing ones.

The response time from groq feels like magic!

Groq is serving the fastest responses I've ever seen. We're talking almost 500 T/s! I did some research on how they're able to do it. Turns out they developed their own hardware that utilize LPUs instead of GPUs. Here's the skinny: Groq created a novel processing unit known as the Tensor Streaming Processor (TSP) which they categorize as a Linear Processor Unit (LPU). Unlike traditional GPUs that are parallel processors with hundreds of cores designed for graphics rendering, LPUs are architected to deliver deterministic performance for AI computations. The LPU's architecture is a departure from the SIMD (Single Instruction, Multiple Data) model used by GPUs and favor a more streamlined approach that eliminate the need for complex scheduling hardware. This design allows every clock cycle to be utilized effectively, ensuring consistent latency and throughput. For developers, this means that performance can be precisely predicted and optimized which is critical in real-time AI applications. Energy efficiency is another area where LPUs shine. By reducing the overhead of managing multiple threads and avoiding the underutilization of cores, LPUs can deliver more computations per watt. Groq's innovative chip design allows multiple TSPs to be linked together without the traditional bottlenecks found in GPU clusters making them extremely scalable. This enables linear scaling of performance as more LPUs are added simplifying the hardware requirements for large-scale AI models and making it easier for developers to scale their applications without rearchitecting their systems. So what does this all mean? LPUs could provide a massive improvement compared to GPUs for serving AI applications in the future! If anything it will be great to have alternative high performing hardware since A100s and H100s are so in demand

@JohnYue122333 @JayScambler @ylecun He knows

@JayScambler @ylecun

@sandersted I’m waiting for the tiktok video.

As a former materials physicist, I am genuinely unsure of what to make of this superconductivity paper. 🧵 👇

@lifebypixels Spurts. From “experts”.

Any insight on what 𝕏 is going to call posts? Obvi not going to be tweets...so....? Brand strategic rollout at its finest. :/

@vpatryshev It’s like Theory but not just for clothing.

Yesterday a cashier at a gas station asked me what is category theory. Imagine, you have 5 seconds to think and 15 seconds to explain.

@oldfriend99 @sclv 0 + 0 is my favorite but Dad said it would never amount to anything.

2 + 2 is often held up as an example of a very easy math problem. But I find 2 + 1 is even easier

Math. We have no moat around it. How do we build one?