Claire Oxner

might have to do some triage and drop out of school to focus on what really matters: giving my cat 6 hours of uninterrupted attention every afternoon

what do you do if your intern is rapidly developing a twitter addiction

Meet Sohu, the fastest AI chip of all time. With over 500,000 tokens per second running Llama 70B, Sohu lets you build products that are impossible on GPUs. One 8xSohu server replaces 160 H100s. Sohu is the first specialized chip (ASIC) for transformer models. By specializing, we get way more performance: Sohu can’t run CNNs, LSTMs, SSMs, or any other AI models. Today, every major AI product (ChatGPT, Claude, Gemini, Sora) is powered by transformers. Within a few years, every large AI model will run on custom chips. Here’s why specialized chips are inevitable:

“pair programming”

some companies measure their features in story points, we measure ours in all nighters our intern today: “oh that’s not too bad, like three allnightersable”