
Dorian Johnson
121 posts

Dorian Johnson
@dorianj
fighting yesterdays wars




Total amt of flops across all the GPUs in the world has grown about 3x per year for the last few years. Total amt of inference demand has probably grown ~10x per year. What happens when those lines cross? The econ answer is: when demand > supply, price goes up. That might be true (even H100s are more expensive than they have ever been...) but doesn't actually solve the problem on its own here - demand continues to grow as we unlock new use cases and there is only so much additional supply coming. To get to a healthy equilibrium, we also need to shift much more usage to smaller, targeted models. This will happen naturally as the incentives make sense for it: it's much easier to 10x your agent usage if you know that you can now solve 90% of your tasks with good cheap, fast models. SWE 1.6 is not a general model. But we have trained it to specifically be good at the kinds of standard coding tasks that our users run. And thanks to its small size & a little magic from Cerebras it can run very cheaply at ~1000 tokens / sec. Give it a try and let us know what you think!









okay here is my comment very very often after 4.6, opus will ask a question or make a suggestion, and then just do it. this extends to a lot of things it does, but electing to destroy instances costs me actual real money and it's getting super tireseome, so i'm shaming publicly



Thank you to everyone who spent time sending us feedback and reports. We've investigated and we're sorry this has been a bad experience. Here's what we found:





Tesla’s TeraFab has launched a talent war in Taiwan via job postings seeking senior chip experts (Process Integration Engineers) with over 10-years of experience, media report, adding its 2nm fab plan aims directly at TSMC. Chip engineers are already in short supply in Taiwan – like nearly everything chip related – and industry insiders worry the ‘Musk Halo Effect’ will draw local talent. More: Deep expertise in FinFET, GAA, BSPDN, and across all stages of chip building: FEOL, MOL and BEOL. $TSLA $TSM $UMC $ASX #semiconductors #semiconductor money.udn.com/money/story/56…












