sohail
7K posts

sohail
@sohailmo
inference perf @togethercompute | ex @amazon @wendys @jpmorgan kernels, gpus, intelligence

Today, we launched GPU compute forward curves derived from our prediction market prices. Forward curves are now available on Nvidia B200. H200, and A100 chips. Forward curves track implied future prices. They are how mature commodity markets form expectations, allocate capital, and manage risk. Energy, interest rates/SOFR, FX, metals, and agricultural markets all rely on market-implied forward prices. Despite becoming one of the key inputs in the global economy, compute has lacked that market-derived infrastructure. Compute right now is where oil was before NYMEX — traded only via OTC deals, just like oil used to trade OTC between producers and refiners. As compute becomes as fundamental to the economy as energy, the industry will need a similar derivative market to promote efficient price discovery. Prediction markets are uniquely suited to this problem. Compute is not one uniform commodity and spans many chips, grades, tenors, locations, and contract structures. A live prediction market can aggregate those dispersed views into transparent prices that reflect market expectations for different maturities. The opportunity is big. Hyperscalers are spending over $700B on compute this year and the market is expected to grow to $7-10T by 2030. If this market behaves like traditional commodity markets, a liquid derivative market could be 10-20x bigger than the underlying spot market. Compute is still not uniform enough, but this is a step towards standardization as forward curves will help us see the rise and fall of different model prices and how they correlate. The forward curve is a first step. Up next: futures and perps.

if you read this and understand all the concepts you have the 80/20 of inference optimization fundamentals

Someone should make an app to record meetings with automatic AI transcripts. Underexplored space rn.

Excited to share I've joined @cursor_ai! One thing that stood out to me was how much this design team cares about building excellent products. Looking forward to contributing and learning from everyone here.

Anyone remember early AI when you'd copy paste code out of a chat app.

Today we're launching Claude for Teachers -- premium @claudeai and Cowork, free for every US teacher. Teachers have been experimenting with AI for a while. But they told us they wanted something curriculum-aligned, evidence-based, and able to work in the background while they focus on their students. Four things that I think make this special:




In previous research, we found that Claude expresses over 3,000 values, like honesty and warmth. In new work, we asked how the values Claude expresses vary between Claude models and across languages. We analyzed 300K+ anonymized conversations to find out.anthropic.com/research/claud…


As AI models continue to grow in scale and capability, shaping a model matters just as much as its size. We're introducing a new series on AI Model Co-Design exploring the synergy between models and hardware. The first post focuses on how model dimensions influence GPU performance, and how the right design choices improve both system throughput and per-user responsiveness. You can read it here: nvda.ws/452Idiy

We're extending Claude Fable 5 access on all paid plans, as well as keeping Claude Code’s weekly rate limits 50% higher, through July 19.








