Sabitlenmiş Tweet
Etched
35 posts

Etched
@Etched
Frontier Inference Clusters
San Francisco Katılım Nisan 2024
4 Takip Edilen40.3K Takipçiler

Vertically integrating the full inference hardware stack is extremely hard.
Hear @UbertiGavin and @robertwachen share three years of battle stories leading into today's launch
Etched@Etched
We're coming out of stealth. We've built our first racks after a successful A0 tapeout, $1B+ in customer contracts, and $800m raised. Early customer tests show us achieving SOTA throughput, latency, and power efficiency on inference workloads. Our first racks ship this summer.
English

@Etched Congrats! Love seeing the huge gains by rethinking inference all the way down to materials and packaging!
English

Congrats!! I was impressed to learn about some of the engineering wizardry (e.g. *very* low voltage domains, cluster scale memory, ...) that goes into tokens/watt maxxing of state of the art LLMs at interactive tokens/sec/user. Esp fun and memorable is the idea that this is engineering at the "opposite" regime to that of power transmission lines: very low voltage high current (at tiny distances) vs. very high voltage & low current (at great distances). Looking forward to more!
English

@Etched amazing, I've been to your offices a few times to visit @LaurenWChin. @Etched has the best office energy I've ever seen
English

We believe today's models significantly underutilize inference-time compute and search. With better algorithms and much faster hardware, we can push this scaling law by several orders of magnitude.
We're particularly interested in research that accelerates parallel reasoning, high batch speculative decoding, text diffusion, and adaptive scaling.
English

We're excited to partner with @Cognition_Labs @Mercor_AI @CoreWeave and @AnthropicAI to host an inference-time compute hackathon, featuring >$60K in cash prizes and >1 exaflop of free compute.

English
Etched retweetledi

Thousands of people in the line 😅 adding compute to handle the load!
Go to oasis.decart.ai to try it yourself

English



