Etched

35 posts

Etched banner
Etched

Etched

@Etched

Frontier Inference Clusters

San Francisco Katılım Nisan 2024
4 Takip Edilen40.3K Takipçiler
Sabitlenmiş Tweet
Etched
Etched@Etched·
We're coming out of stealth. We've built our first racks after a successful A0 tapeout, $1B+ in customer contracts, and $800m raised. Early customer tests show us achieving SOTA throughput, latency, and power efficiency on inference workloads. Our first racks ship this summer.
Etched tweet media
English
644
928
9.6K
6.2M
Etched
Etched@Etched·
@LiamFedus Thanks for all of your support Liam!
English
0
0
15
15.1K
Liam Fedus
Liam Fedus@LiamFedus·
@Etched Congrats! Love seeing the huge gains by rethinking inference all the way down to materials and packaging!
English
1
0
64
18.2K
Etched
Etched@Etched·
We're coming out of stealth. We've built our first racks after a successful A0 tapeout, $1B+ in customer contracts, and $800m raised. Early customer tests show us achieving SOTA throughput, latency, and power efficiency on inference workloads. Our first racks ship this summer.
Etched tweet media
English
644
928
9.6K
6.2M
Etched
Etched@Etched·
@karpathy We're excited to spend more time together!
English
1
0
78
11.4K
Andrej Karpathy
Andrej Karpathy@karpathy·
Congrats!! I was impressed to learn about some of the engineering wizardry (e.g. *very* low voltage domains, cluster scale memory, ...) that goes into tokens/watt maxxing of state of the art LLMs at interactive tokens/sec/user. Esp fun and memorable is the idea that this is engineering at the "opposite" regime to that of power transmission lines: very low voltage high current (at tiny distances) vs. very high voltage & low current (at great distances). Looking forward to more!
English
23
48
1.7K
101.9K
Etched
Etched@Etched·
We're scaling production as fast as possible. We built a 2MW datacenter in our office and opened a Taiwan factory for 24/7 engineering. Performance, roadmap, and more updates are coming this summer. If this excites you, join us to build the future of gigawatt-scale inference:
English
8
15
687
122.9K
Etched
Etched@Etched·
We believe today's models significantly underutilize inference-time compute and search. With better algorithms and much faster hardware, we can push this scaling law by several orders of magnitude. We're particularly interested in research that accelerates parallel reasoning, high batch speculative decoding, text diffusion, and adaptive scaling.
English
4
0
58
28.9K
Etched retweetledi
Decart
Decart@DecartAI·
Thousands of people in the line 😅 adding compute to handle the load! Go to oasis.decart.ai to try it yourself
Decart tweet media
English
19
12
175
56.2K