kavanmce

8 posts

kavanmce

kavanmce

@kavanmce

Katılım Ekim 2024
55 Takip Edilen18 Takipçiler
Leo McKee-Reid
Leo McKee-Reid@LeoMcKeeReid·
Excited to announce a new, nonprofit AI safety startup: @NeolithicAI We are building agentic tools and infra to scale AI safety research — an engineering-first approach to reducing catastrophic risk from advanced AI. We're hiring! 🧵
Leo McKee-Reid tweet media
English
14
10
188
8.5K
kavanmce
kavanmce@kavanmce·
@Eschalabs Phenomenal work! The future of edge computing just got a bit brighter.
English
1
0
1
129
Escha Labs
Escha Labs@Eschalabs·
Today we are introducing Escha-W2 quantization. A 2-bit Qwen3.6-35B-A3B model built for fast, local inference. The complete model is 12.3GB on disk—small, enough to run on a single consumer GPU — while averaging ~100% of FP8 performance across 12 benchmarks, including: MMLU-Pro: 80.9 MATH-500: 93.8 GPQA-Diamond: 77.8 LiveCodeBench v6: 62.6 BFCL tool use: 88.9 RULER 8K–128K: 89.9 Commonsense-6: 76.1 On a single RTX 4090, the model runs: 225 tok/s single-stream generation on 12.3GB on-disk model size Compressing a 35B MoE model this far without collapsing its capabilities required more than a standard quantization pass. We built an end-to-end compression system combining state-of-the-art low-bit quantization with model-aware fine tuning and recovery to preserve capabilities most vulnerable to low-bit error. Quantizing the Qwen 3.6 35B model - from the base model to the final deployable checkpoint — took approximately 10 hours to complete. Escha-W2 runs through a custom Qwen3-MoE runtime, which includes the weight loader, low-bit decoding kernels and serving integration required to execute the Escha format efficiently. The runtime currently supports SGLang and ZML deployment. vLLM and llama.cpp will be supported in the next release. No retraining from scratch. No specialized accelerator. One consumer GPU. Model download: huggingface.co/EschaLabs/Qwen… Runtime download: huggingface.co/EschaLabs/esch… Apache-2.0 model and runtime.
English
83
123
1.3K
175K
kavanmce
kavanmce@kavanmce·
@spc I've said this elsewhere but worth repeating: every time I walk into the SPC building, I end up having deep, memorable conversations with astonishingly talented and inspiring people. It never ceases to surprise me.
English
0
0
5
846
South Park Commons
The time to be maximally ambitious is now. The $1M Founder Fellowship is open for Fall 2026. Applications are due August 2nd.
GIF
English
17
44
458
63.3K
kavanmce
kavanmce@kavanmce·
@adityaag Every time I walk into the SPC building, I end up having deep, memorable conversations with astonishingly talented and inspiring people. It never ceases to surprise me. Thank you for creating this unparalleled community and fellowship!
English
1
0
4
241
kavanmce retweetledi
Aditya Agarwal
Aditya Agarwal@adityaag·
Every founder I meet worries about missing this moment. The best worry about wasting it. There’s a difference. It’s a waste to ignore how much the world has changed. It’s a waste to think you can capture value with pure software the same as 5 years ago. It’s a waste to build something small. We have seen the shift slowly and then very quickly at @spc. Here’s who we want in the Founder Fellowship now: hardware tinkerers, mad scientists, obsessives, biohackers, people who build nuclear reactors in their basements. People who want to get their hands dirty and touch grass and atoms. If you are only building software, then please (for your own sake!) have a thesis that all your friends laugh at you about. Heresy is the price of ambition. Then put yourself in the right environment to maximize your ambition. (Apply by August 2nd)
English
26
58
352
78.2K
Grey
Grey@greynguyen·
@WHOOP just filed a lawsuit against us. A $10B company with 800+ employees is scared of us, a 20-person team making health tracking accessible to all. Rather than focusing on product and innovation, Whoop has decided to use its newly raised capital on lawfare. In this video, I share our side of the story, explain why their claims are baseless, and why we believe fighting back is the right thing to do.
English
338
426
4K
2.4M