umar
24 posts

umar retweetledi

i just beat @GoogleDeepMind's turboquant
introducing Shard. 10x KV cache compression on Llama-3.1-8B. zero quality loss
- 10x @ 8K context, 11.2x @ 32K
- NIAH recall 1.000 across 4K-32K
- LongBench Δ ≈ 0 vs FP16
turboquant tops out at 4-6x at the same quality. we doubled it.
read more: krishgarg.com/shard
@kirrithan
English

@utosrad @AlexSomtingwang Gotta post this on ig w a drake song
English
umar retweetledi
umar retweetledi

It's time to fix this. Markets shall no longer be local.
Illiquid@illyquid
@origoinvest Do I have to fly to Korea to open a brokerage account in person…
English
umar retweetledi

umar retweetledi

If you’re Canadian 🇨🇦 and want to join us at @xai
I want to chat with you
English

My opps (@krishgarg @lohanipravin @yuviecodes )are winning xAI hackathons but they can’t do this so who’s really winning😭😭😭
English
umar retweetledi

We won the @xai hackathon.
Introducing Halftime; dynamic ad integration that feel like they belong
Built with: @yuviecodes @krishgarg
English









