Davide Liu
51 posts

Davide Liu
@DavideLiu5
CEO at SparseMind | Building sparse layer of intelligence | Hyrox & Spartan Race lover
Beijing, China Katılım Ağustos 2020
25 Takip Edilen10 Takipçiler
Davide Liu retweetledi

Introducing SubQ - a major breakthrough in LLM intelligence.
It is the first model built on a fully sub-quadratic sparse-attention architecture (SSA),
And the first frontier model with a 12 million token context window which is:
- 52x faster than FlashAttention at 1MM tokens
- Less than 5% the cost of Opus
Transformer-based LLMs waste compute by processing every possible relationship between words (standard attention).
Only a small fraction actually matter.
@subquadratic finds and focuses only on the ones that do.
That's nearly 1,000x less compute and a new way for LLMs to scale.
English

No business plan, no team, no investors, no pitch, no KOLs, just me building a product for 4 months and promoting it with 2 posts on #xiaohongshu.
Happy to see HyXpert, my #hyrox training app, getting its first users and growing.
Train hard and build (software) hard!


English

Start dense. Remove what doesn't survive the next iteration.
Backyard ultra is just a biological neural network running in real time — 100 athletes at the gun, one left standing at the end.
The brain works the same way. So does the best AI.
#sparsemind #cht #sparsity #ai
English

Robots just outran humans in a half marathon.
The day they conquer trail running… that’s when we’re staring at true robotics AGI.
#AI #AGI #Robotics #TrailRunning #Endurance #FutureTech #SpartanSpirit
English

“AI is the new electricity.”
Everyone says it. Nobody asks: what happens when electricity itself becomes the bottleneck?
Scaling AI models is the wrong path and #sparsemind with its proprietary #CHT algorithm will provide a solution. Intelligence shell not depend on scale.
English

I just published Financial Trading in the AI Era: What Large Language Models Bring to the Table link.medium.com/AAiXmycZiQb
English

I just published How I Started Trail Running in the Most Brutal Way link.medium.com/1DcRvMlXuPb
English

Lessons from my first day of Memecoins trading: wins, losses, and takeaways link.medium.com/cvbvLeKblPb
English
Davide Liu retweetledi
Davide Liu retweetledi

Peak Performance Analysis of the Track and Field 5000m Event davideliu.com/2022/11/27/pea…
English

Train hard and recover harder: why you should take a recovery week davideliu.com/2022/11/26/tra…
English

Exploring Transformer Model for Reinforcement Learning davideliu.com/2022/11/18/exp…
English

A scientific perspective of legs strength training for distance running davideliu.com/2022/10/29/a-s…
English

Speed benchmark einsum vs matmul in XL-Attention davideliu.com/2022/02/20/spe…
English










