Jason Turco
86 posts

Jason Turco
@AnythingBuilt
Electrician by trade. Builder by nature. Built a bakery, retail store, and education business from nothing using AI. You can too, ill show you how.



Anyone trying out local LLMs do yourself a favor and get off of windows and use Linux





wow google might've popped the ai bubble, memory stocks down massively today: their new algorithm shrinks an AI model's memory by 6X WITHOUT reducing it's intelligence making it 8x faster with the SAME # of GPUs: if this works - we don't need as many GPUs to train AI - kv-cache is basically a model's short term memory. it gets massive pretty quickly = larger, slower, expensive ai - google's algo compresses it to just 3-bits with ZERO loss in accuracy (usually models are like 32-bit) the combined market cap of micron and sandisk is $527 billion and im not even factoring in SK hynix and samsung ai has driven up memory prices by 500%+ over the last few months - if google's algo scales then this might crash.






