Dude gets it. That's the future. Live UI. No UI is the same for everyone, interface on the fly. Services are just APIs.
gabriel@gabriel1
if 5.5 becomes 20x faster, you'll talk and code live while the interface is changing as you speak
English
Kevin
4.2K posts
Kevin
@TheOneKev
Product Owner building independent AI systems. Interested in psychology, politics & the global economy
Присоединился Haziran 2020
475 Подписки178 Подписчики
@WillLewis_1976 @ChampRDS Ngl, lost a LOT of respect for Dana White in the last days. Never liked his political involvement, but the shit he said in the last days about mental health and this bs here, is making him look ridiculous, hypocritical and dumb af. Sad!
English
@ChampRDS Dana White: "Men are supposed to be tough and they shouldn't feel the need to go around telling people about their poor mental health."
Also Dana White: "I don't want to tell my friend Donald Trump that he's doing a bad job because it might hurt his feelings."
GIF
English
Charlamagne confronted Dana White for "glazing" President Donald Trump
🗣️ Charlamagne: "Why can't you tell your friend he's failing the people?"
🗣️ Dana: "I don't know if I agree that he's failing the people. When the president is done in 3 years, people will look back and realize a lot of the good things... You're never gonna have a president that everybody approves 100%. Not everything is always gonna be perfect."
🗣️ Charlamagne: "But don't be a glazer though."
🗣️ Dana: "I don't think anybody's ever accused me of being a yes man."
🗣️ Charlamagne: "So you're responsible for the high tariffs, and high inflation costs, people's health care getting cut."
🗣️ Dana: "I guess if that's the way you wanna look at it, it's my fault."
(via @breakfastclubam)
English
Still blown away by the speed Gemma 4 now mit MTP.
Did 31B and 26B with 4bit and 8bit quants from @RedHat_AI and what can I say, those speeds are nuts. Especially the MoE model is just flying now on a single RTX 5000 Pro.
English
@_philschmid @arena Big fan of both models. Especially now with MTP, they're both just crazy good. Token/s is just mind-blowing in combination with the intelligence, and super smooth on my RTX 5000 Pro.
Really worthy successors for the Gemma 3 series. Amazing job.
English
Kevin ретвитнул
Gemma-4 lands in Code Arena: Frontend Webdev and shifts the Pareto Frontier!
Among open models, Gemma-4-31b ranks #13 and Gemma-4-26b-a4b ranks #17.
Congrats to @GoogleDeepMind on shifting the frontier!
Google DeepMind@GoogleDeepMind
Meet Gemma 4: our new family of open models you can run on your own hardware. Built for advanced reasoning and agentic workflows, we’re releasing them under an Apache 2.0 license. Here’s what’s new 🧵
English
Excited to introduce Gemma 4 Multi-Token Prediction Drafters⚡️Accelerated inference right in your pockets
- Up to a 3x speedup
- Same quality guarantees
- Available in your favorite open-source tools
English
@bnjmn_marie That was really that critical thing missing with Gemma 4 31B. Speed. Now that this also is there, best open model for me right now. Love it so far.
English
I benchmarked Google’s new MTP for Gemma 4 31B using vLLM with 4 speculative tokens, a fairly conservative setup.
Results:
- Much higher throughput than Qwen3.6’s MTP
- Lower latency too, helped by Gemma 4 generating fewer tokens
- For coding tasks with reasoning enabled, Gemma 4 is now at least 6x faster than Qwen3.6. So you can generate 5 outputs, run your tests to select the best one, and it would still be cheaper than a single output by Qwen3.6.
I’ve updated my full comparison with the new numbers:
kaitchup.substack.com/p/qwen36-27b-v…
I also confirmed what others have reported: Gemma 4’s MTP handles a high number of speculative tokens very well.
On simple text generation, I’m now testing values above 10 and reached 129 tok/s on an RTX Pro 6000, compared with 20 tok/s without MTP.
Next step: confirming how this translates to real tasks.
English
@bnjmn_marie Tested it on my two RTX 5000 Pros, one model on each, both Gemma 4 31B, both FP8, one with and one without MTP.
The 3x was no lie. Went from 30 to almost 100 tok/s. That's incredible.
English
Gemma 4 was very slow compared to Qwen3.6. Now, it's probably much faster!
I'll publish my own numbers tomorrow
Google for Developers@googledevs
Gemma 4: Now up to 3x Faster. ⚡ Same quality, way more speed. Our new MTP drafters allow Gemma 4 to predict multiple tokens at once, effectively tripling your output speed without compromising intelligence.
English
Ok, had to try it out. Doing the first runs, both FP8 and each running on a RTX 5000 Pro.
And what can I say? hey weren't exaggerating. ~30 tok/s vs almost 100 tok/sec.
Which meant in that test run reducing the time from 16 to 5 secs. And I can't see any degradation or similar.
Great job @googlegemma
Google Gemma@googlegemma
Gemma 4 just got even faster! We're releasing Multi-Token Prediction (MTP) drafters that deliver up to a 3x speedup, without any degradation in output quality or reasoning logic.
English
Kevin ретвитнул
Gemma 4 just got even faster!
We're releasing Multi-Token Prediction (MTP) drafters that deliver up to a 3x speedup, without any degradation in output quality or reasoning logic.
GIF
English
If anyone wants to do this this summer I have giant villa on the Amalfi Coast & Lake Como that I’ll be hosting hackathons from.
ol’ stocky ⛳️@oldstocky
Your soul needs this, not the Met Gala
English
@TheOneKev This is the pro move brother! You gave me inspiration to move to the next level.
English
What LLM gateway are you using?
I built my own to have a single point of configuration for my local AI systems.
How did you all solve the pain point of having many local models over many local machines.
English
@Dozer3000 @gas0linr Stimme ich halbwegs zu. Zumindest was den Status Quo betrifft. Aber wenn man überlegt, wo LLMs herkommen und dass Scaling bis jetzt immer noch was bringt, abgesehen von evtl neuen Architekturen bald, wird bald kein Dev mehr mithalten können. Biologisch nicht möglich.
Deutsch
@gas0linr Die Aussage ist meines Erachtens völliger Quark. Das Studium lohnt sich. Nur weil man mit vibe-coding mit ein paar Agenten effizienter arbeiten kann, werden gute ITler nicht obsolet. Reine Script-Coder haben es schwerer, aber sonst gibt genug zu tun.
Deutsch
Es ist ein wirklich irres Gefühl als Informatiker zu sehen, was der technologische Fortschritt mit der Branche macht. Und es ist beängstigend zu erkennen, dass 90% der Menschen das nicht kommen sehen.
Als Student der Informatik würde ich jetzt (!) abbrechen und mich orientieren.
Deutsch
Sometimes it's hard to understand, when you're right in the middle of it, but this is literally history in the making. And I honestly think just a precursor of what will come.
I think @sama even said it himself, that it will probably get bad first, before it can(!) become good.
Anonymous@YourAnonNews
Kevin O'Leary's massive data center was approved by a county commission in Utah last night without residents' approval of the measure. At 40,000 acres, it would be 2.5x the size of Manhattan. The commission approved the proposal despite opposition from hundreds of locals.
English
@isabelunraveled As a dad, makes me happy reading that reply from you dad. That's how it should be. He's doing a great job.
English
