Crown 👑

@the_jimmy_jones x.com/i/chat/group_j…

@MichaelGannotti @mr_r0b0t I thought you had the same system? (hardware wise)

@mr_r0b0t Yup.... the clickbait posts showing $1,900 ... If it was that cheap Id have bought one today

What is all this nonsense I keep seeing about the AMD Strix Halo being $2000!?! Half the posts aren’t even showing the correct device? It isn’t $2000, it was announced at $3999. That’s the only price I’ve seen anywhere. I spec’d out a comparable Framework desktop for reference.

@mr_r0b0t slop influencers.

@sirius_devops @sudoingX Nah it's cheaper, but not 2k. $3~

@sudoingX Stop the lies the AMD box is the same price . These LLM generated grift posts should get people banned

nvidia vs amd two boxes on my desk, both 128gb of unified memory. one is the nvidia dgx spark ($4,699). the other is the amd strix halo ($1,999), amd at roughly half the price. i'm running the exact same models on both, from a 3b all the way up to a 397b, same quants, same llama.cpp, and i'm posting every single number. here is why it actually matters. if the amd box just keeps pace, that's a nice story. but if it matches or beats a box that costs twice as much, the entire calculus for buying local ai hardware changes overnight. i already have the first numbers and they made me sit up. holding them for the full breakdown. stay tuned anon. this matchup is going to shake some ground.

@DBirker78883 @sudoingX Absolutely. I hope his benchmarks do it any justice at all.

@sudoingX I feel like the Strix Halo is the sleeping giant of local ai.

@sudoingX its not fair to use same quants on both when there are quants optimized for each.

the rules, so it's fair: identical models, identical quants, same llama.cpp build, both boxes idle, every number posted whether it flatters amd or nvidia. full disclosure, both nvidia and amd plus framework sent these units for honest testing, no money on either side. that's the whole point, nobody's paying me to crown a winner, the silicon decides. 3b dense up to a 397b moe, the full range. first numbers dropping soon.

@MichaelGannotti @NVIDIAAI Congrats mike! looking forward to hearing about how it compares to your Strix Halo!

Just ordered! @NVIDIAAI DGX Spark. Can't wait to get my hands on it

@SMNYC1 @arunninghacker blows my mind what even a 3GB model knows. Where does it keep it all? 😂

@ciruai @arunninghacker Yes! That is amazing compression right?

I ran OpenCode riding an uncensored Qwen3.6 running on a Mini-sized shiny silver box with an NVIDIA card in it for a couple of days, and I assure you: all this ethics/regulations/export control frontier AI drama will be over very, very soon

@SMNYC1 @arunninghacker Imagine power is out for extended period and you're the only house which basically still has the whole internet self contained within it!

@ciruai @arunninghacker I feel like there has to be a market for the people who buy the storage 10 year food kits. They could rebuild civilization after they come out the bunker with ai in a box. Its a neat thought

@SMNYC1 @arunninghacker Currently solar powered and running AI locally. Hypothetically if power and internet goes out I could still run AI at home

@ciruai @arunninghacker Its an amazing way to compress a ton of information. Like wow. Having it work durable and offline would be good for if the web ever blows up. Its always a dns issue lol

@GMMeyer @benrayfield @BLUECOW009 I have no illusions about someone's ability to just download a weight file. Specifics are going to matter. That's why I say we can't really war game it without the details.

@ciruai @benrayfield @BLUECOW009 have you ever worked at an enterprise tech company? i can 100% guarantee almost no one has access to the model itself in the way you’re suggesting and any access of this kind is logged

Kinda crazy we never had the weights for a sota model be leaked

I rely heavily on openai still at home, even though I have access to dozens of models running locally and have spent hundreds of hours preparing for local only use. A couple of times in the last month the internet went out for an extended period (someone crashed into a main hub and died 🥲). Had to test everything I had been working on and keep moving without it. Found some important gaps. It's a lot of fun though, to be honest.

@ciruai @arunninghacker Yeah. I'm from the before times when we had our own computers and no internet. Ownership is kinda retro and good sec ops.

GPU VMs are much more expensive than just using an API. It's going to cost you $1+ an hour. Adds up if it's always on. An API for chatting probably will only cost you $20 a month or less but at that point why are you not just using gpt anyway? The reason to go local is to be in control.

@ciruai @arunninghacker Cool! Curious why not just host a vm somewhere? With a gpu

@GMMeyer @benrayfield @BLUECOW009 Would need to dig into specifics to map out the best way. Kind of hard to say hypothetically. Impossible to stop if people can't be trusted. In the end it's your people who protect you.

@ciruai @benrayfield @BLUECOW009 x.com/gmmeyer/status…

Can do it on a nice $1000 laptop too, of course. Under $5000 is the same answer as "what does a nice computer cost" I have a nice chat bot on a $150 laptop but thats not going to replace the experience of chatting with chatgpt. You can with better hardware (not including image gen, all the other fancy tools it has now, just chatting unless price gets closer to that $5000 number)

@ciruai @arunninghacker I'm a dev, so I can get it to run. But 5k for a library chat bot seems steep. 🤔

@MrPeterLMorris @sudoingX @FrameworkPuter Assume whatever you want, he repeated the invalid claim again, and framework responded to my tweet confirming the issue. So whatever you assumptions are the reality isnt looking good for this lazy influencers credibility.

@ciruai @sudoingX @FrameworkPuter I assume they gave him info to discuss his findings and how to ask for help, so they look good.

the one box i was missing just landed anon. this is the @FrameworkPuter desktop with amd's strix halo, ryzen ai max+ 395, 128gb of unified memory, up to 96 of it addressable as vram. amd and framework sent it over for honest testing, no strings attached, and i've been waiting on this one specifically. here's why it matters. i've run local ai on basically everything, a 150 dollar drawer card, a 3090, a 5090, the dgx spark, datacenter h200s. the one gap was always the accessible big memory tier on the amd side, and this fills it. 128gb unified at roughly half the price of the nvidia equivalent, the sovereignty box for people who want to run real models without a datacenter budget. booting it today. and the question i actually want answered is the one nobody answers straight: what does this thing really run? same bar i hold every other card to. amd, nvidia, apple, measured, never vibes. let's find out what it's got.

@MrPeterLMorris @sudoingX @FrameworkPuter it matters in a bad way if they are saying your 128gb system can only handle using 96gb

@ciruai @sudoingX @FrameworkPuter He has 30k+ followers, that's mostly what matters

@GMMeyer @benrayfield @BLUECOW009 You would take it out physically. Obviously.

@benrayfield @BLUECOW009 this is not the part that would set off alarms…

@michal_dolnik @sudoingX Apple doesn't make anything better than it unless you spend twice as much.

@sudoingX Better than Mac Mini for running a local models ?

AMD

You can own it now it's just a matter of what you expect to be able to do with it. For people who just want to chat where they're already you can have incredibly intelligent chatting AI that does research for you all of that under $5,000 easily. Incredibly intelligent chatbots are solved. Fully agentic AI developing complex code and projects doing full system administration these things take a lot more coordination and intentional workflows in many cases. Still a lot of skill in the driver here so can absolutely be done on local hardware under 5K very well but not out of the box whatsoever. Person that doesn't know what they're doing is going to think it doesn't work at all for that.

@ciruai @arunninghacker I'm not sure yet. I can't think of anything worth building. Mostly interested when I can own the server side in my house. Its a matter of time before commodity models get good enough. Depends on the next few months and who goes under.

@MrPeterLMorris @sudoingX Of course you can always spend twice the money for better performance with a much higher power bill. They are great for having good enough performance on fairly large models with high context and very low power.

@ciruai @sudoingX Both machines too slow for my taste.

Someone please ping @sudoingX and tell him to stop saying that AMD Strix Halo can only use 96GB as VRAM. It is a real shared memory pool. Just has to be configured properly. While you're at it show him my 2000 rows of benchmarks since he keeps asking "does anyone have any AMD benchmarks" and ignoring the best answers. llm.ciru.ai