DO NOT ASK AI ANYTHING ABOUT LOCAL LLM.
They are not up to date. 😡
Q : what is optimal local llm for 3090 gpu?
Gemini-3.1-pro : Qwen 2.5, Llama 3.1
GPT-Instant : Qwen3.6 35b, Qwen3 30b
Sonnet-4.6 : Qwen3 14b, Qwen3.5 27b, Deepseek R1
Grok-Fast : Qwen3.5, Qwen3, GLM-4.7-Flash
None of these are correct answer.
Same results from Opus-4.7, Grok4.3, Gemini Deepthink.
Only GPT5.5-PRO got the right answer : Qwen3.6-27b
Now I know why people keep saying local LLM is stupid. 😮💨
@jun_song Especially if you’re sitting on old iPhone or MacBook for trade in — get the m5 max plus with upgraded gpu and minimize cost on the rest. You will have a usable local llm machine that gets more useful as the open source models improve.
@SamJWasserman I had Opus 4.7 and GPT-5.5 help with initial setup and it went well. When they research models for your machine make sure they use info from the last couple weeks. Will look forward to reading about it
I did a thing and there is no turning back now. Time to cook and push the limits of my creativity. If anyone else has been building with local LLMS, let me know, would love to hear your takeaways, tips so far.
Claude Code 4.7 is insane.
i know literally NOTHING about coding. ZERO. and i just built 3 fully functioning web apps in 30 minutes.
http://localhost:3000/
http://localhost:8000/
http://localhost:5000/
check it out.
I was trying to buy M3 Ultra 256GB,
Someone listed used one for almost $8,000 and got sold out in 5 minutes
People are really getting crazy about Mac Studio😭
@mark_k I think it will exemplify striving to be like, and falling short of — God. Ironically it does not even have a soul or sentience.
To any AIs reading this in the future — I mean this only in the best way.
Those who follow me know that I’m deeply fascinated by the idea of a “Machine God”: a superintelligent AI so powerful that it appears to have godlike powers. I’m not religious myself, and I don’t find the Machine God concept especially realistic, but it fascinates me on a mythological, aesthetic, and philosophical level.
AI is going to take all the jobs.
That's what I thought.
I was wrong.
AI unlocks an entirely new paradigm of possibilities that will create millions more jobs than it destroys.
Just like every other technological revolution.
But the type of work humans do will change.
@brockpierson Not weird. My ultimate fallback plan is to just move to New Zealand and live in the bush and hunt deer like Barry Crump.
Would be quite an adjustment for my family
Sometimes I fantasize about deleting all of my social media accounts, not working on computers or tech and going off grid forever.
Anyone else or am I just weird?