Wilkane

@Suparious @aditiitwt Tinygrad is good. vLLM support on ROCm is also fine

Well, I tried to save a few $$ and bought 2 AMD 7900 XTX cards, just to find out that ROCm support was useless at best, and could never use the two GPUs together with one model. So I decided to build a whole "data layer" that could empower a small 4B model that I could run at full float (no quantizing) and have it appear to be intelligent. I can run this 4B model on an NVIDIA 3060 12GB GPU, but need a full kubernetes cluster to make it smart.

Just met a guy who stopped paying for Cursor, Claude, ChatGPT, Gemini, Codex & Perplexity Now he runs everything locally on his own machine No API limits No token costs No monthly subscriptions No data leaving his system Paid once for the hardware… and that’s it Feels like owning your own brain instead of renting one 😭 What kind of setup do you think makes this practical?

@venturetwins Will power is for losers

I don't want to be an asshole here, but I'm worried we're losing the concept of personal responsibility

@krishnanrohit Because the individual doesnt know its bad. The individual knows hardly anything about anything

What's the underlying reason why so many people so radically prefer bad economic policies like price controls, considering we've known they're bad for decades now?

@SwannMarcus89 The problem is former trump supporters don't have a change in values, they simply think they bet on the wrong dictator and will happily vote for the next dictator they vibe with. The wrong lessons were learnt

It pisses me off how whenever a former Trump supporter turns on him liberals make fun of them for being a rube Don’t you think it’s kind of bad conservatives welcome defectors with open arms while we demand they say 500 Hail Marys before we invite them to the cocktail party?

Im at a family office AI meetup. The net value of this room is in the billions and yet most are struggling to explain what a token is. What the fuck is happening

@BradAllen_87 @xevekiah You need a better brain

@xevekiah So any woman who has kids gets married and worked only did it as a direct result of feminism. Prior to feminism no woman ever had kids, worked or got married apparently.

she has 3 university degrees, she’s a businesswoman and ceo, she got married in her 30s (to a man 5 years younger than her), had kids in her mid 30s… he entire life is the result of feminism

@Ethantmercer @ABmrJutt Lol no it doesn't. If you drink, good luck finding a liver

@ABmrJutt Healthcare usually treats people regardless of how they got there. The real debate around abortion is more about autonomy and when/if another life is considered in the equation.

If abortion is illegal because “sex has natural consequences,” then liver transplants for alcoholics and lung transplants for smokers should be illegal too because consequences, darling, are so consistent.

@ABmrJutt Tbf, we do deprioritize smokers and drinkers for transplants no?

@kr0der Until the models can maintain a mental model of an entire codebase, none of these tools will be properly great

i’m currently testing Opus 4.6 in Claude Code after using Codex for 3 months straight both have a big downside and i’m currently weighing which one actually slows me down more: Codex - random abstractions, random helpers, not that good at frontend, variable/function naming could use some help Claude - less thorough so it often misses places when implementing features, and produces slightly more bugs in general

@TynanSylvester There's a lesson in there somewhere

It's underappreciated how little freedom you have while designing a game. You can't just make what you want. You have to to make what works, and you don't get to choose that.

@sudoingX Amen

companies are blindly burning thousands $ on fine-tuning before they even know if the base model can do the job. i've seen it firsthand. someone finetunes a large model on enterprise GPUs and the result matches a base model they could have tested for free. the smarter path should be test on a single consumer GPU first. run your actual workload on a 3090-5090 with the base model. find where it breaks. find where it's already good enough. then finetune only the gaps. then scale compute. if your finetuning is the bottleneck, throwing more hardware at it won't fix it. the problem is usually upstream. a $900 GPU and 2 hours of testing would have told you that before you burned $10K in compute. i test models on consumer hardware every day. the number of times a well chosen base model at the right quant outperforms a fine tuned model on 10x the hardware would surprise you.

Alphafold for materials science is the missing unlock to replicate TSMC

@iabhinavKhare Are all four legged animals cats?

@LinkofSunshine Actually true. More people unemployed seems to make people happier than everyone having higher prices. This is stupid but seems empirically true

Ultimately the failure of Bidenomics was simply betting against this

@altryne Well the programs you can run on it are more valuable so yeah

Ah yes... the bubble where the tulips of *checks notes* 4 years ago are more valuable now than then.

@crypt0lake Tbf, thats what reasoning is too

"AI" and it's just a control loop

@HeLiuLeo I mean, that's just not true but okay..

I’m so tired of ignorant foreigners worshipping China’s railways and bridges. China’s infrastructure looks great, until you realize almost every single province is bankrupted like pre-2010 Greece, or worse. It’s called ‘local debt’. Think about it: the entirety of China’s savings by ordinary people and firms over decades of economic boom got dumped into these rubbish assets through the government-controlled banking system. Roads and bridges are classic vanity political projects: look good but make no money. To build these on debt is financial suicide. And when local debts become insurmountable, the central government poured even more savings into these irresponsible, default-worthy debts. Every city on earth can build new bridges, roads and highways if they’re willing to empty their bank accounts and borrow as China did (and able to bulldoze over houses at the government’s will.) Yet, behind every new bridge in China are a bunch of effectively bankrupted families whose bank savings have been completely decimated. They just don’t know it, because - guess what - the government controls information too.

Once again, Opus 4.6 just moggs every other model. Not even close. Anthropic must have sacrificed a thousand virgins or something for the black magic they distilled into a series of FP32 numbers...

@Ravenismeee Whiplash

I need a movie where the villain actually won

@itsalexiagrace Well actually, they are in the US. Pornhub is literally banned in like 20 states

People don’t hate OnlyFans because it exists… they hate it because women are profiting from it. No one’s screaming to shut down Pornhub, are they?