MartinEigenstetter retweetledi

Let me local AI pill you:
1. It sucks compared to SOTA
2. It can’t code so well
3. It can be a good agent
4. It can be great at chat
5. It can be fine as a researcher
6. It can be a great automation engine
7. It can be tuned however you want
8. It teaches you how the sausage is made
9. It works on a plane, or in an outage
10. It costs your electric bill + hardware
11. It is better than the AI we gave up coding for a year or 2 ago.
Local AI is self defence, it is a go kit, it is a rebalancing of power.
It’s delusional to think it approaches or will ever approach SOTA, the scale of private labs blows anything you can get for less than 25k USD out the water.
Local AI is a bet that prices won’t stay this low, that private corporations with closed source weights can’t be trusted to stay consistent.
I am more than happy to rent a Ferrari for dirt cheap, but i should also have a beater Toyota if I can afford it.
Local AI is the car I can depend on to be there tomorrow, something that’s mine.

English

























