David Petrou

"The future will come in one minute." -- my three-year-old daughter.

@badlogicgames @juliarturc , do you know? Couple quick things: we've gotten very nice results on a hebbian inspired approach (no fine tuning) I'll blog about soon. Secondly, there are lots of non open ai options for qlora.

any idea how well that works for baking in actual knowledge? i played with lora a long while ago and it wasn't quite useful for knowledge, but great for style, or adhering to a specific output structure. also, it seems openai shut down their fine tuning offering. guess for a reason.

recommended viewing youtu.be/NQczevdpxq0?is…

@badlogicgames lora / qlora can get you far re: per user models.

on memory/continual learning, he's very clear that that will be an app level thing, not a model thing, because it's not practical, economical or even possible to fine tune per user models. i think we'll find a lot of other limitations that can never be solved in the model layer, simply because we've kinda painted ourselves into an architectural corner with transformers. which is why i think transformers will be a primitive within AGI systems, but are very unlikely to be the sole thing giving us AGI. on a more positive note, that means there's ample opportunity for folks outside the big labs to innovate and create systems that are more than just a chatbox hooked up to a model. it also means, that a lot of this work will basically be relearning all the things from information retrieval ca. 2000s, and combining that with new methods. same for ensemble techniques, etc. a certain CEO at chroma is gonna like this tweet :)

@MattBruenig @bigblackjacobin @Noahpinion The math/cs is nice. But yah, we need a psychological post-mortem on this collective delusion.

@Noahpinion It’s sad that Silicon Valley seemed to spend a decade on blockchain and crypto which was totally useless outside of crime facilitation

It wasn't just crypto. A big factor was post-2020 DEI at tech companies, which previously had been the most meritocratic of industries.

@chemendonca Q6!

@dpetrou The new K3 Ultra from Keychron?

got a new computer keyboard. marketing was really really big on the 8k polling rate. is this for robot agents to use or something?

@Freyy_is @birchlse Massive privacy violation

there was something beautiful about library checkout cards because you could literally see the history of human curiosity attached to a book. like a tiny ghost trail of strangers connected by the same story.

@Yuchenj_UW Bell labs.

Whoever invented “Member of Technical Staff” was a genius. It filters out Staff/Principal title-maxxers, protects engineering and research from corporate ladder brain, and leaves recruiters staring at LinkedIn like: “Is this person L4 or L7?” MTS is the best title. Happy to be MTS.

@tunguz Until it can make an x11rc file or .xsession, it's not agi.

I am making Codex upgrade my very old System76 laptop running Ubuntu 16.04 with 1070 GPU. Codex is running on my Mac laptop and upgrading the Ubuntu one via terminal. If it pulls it off, I'll concede that we have AGI already.

just as neural networks are believed to be wildly bigger than they need to be, code generated by agents is wildly out of control. exactly the kind of problem problem we're working on these days.

@ThePrimeagen that keyboard looks so uncomfortable.

I am remembering right now for my own sanity. There is so much peace in deep thought instead of some insane frenetic agent orchestration fever dream

@draparente just tell your clanker to read the book.

Earlier this year I was getting frustrated with Claude's charts, fed this book to claude and had it generate a Tufte skill. Instantly got simpler/more beautiful visualizations. gist.github.com/aparente/e48c3…

why do i always feel p0wned?

@willmcgugan @AnthropicAI hey, the kids find mp3's good enough, ... so...

My concern for the AI era, or at least this phase of it, is that a generation is being taught that "close enough" is just fine. Take @AnthropicAI for example. Text wrapping in Claude Code has been broken for weeks. Superfluous spaces appear on the left edge. One engineer to another: you know its an out by one error. I refused to believe that nobody has noticed this. The shtick they are selling is that AI can fix this kind of thing. Either they tried to prompt a fix, and Claude ain't good enough to fix an out-by-one error. Or they haven't attempted it because it is "close enough". It can't be the case that AI is only good enough if we lower our standards. It can't. I'm well aware I have both feet firmly planted in my "grumpy old man" phase of life...

@KentonVarda too light.

1999 Microsoft IntelliMouse Explorer, still the greatest mouse ever made.

@HedgieMarkets or self-hosted / at-edge models become good enough.

🦔Microsoft canceled its internal Claude Code licenses this week after token-based billing made the cost untenable, even for a company with effectively infinite cloud resources. Uber's CTO sent an internal memo warning the company burned through its entire 2026 AI budget in just four months. American AI software prices have jumped 20% to 37%, and GitHub (owned by Microsoft) is dropping flat-rate plans for usage-based billing across its products. My Take The AI subsidy era is ending in real time. The same company that put $13 billion into OpenAI and built the Azure infrastructure powering most of Anthropic's compute just looked at the bill from a competitor's coding tool and decided it was not worth paying. That is not a productivity failure on Anthropic's end. Token-based pricing is forcing every enterprise customer to confront the actual cost of running these models at scale, and the number turns out to be far higher than the flat-rate experiments suggested. This ties directly to my Gemini Flash post yesterday. Anthropic, OpenAI, and Google all raised effective prices in the last six months. Enterprises that built workflows assuming AI costs would keep falling are now watching annual budgets evaporate in months. Two outcomes look likely from here. Either enterprises scale back AI usage to fit budgets, which slows the revenue ramp the labs need to justify their valuations ahead of IPOs, or the labs cut prices and absorb the losses, which makes the unit economics worse at exactly the wrong moment. Both paths land in the same place, the numbers stop working, and somebody has to take the writedown. Hedgie🤗

@ibuildthecloud wassup?

I'm so frustrated. I need to be put out to pasture. I just can't do this. None of this makes sense. I don't have control of anything. I don't want fight the whole world. I've done that for so long. At what point do you give up?

@FredKSchott coming late to this post -- agreed on the security posture and the big unlock w/ sandboxen.

In the next release: Connect your agent to any remote sandbox. We output the official guide, your coding agent reads it and writes a connector directly to your codebase. No npm packages to install. No third-party deps to manage. No more hassle. shadcn for agent setup.

@mitsuhiko subscription. will do next it happens -- thanks. and sorry for using twitter as support.

@dpetrou Can you share a broken session with me? (/share, use pi -r to resume one first)

@mitsuhiko , this, usually followed by websockets issue, is happening more and more for me on pi (using gpt-5.5 high), and /compact doesn't fix it. having to start fresh pi sessions and reconstruct state to unbork it. ``` Error: Codex error: {"type":"error","error":{"type":"invalid_request_error","code":"context_length_exceeded","message":"Your input exceeds the context window of this model. Please adjust your input and try again.","param":"input"},"sequence_number":2} ```