John McBride

🧃 Introducing stereOS: a Linux based operating system hardened and purpose built for AI agents. It's clear that agents need an ACTUAL operating system (not what people are calling an "OS") to witness the full breadth and depth of their capabilities while mitigating the blast radius of autonomous, untrusted actors. But there are so many problems with AI sandboxes today: * Going out to the apple store and buying a mac mini will never scale and is way too expensive (obviously) * Running in Docker is too restrictive (agents can't stand up their own container infrastructure, no sub virtualization, docker-in-docker is very broken) * Firecracker strips all the hardware so GPU PCIe passthrough, secure boot, FIPs, etc. is out of the question. * Native VMs are too fat and the overhead of 1 agent per VM is too much. stereOS takes a different approach: it's a full NixOS system that you boot and then kick off agent sandboxes inside with gVisor + /nix/store namespace mounting. Each agent gets their own kernel and the /nix/store is read only by nature. Even if the agent was somehow able to escape the gVisor virtual kernel, they'd land on the NixOS system as the "agent" user! Not your actual hardware!! If you want to take a defense-in-depth approach, we support "native" agents that run at the system level kicked off by our `agentd` utility. These agents, on their own, can manage and kick off other sub agents using the internal sandboxing mechanisms. Today, we're open sourcing all of this: * stereOS: our purpose built Linux OS - github.com/papercomputeco… * masterblaster: client utility to launch, manage, and orchestrate agents - github.com/papercomputeco… * stereosd: the stereOS system control plane daemon - github.com/papercomputeco… * agentd: the stereOS system agent management daemon - github.com/papercomputeco… Give it a try, throw us a star, and let me know what you think 🧃⭐️

@tannerlinsley Really enjoy Pi agent by @badlogicgames - fully customizable, open, and the ecosystem of extensions is amazing

Ghostty was fun, but time for something else. I still love opencode, too but with CC plans dead on it… I’m feeling lost. Full GUI? T3 Code? Opencode GUI? Warp? Back to cursor? Try CC again? Raw Codex? My 🧠 hurts and I just need to keep shipping.

@leerob Pretty poor look overall - what did yall think was going to happen? People wouldn’t realized the model was RL from open weights even though you passed it off as an in house product?

@johncodes This isn't accurate, we are following the license x.com/leerob/status/…

Shocking that the company that forked and monetized open source vscode, calling it their own, would distill an open weight model, disregarding all licensing, calling it their own.

This. So frustrating to see time and time again openness taken advantage of and the goodwill of the community shuttered in favor of blind commercialization. The effort to thank open source contributors and maintainers WHO BUILT THE FOUNDATION even if you’re complicit with the license is literally zero.

@rawkode It definitely was. Open weight != open source

@johncodes You think K2.5 wasn’t trained on open data and models?

@rickc42069 trust me bro it's real good.

@johncodes forgot about the TrustMeBroBench

@sudobunni fish stans unite 🎣 👏

The Internet isn't real. I don't even use bash... I'm a fish user (the superior interactive shell)

Yeah it’s called composer cos it’s composed of other models

Finally, Astral Codex

@OpenAINewsroom @astral_sh openai buying astral is like watching your favorite local restaurant get acquired by a hotel chain

so we all using kitty now huh?

I have been working on Obsidian Reader for a over a year. I didn't want to share it until I felt it was good enough. It's finally there. Consistent formatting for any article. Outline, syntax highlighting, nice footnotes, adjustable typography. Runs locally. Just rules, no AI.

@ThePrimeagen Especially annoying/frustrating when you’re ACTUALLY working on an operating system for AI systems x.com/johncodes/stat…

the amount of times i have seen "operating system" describing tools that write code or use a texting app and a cron job is terrifying is this what Andreesen meant by retardmaxxing?

"...those models have been extracted. It's called a distillation attack, Eli. I have unfettered access to your model so I generate millions of exchanges and use the outputs as training data" "No, no, no, this is Claude, do you understand?" "Do you understand, Eli? That's more to the point. Do you understand? I eat your data. I eat your compute. I eat it all up"

i am here in the nix store

16x the detail

lmao who approved this, it makes zero sense.

would you still follow me if I was a worm (that could code)

@sneezuschrist The answer is rarely "just another subscription"

@johncodes We will just switch providers nbd why qq

I've experienced something that makes me want to stop all my AI agent coding use: 1) I see elevated "Overloaded" and 529 errors from Anthropic. 2) I check and, yes, Anthropic is down. I then legitimately feel like I can't do anything. Crippled. And before you reply "har har skill issue!", I'm ex-faang, have nearly 10+ years of experience building cloud and infra technologies, successfully exited a startup last year, and I maintain open source software you rely on every single day. And yet, I feel crippled when I can't rely on the big ol "agent do a thing" button. Over the last 2 months, building a new company with my co-founder, I've leaned in: like, REALLY leaned in. Probably 90% of what we've been shipping has been AI generated - it's not all perfect but it's been a really good way to go from 0 to 1 and get early validation in the market. But, if I can't rely on tokens, if I feel crippled by a lack of inference providers, where does that leave me? Have I outsourced my thinking and abilities to AI and, at worst, companies who want to sap my intelligence for a chance to keep me dependent? This is no different with open weight models on local hardware: what happens if a GPU falls of the rack (and trust me, this hardware dies all the time, back when we operated a whole T4 GPU inference RAG pipeline, these would die and get dropped from the cluster all the time)? Open weight models also aren't open source: I can't study the model or its training data, I can't reproduce it, I can't make modifications, ad the licensing is anything but free (as in freedom). This is like having an IDE that has a very very steep price to pay AND is dependent on cloud services to be "on". I don't think this is a good paradigm for the industry at large.