marius eriksen

@yminsky @AntithesisHQ Antithesis is so cool! And I'm sure a great complement to the world of engineering with agents. cc @lennypruss

It's been a minute, but, time for another Signals and Threads, this one with Will Wilson about the testing tools he's building at @AntithesisHQ. And, in a bow to modernity, we have a video version of this one too!

@nk @dhh also, this is a very common device in british news writing in general; part of why i love them!

@dhh Like if it's not obvious, this is written as if the interior monologue of someone the economist detests.

Find someone who will eulogize you with the romantic flair and fawning adoration of The Economist remembering Khamenei. archive.md/Jl1ki

In other words, computer science will become a science?

@yminsky I've been using Vercel to good effect.

So, where is the application hosting platform of the future that's optimized for vibe coding? There are a ton of little applications I'd love to build for myself if the costs and annoyances of setting up services and permissions were mitigated.

@nk I am working on one system where we have extensive tracing. Just dump the raw traces (spans, events) into a sqlite db, and give it a goal. In this system, Claude has been able to find quite subtle bugs and perf improvements...

I think long-term you are right we may end up with these large inscrutable systems. But I just don't think that's 2026 or 2027 for a lot of software. The longer the software needs to "live" the higher the requirements for scrutability. But the pace of improvement is surprisingly fast, who knows. These steering structures, though, are already super valuable (unit tests, assertions, skills, etc) and I'm trying to come up with more stuff to feed the beast. I've started putting traces+meters+gauges specifically as real-time feedback for the llm to observe when making changes. Have you found anything interesting?

Prediction: code quality will continue to matter a lot - at least for the next few years. High availability network services, for example, can easily have impossible to debug cascading failures when the architecture is unsound. There is a large class of software where just barfing out a million lines of code is going to be a disaster. This applies to a lot of SaaS stuff that people are currently paying for, not to mention anything related to payments or banking. Most of us don’t really care about the generated assembly code of our software (except in some critical sections), and we don’t consider duplicated (inlined) asm instructions to be “slop”. So I think there is a good chance that for a lot of programming “in the small” (ie, internal to a single function) the quality of that code will matter less and less. But the basic structure of software: how it’s decomposed into modules, how cohesive the design is, the fundamental choice of data structures, and so forth: high code quality here will allow llms to be more productive, produce fewer bugs, and move faster. This is “programming in the large”. Today’s models (Codex 5.3 and Opus 4.6), are genuinely awful at this programming in the large stuff. Obviously it will get better with time. But for the foreseeable future the best harness for these models is high quality code, good unit tests, good type checking, explicit invariants assertions, etc.

@nk But I do think the role of (good) software engineering will be setting up safe large-scale structures for LLMs within which they can remain productive.

@nk Evolved, rather than engineered, because the models are good at fixing things pointwise, and are inexhaustible. They are clever enough to come up with locally robust fixes that solve the issues. It's hard to resist the economics of that.

@kevinweil @JaidevShah4 humans were the GPU bottleneck all along

@JaidevShah4 Right? I would NOT have predicted this a year ago.

@wickman still the best city

gm

9 months ago @Color partnered with @OpenAI and @UCSF to bring world-class cancer expertise to everyone. To achieve this, we designed a novel architecture that safely integrates GenAI into clinical practice. We call it a “Large Language Expert” (LLE). 🧵

Free speech with Premium.

@aboodman @benthompson DM me your email and I'll send it to you

.@benthompson I will venmo you $20 to read this article but I don't want another fucking subscription. I bet I am not alone. stratechery.com/2024/president… And if you let me do that, it's possible that after paying $20/article a few times I do eventually decide to subscribe.

Today, we're sharing some big updates on @Color's Virtual Cancer Clinic. It's the nation’s first clinic of its kind, designed from first principles to create a modern care model, rather than simply working around the current system. As with many aspects of our lives over the past 20 years, we believe that with a virtual-first distribution model, it is possible to improve both the cost and quality of services we receive. Instead of assuming that high quality care needs to be centralized, scarce and expensive, we believe that it is possible to serve a national footprint in a way that makes world-class care accessible, equitable and affordable. Check out this post about the principles we followed in creating this model. If you want to get involved with our work, please reach out! color.com/blog/colors-vi…

Going to teach my kids about control theory

The customer is always liable.

My daughter just described my style as “hiking nerd” which I think was supposed to be a burn but is actually very apt.

This woman is spot-fucking-on‼🔥🔥🔥

@sampullara aka "density"

no matter where i am in sf

@mattklein123 Tbh, this is mostly speculative, and responses like yours exactly why I asked! On the surface, async just seems like a pretty awkward bolt-on: 'static lifetimes and Pin<Box<dyn Future<...>>> abound... But it's good to hear that this maybe doesn't get in the way.

@marius Copious amounts of async rust code written. There are a few warts but I don't find it awkward at all. I love it! What problem are you having?

shitposting aside, who has experience working with async in Rust? On the surface it seems quite awkward and not a great fit.