Joe Schmid

238 posts

Joe Schmid

Joe Schmid

@jschmid

Forward Deployed Engineering @ https://t.co/rij9dk4elc

Pittsburgh, PA Katılım Ekim 2007
2.3K Takip Edilen317 Takipçiler
Joe Schmid
Joe Schmid@jschmid·
"We'll just build it ourselves" is the most expensive sentence I hear from prospects. Then, teams come up against the Context Chasm. The pattern is consistent. Teams burn months, and they lose their best engineers to the work. Most never ship the build at all. Context infrastructure works the way version control works. You adopt it. You don't build it. Adam's piece on why: driver.ai/blog/diy-conte…
English
0
0
1
13
Joe Schmid
Joe Schmid@jschmid·
"We'll just build it ourselves" is the most expensive sentence I hear from prospects. Then, teams come up against the Context Chasm. The pattern is consistent. Teams burn months, and they lose their best engineers to the work. Most never ship the build at all. Context infrastructure works the way version control works. You adopt it. You don't build it. Adam's piece on why: driver.ai/blog/diy-conte…
English
0
1
2
21
Joe Schmid
Joe Schmid@jschmid·
Matt Nassr at Optiver described a pattern we keep hearing from engineering leaders. His researchers and traders got dramatically more productive once AI entered the workflow. They consumed pipelines faster, asked sharper questions, ran more experiments. Nobody planned for who would answer all those questions. The questions were reasonable. Does a feed exist for this instrument? What fields does this market dataset expose? Can this pipeline support intraday resolution? Context questions, not research problems. The kind a well-indexed system should answer on its own. The system couldn't. So the questions routed to the engineers who built it. Senior people who should have been designing next-gen infrastructure were burning real chunks of their week on lookups. The AI agents were supposed to handle this. They didn't have reliable context, so they punted humans back into the loop. Context infrastructure isn't a dev tools problem. It's an org design problem. When your best engineers are the indexing layer for your codebase, the company doesn't scale. It just gets more expensive. Once Driver gave Optiver's agents a deterministic view of the codebase, the questions stopped routing through people. driver.ai/blog/optiver-c…
Joe Schmid tweet media
English
0
1
0
36
Joe Schmid
Joe Schmid@jschmid·
@nitmusai That's well said. Our product keeps context up to date with every push to remote and on every active branch in all repos. When AI coding agents ask for task-specific context from our MCP server, we assemble dynamic context from that up to date understanding of customer codebases.
English
1
0
0
16
Nitish Mutha ⚡️
Nitish Mutha ⚡️@nitmusai·
@jschmid Stale docs fed to an agent is not context engineering. It's wishful thinking. The whole point is live evolving context, not a snapshot from last sprint. Automating context collection is where the real work is.
English
1
0
0
34
Joe Schmid
Joe Schmid@jschmid·
A pattern we kept seeing before we built Driver, that I think most engineering leaders will recognize: A team takes the reasonable approach to giving their AI coding agents context. Export the codebase docs to markdown, check them into the repos, point agents at the right directories. At @OptiverGlobal, the team was shipping 120+ commits a day. By the time a markdown file describing a pipeline was reviewed and merged, the content was already stale. The docs weren't wrong because anyone was careless. They were wrong because the code moved faster than documentation could keep up. The bigger problem wasn't the staleness. It was the hidden tax. Engineers weren't just writing docs, but rather they were maintaining them, explaining to agents why the docs disagreed with reality, then re-prompting when the agent got confused anyway. Documentation stopped being an asset. It became a liability. The lesson: if humans have to keep the context fresh by hand, the context will always lag the work. Automating coding agents is the easy part. Automating the context they need is the harder one. That's what we've been heads-down on.
Joe Schmid tweet media
English
2
1
3
221
Joe Schmid
Joe Schmid@jschmid·
If you're using an AI coding agent like Claude Code, Cursor, Codex, etc. with microservices spread out across repos, you've got a challenging context engineering problem. Read this:
Daniel Hensley@dw_hensley

Highly distributed, multi-codebase systems have structural properties that current AI coding tools can't navigate. What we've found is that the multi-codebase problem is a context problem, and context problems are solvable if you treat them as compilation rather than search. 𝗧𝗵𝗲 𝗣𝗿𝗼𝗯𝗹𝗲𝗺 We've been working with engineering teams that have many codebases totaling from 3 million to 40 million+ lines of code. A number of them run microservices architectures with hundreds of repos. A pattern we keep seeing: AI coding agents fall down significantly when a task crosses a service boundary. And when you're developing against a large microservices architecture, this is constant. Three challenges drive this. 𝗖𝗼-𝗹𝗼𝗰𝗮𝗹𝗶𝘁𝘆. In a microservices architecture, no developer has every relevant repo cloned and open, and often doesn't start a task knowing which repos are relevant. An agent inherits this limitation. It can only reason about what it can see, and in a distributed architecture, most of the relevant context is somewhere else. 𝗜𝗺𝗽𝗹𝗶𝗰𝗶𝘁 𝗱𝗲𝗽𝗲𝗻𝗱𝗲𝗻𝗰𝗶𝗲𝘀. In a monolith, dependencies are explicit via imports, function calls, class hierarchies, etc. and an agent can trace them. In a microservices architecture, the connection is often a URL string in a config file, or two services reading from the same database table without either one knowing about the other. These relationships are real and load-bearing, but invisible to tools that reason at the code level. 𝗡𝗼𝗻𝗹𝗶𝗻𝗲𝗮𝗿 𝗰𝗼𝗺𝗽𝗹𝗲𝘅𝗶𝘁𝘆. A codebase with N symbols has N-squared potential relationships. Teams try to solve this by introducing context about the service layer into their repos, but it doesn't scale: documentation rapidly goes stale and RAG-based approaches chunk code into text fragments, destroying the structural relationships that matter most in distributed systems. Furthermore, identifying the structural connectedness through interfaces of isolated services requires its own derivative analysis. 𝗔 𝗖𝗼𝗱𝗲𝗯𝗮𝘀𝗲 𝗖𝗼𝗺𝗽𝗶𝗹𝗲𝗿 𝗶𝘀 𝗖𝗿𝗶𝘁𝗶𝗰𝗮𝗹 Our approach at Driver starts with what Adam and I call our transpiler: a compiler-like architecture we built that begins by parsing code via static analysis and emits structured context instead of executable code. A core feature here is exhaustiveness. Symbol tables, dependency graphs, and syntax trees are all computed deterministically for every file and symbol in each codebase. This is the foundation, and it matters. It means every codebase we process is understood exhaustively, not sampled. For microservice architectures, and other intensively multi-codebase systems, we have observed that this exhaustive understanding of each individual codebase is absolutely necessary but not sufficient. The reason is that the connections between services don't live at the level of syntax analysis or even analysis of any kind of any one codebase. In a monolith, you can follow imports and function calls to trace a dependency. In a microservices architecture, the dependency might be an HTTP endpoint defined in one service and called via a string constant in another (a more difficult version of the "stringly-typed" problem). It might be a shared database table, a message queue topic, or an event schema that two services conform to independently. These relationships are invisible to any tool reasoning within a single repo, no matter how thoroughly it parses the code. To capture these, we needed to go further: later stages of the transpiler that synthesize across the parsed structure of individual codebases, and a runtime layer that can reason across all of them simultaneously. 𝗔 𝗨𝗻𝗶𝗳𝗶𝗲𝗱 𝗔𝗽𝗽𝗿𝗼𝗮𝗰𝗵 𝘁𝗵𝗮𝘁 𝗨𝗻𝗹𝗼𝗰𝗸𝘀 𝗠𝘂𝗹𝘁𝗶-𝗖𝗼𝗱𝗲𝗯𝗮𝘀𝗲 Two developments have unlocked multi-codebase context. 𝗛𝗶𝗴𝗵𝗲𝗿-𝗹𝗲𝘃𝗲𝗹 𝘀𝘆𝗻𝘁𝗵𝗲𝘀𝗶𝘀. Beyond symbol-level static analysis, later stages of our transpiler produce intermediate representations (IRs) at many different levels of abstraction. These culminate with what we call Deep Context Documents: atomic, codebase-wide documents that describe architecture, major components, how they interact, and (crucially) where to go for more detail. These are synthesized by exhaustive review of all the structured content from earlier transpiler stages. They capture the conceptual and architectural relationships that exist above the code level, including cross-cutting concerns, integration patterns, and service boundaries. For an agent, this solves the "don't know what you don't know" circular problem that is so challenging without exhaustive context. 𝗠𝘂𝗹𝘁𝗶-𝗰𝗼𝗱𝗲𝗯𝗮𝘀𝗲 𝗿𝘂𝗻𝘁𝗶𝗺𝗲 𝗽𝗿𝗶𝗺𝗶𝘁𝗶𝘃𝗲𝘀. We built a runtime layer where an agent connects to Driver via a single MCP integration and can query context across every codebase in an organization. Via the primitive tools, all pre-computed artifacts are queryable per-codebase: architecture overviews, file-level documentation, code maps, changelogs, source files. We also provide a single deep context sub-agent tool. Under the hood, this runs a dedicated context agent with access to all pre-computed artifacts. When a task spans multiple services, the agent queries context from different codebases exactly the way it queries within one. It synthesizes everything into a single, high-signal response tailored to the task at hand and returned to the caller. The combination is what matters. The transpiler's static analysis gives you exhaustive per-codebase understanding. The higher-level synthesis captures cross-cutting relationships that don't live at the code level. The runtime makes all of it queryable across every codebase simultaneously, so the agent sees the full system, not just whatever repo it happens to be sitting in. No co-locality requirement, manual assembly, or re-deriving what was already known. 𝗪𝗵𝗮𝘁 𝗪𝗲'𝘃𝗲 𝗦𝗲𝗲𝗻 A customer had a bug where bookings were completing despite no payment records. The investigation spanned 4-5 services across order orchestration, admin, and payments. This bug had been investigated multiple times before and missed. One engineer used Driver to trace the issue iteratively: broad exploration first, then narrowing hypotheses, then precise constraints. Driver pinpointed the exact method where validation logic silently passed orders with zero payment records. Total hands-on time: about 30 minutes. As the engineer described it, instead of needing three people with intensive knowledge of different services, one person got 80% of the way there, then brought in specialists to confirm. Another team with 200+ microservices built a workflow on top of Driver that takes a single Jira ticket, identifies which repos are impacted, gathers context across all of them in parallel, and generates per-service subtasks with specific file paths, class names, and implementation patterns. The constraint before, as one of their engineers put it: "you've got to know which repos." With all repos accessible through a single integration, that constraint disappeared. Beyond debugging and ticket analysis, teams report that Driver changes the baseline for development in multi-codebase environments. Concerns that historically slowed work (unknown blast radius, missing context from adjacent services) are addressed by the same cross-codebase context layer. One large microservices team reported 2x average PR velocity team-wide after introducing Driver. 𝗧𝗵𝗲 𝗕𝗿𝗼𝗮𝗱𝗲𝗿 𝗣𝗼𝗶𝗻𝘁 A fundamental tradeoff of microservices has always been autonomy in exchange for complexity. Small, independent services are easy to deploy individually but hard to reason about collectively. AI coding tools struggle with this in the same ways developers do. This is a genuinely complex problem and the fact that tools today (for agents and humans) are often single- or few-codebase centric exacerbates this issue. This tension has significantly held us all back. What we've found is that this is a solvable problem if you approach it at the right level. Per-codebase exhaustive context compilation is the foundation, but the microservices unlock is at a higher layer: synthesized understanding that captures cross-service relationships, and a runtime that makes it all accessible through one integration. The agent sees the whole system and understands the connections relevant to a particular task. The more codebases you have, the more immediately this compounds. If your team is running a distributed architecture and your agents are struggling with cross-service work, the issue is probably not the agent. It's what the agent can see.

English
0
0
1
56
Chris Albon
Chris Albon@chrisalbon·
If I wanted to skate towards where the puck will be, is that agents in cli or a full app like Codex?
English
22
0
16
6.9K
Joe Schmid retweetledi
Ben Williams
Ben Williams@biwills·
git worktree is going to be everywhere in 2026
English
0
1
2
153
Joe Schmid
Joe Schmid@jschmid·
Another innovation from @PrefectIO. Horizon is the control plane for managing MCP at scale.
Jeremiah Lowin@jlowin

Every company will have a context layer. Today, we're launching Prefect Horizon to make that possible. The context layer is where AI agents interface with your business. It's where teams expose their proprietary data, tools, and workflows to autonomous systems. It’s where you define what agents can see and do, and where you curate and distribute the context that makes automation useful and safe. We know what this requires because we created FastMCP, the standard framework for working with the Model Context Protocol. We've watched it grow to a million downloads a day. But we've also seen the protocol's limits. MCP describes how to *build* a server, not how to govern it at scale. It doesn't tell you how to deploy it, secure it, or share it with 5,000 colleagues. We built Prefect Horizon to turn MCP from a protocol into a platform: 🚀 Horizon Deploy: Managed MCP hosting that gets you from PR to governed endpoint in 60 seconds. 📚 Horizon Registry: A central catalog for all your MCP servers, including first-party, third-party, and our new remix servers that compose multiple sources together. 🔐 Horizon Gateway: The control plane enterprises need: role-based access control down to the tool level, audit logs, and usage visibility. 💬 Horizon Agents: The last mile. Give business users an agentic interface to your company without ever knowing what "MCP" is. This is automation for the context era. Welcome to Horizon.

English
0
0
1
58
Joe Schmid retweetledi
Jeremiah Lowin
Jeremiah Lowin@jlowin·
Every company will have a context layer. Today, we're launching Prefect Horizon to make that possible. The context layer is where AI agents interface with your business. It's where teams expose their proprietary data, tools, and workflows to autonomous systems. It’s where you define what agents can see and do, and where you curate and distribute the context that makes automation useful and safe. We know what this requires because we created FastMCP, the standard framework for working with the Model Context Protocol. We've watched it grow to a million downloads a day. But we've also seen the protocol's limits. MCP describes how to *build* a server, not how to govern it at scale. It doesn't tell you how to deploy it, secure it, or share it with 5,000 colleagues. We built Prefect Horizon to turn MCP from a protocol into a platform: 🚀 Horizon Deploy: Managed MCP hosting that gets you from PR to governed endpoint in 60 seconds. 📚 Horizon Registry: A central catalog for all your MCP servers, including first-party, third-party, and our new remix servers that compose multiple sources together. 🔐 Horizon Gateway: The control plane enterprises need: role-based access control down to the tool level, audit logs, and usage visibility. 💬 Horizon Agents: The last mile. Give business users an agentic interface to your company without ever knowing what "MCP" is. This is automation for the context era. Welcome to Horizon.
Jeremiah Lowin tweet media
English
21
34
494
287K
Joe Schmid
Joe Schmid@jschmid·
@SahilBloom “The Supreme Personality of Godhead said: The giving up of activities that are based on material desire is what great learned men call the renounced order of life [sannyāsa]. And giving up the results of all activities is what the wise call renunciation [tyāga].”
English
0
0
0
18
Sahil Bloom
Sahil Bloom@SahilBloom·
The older I get, the more I realize that most progress won’t feel like progress. Some seasons are about planting seeds you won’t see grow for years. Learn to work without validation. Take pride in it. The world belongs to those who show up even when the rewards are uncertain.
English
96
178
1.4K
55.3K
Joe Schmid retweetledi
Jeff Twohey
Jeff Twohey@Jefftwo·
Youngest grandson cheering on Team Canada tonight……taking a break from outdoor rink fun 🇨🇦🇨🇦🇨🇦🇨🇦
Jeff Twohey tweet media
English
28
30
2K
142.5K
Joe Schmid
Joe Schmid@jschmid·
@davebudge Do you have a butcher shop close? Might be able to take 'em there and pay a few bucks for them to cut 'em up for you.
English
1
0
0
29
Old Bull Lee
Old Bull Lee@davebudge·
My son-in-law just brought me about 20 lbs of elk and deer bones. The only problem is that all of them are way too long to put in my huge stock pot. He told me to take them out to the garage and use my chop saw. I need to consider the hygienic aspects. They are lovely otherwise.
English
1
0
1
66
Lin
Lin@Speculator_io·
𝗧𝗵𝗲 𝗦𝗶𝘅 𝗟𝗮𝘆𝗲𝗿𝘀 𝗼𝗳 𝘁𝗵𝗲 𝗔𝗜 𝗥𝗲𝘃𝗼𝗹𝘂𝘁𝗶𝗼𝗻 Tier 0 - Energy $LEU $CEG $OKLO $BE $NXT $VST $TLN $GEV $AMSC $NVTS $BWXT Tier 1 - Chips $TSM $NVDA $AVGO $AMD $ASML $ARM $INTC $MRVL Tier 2 - Data Centers $NBIS $IREN $CRWV $APLD $GLXY $WYFI $ORCL $AMZN $GOOGL Tier 3 - Foundation Models $GOOGL $META $NVDA $MSFT $AMZN $BABA Tier 4 - Software Infrastructure $INOD $PLTR $BBAI $SNOW $DDOG $MDB $VERI $SYM Tier 5 - Al Agents $PATH $CRM $NET $SOUN $PEGA $GOOGL
Lin tweet media
English
134
743
3.2K
383.6K
Joe Schmid
Joe Schmid@jschmid·
@sanglucci Inflation, especially since it’s scary. (Duct tape a hand pump used to inflate a basketball, soccer ball, etc. to an old shirt.)
English
0
0
1
4.9K
SangLucci™
SangLucci™@sanglucci·
I usually don't celebrate Halloween at all Frankly I think the shit is weird A decade ago I dressed up as Sammy Davis Jr. However, I was invited to a big party And I am in need of some costume ideas Send me what ya got
English
18
1
5
3.8K