Respan

Introducing Respan AI Gateway. The world’s first AI gateway with built-in observability, evals, and prompt optimization. Access 1,000+ models through one endpoint, with the production layer teams need beyond routing.

5/ Make evals part of production ops Online evals should not live in a dashboard nobody checks. Connect Respan to your monitoring, alerting, and incident response systems so AI quality becomes an operational signal, not a postmortem artifact.

4/ Turn eval scores into alerts Configure thresholds and trigger webhooks when quality drops. Use them to notify your team, create review queues, or kick off incident workflows from actual eval results.

Introducing Respan Evals 2.0: Automation. Most AI production issues don’t show up as errors. They show up as answers that look valid but are wrong, incomplete, unsafe, or off-brand. Respan now runs automated online evals on live production logs to catch silent quality failures in real time.

everyone passed the stress test.

Spent this week looking at AI eval tools. They're all the same tool. LLM-as-a-judge, wrapped for model outputs. Then wrapped again for agent traces. That's the whole category. Nothing new under the hood. The hard part is getting to your first eval that actually means something.

Just found this thing called logprobs, and OpenAI is hiding it on their newest models. It's the real % a model puts on each next word before it picks one. So I asked 3 models how many R's are in "strawberry," had each one state its confidence, then checked the receipts. All three said 100% sure. Only one actually was. Feels like a party trick, but it gets genuinely powerful the moment you bring it into LLM evals. When you ask a model for a score, the real output isn't one number, it's a distribution: 1: 10% · 2: 20% · 3: 15% · 4: 35% · 5: 20% Do you take the average, or just the max? Genuinely interesting thing to sit with.

Artificial intelligence is a full production pipeline pretending to be one button.

This is exactly the kind of shift we watch across the AI dev tools landscape.

@francchen Mindshare like this usually shows up in adoption a few months later.

Global monthly searches, AI coding tools: Claude Code: 2.06M GitHub Copilot: 721K Cursor: 584K OpenCode: 298K Claude Code pulls more searches than Codex and Cursor combined. It's not close.

Thrilled to co-host this voice‑coding hackathon🚀 Join us Friday in SF for a night of building and experimenting together. See you there! @VoiceCursor @convex @photonhq

@novita_labs respan.ai/ai-gateway

.@novita_labs models are now 10% off through Respan Gateway. Get your API key - link in comments.

@MiniMax_AI respan.ai/ai-gateway

.@MiniMax_AI M3 is now 50% off on Respan Gateway through June 16. Get your API key - link in comments.

@francchen 🔥🔥🔥

10 engineers × 4 CLI agents = 40 accounts, 40 invoices, 40 price tags. We made it 1. Claude Code, Codex, Gemini CLI, OpenCode, and more can now run through Respan Gateway with unified billing and discounted usage.

Take good care of your billing through @RespanAI