پن کیا گیا ٹویٹ
Hello people,
So I was running 3 LLM providers in production. 3 SDKs, 3 billing dashboards, 3 sets of docs. Every time I wanted to try a new model I was rewriting the integration code.
OpenAI went down one night and my app just sat there. Dead. No fallback, no routing, nothing. Just a blank screen and angry users.
Then I checked my bill at the end of the month. That was a fun morning.
So WE (@theunblunt, @intermurphi, @Palakonweb) built Metriqual.
Same OpenAI SDK. Change 2 lines, base URL and API key. Now GPT-4, Claude, Gemini, Llama all run through one endpoint. I swap models by changing a string. No refactoring.
Provider goes down? It hits my fallback automatically. Rate limited? Routes around it. My users never know if something broke.
I set a daily spend cap. I see every request, every cost, every failure in real time. I A/B test models from the dashboard. I update prompts without deploying. PII gets stripped before it ever touches the LLM.
All the shit I was building in-house for months was gone in 60 seconds.
Free tier. No credit card. 15+ providers. One key.
metriqual.com
English
