Anton Kuratnik | AI Nerd

@homoludens @shashankgoyal95 @zerohedge That's because each time it switches you to a different provider all your input tokens miss cache.

@shashankgoyal95 @anton_onAI @zerohedge i noticed it is much more expensive using deepseek flash on openrouter than using it directly.

"the share of tokens used for US models on OpenRouter has collapsed": Bloomberg

Yeah, it's awful. Try running the same complex task on DeepSeek or GLM5.2 on OpenRouter vs Fireworks. They're literally different models. Openrouter doesn't have one provider for most models. It has many and it routes you to whichever one is available. Some of those providers serve a quantized model, which reduces performance. Also, if you have a long conversation (eg agentic run) and are switched to another provider, you're paying for ALL those input tokens because they miss KV cache cuz that's with the other provider. On top of that, different providers have different outputs. When I tried running anthropic models via OpenRouter, they'd work fine and suddenly error because I got switched over to Bedrock for provider and Bedrock's API output is different and it broke the app's expected input. Plus, some models require special syntax for openrouter specifically. So Qwen via Alibaba hits cache just fine, via OpenRouter you have to add a special API argument to make sure it does. So you get: random, unpredictable performance at higher cost and with more errors. There are some models it does well with, mostly single-provider ones. Hy-3 is a beast, for example, and hella cheap.

@anton_onAI @zerohedge Was there anything specific you noticed with model quality on OpenRouter?

@paul_dentro @zerohedge At the cost of their performance and overpaying on cache.

@anton_onAI @zerohedge you don't have to get separate API Keys, can switch around models in a second

Folks: what's the best model for long agentic task? Specific use case: 2 skills, 1 mcp, and a large spec. Need a model to just follow it, not miss details, and get it done. Codex refuses to follow what's set out in the skill. Opus refuses to read documentation. Deepseek?

@ahtoshkaa @zerohedge Then just get $20/month codex and you're good.

@anton_onAI @zerohedge for small hobby projects

@LordoftheMounts @zerohedge Exactly

@anton_onAI @zerohedge Why would anyone be using open router if they are doing meaningful work?

@NoetekCo @zerohedge Depends on which provider they route you to. Try fireworks.

@anton_onAI @zerohedge moonshot.ai api is ass, for one. you can get a much better kimi instance on openrouter

It should be possible to compact an AI conversation from a specific message. Sometimes I can lose certain context but other messages need to be there in full.

@Alibaba_Qwen That's such an awesome idea! Guessing 3.8 will have this baked in

📣📣 Meet Qwen-AgentWorld — a native language world model that simulates 7 agent environments (MCP, Search, Terminal, SWE, Web, OS, Android) within a single model. Environment modeling is the training objective from day one, not a post-hoc adaptation. 🤔 LLMs are trained to be better agents — better at acting in environments. But nobody has trained them to model the environments themselves. 🗺️ Our roadmap: investigate how language world modeling can push the boundaries of general agent capabilities, along two routes: 1️⃣ Build a foundation model for environment simulation — outperforming Claude Opus 4.8 and GPT-5.4 on AgentWorldBench 2️⃣ Investigate how world modeling enhances agent training: 🔬 Controllable Sim RL (agentic RL with LWM as environments) surpasses training in real environments 🧠 Learning to predict environments (LWM warm-up) makes agents stronger — remarkably, even without any agent-specific training, this predictive knowledge transfers to agentic tasks with zero fine-tuning 📑 Paper: arxiv.org/abs/2606.24597 📖 Blog: qwen.ai/blog?id=qwen-a… 💻 GitHub: github.com/QwenLM/Qwen-Ag… 🤗 HuggingFace: huggingface.co/collections/Qw… 🧩 ModelScope: modelscope.cn/collections/Qw…

@alex_grankin @OpenAI @Broadcom Loll they will 100% name the next gen chip "habanero"

@OpenAI @Broadcom Can't wait for Habanero, and than California reaper! Just hope we don't get an eggplant... 🍆

We’ve designed and built our first AI chip: Jalapeño. Designed from the ground up by OpenAI and brought to production with @Broadcom, Jalapeño is purpose-built for the LLM workloads powering ChatGPT, Codex, the API, and future agentic products. Chips are foundational to the AI economy. Building our own expands our full-stack platform from products to models to infrastructure, and will help us scale intelligence, serve more people, and expand access to AI.

@robinebers @Atlassian Loom after Atlassian takeover has been awful.

my fucking god @Atlassian is such a scammy company they acquired loom and silently upgraded what used to be free guest users to paid ones (without any opt-in confirmation) only found out today because they kept spamming my inbox then trying to remove one user and the fucking site doesn't work took me a solid 10 min to cancel this hit never using Loom again

@pvncher Having literally the opposite problem right now. Damn thing won't listen no many how many times I tell it how to do stuff!

Because codex is so good at adhering to your skill files, you have to be very intentional about how you word the description, or they can trigger more often than necessary. The coolest thing is having codex run evals for skill activation using sub agents!

@growing_daniel It's... not? Professional copywriter here + side hobby is fiction writing. Can get amazing results, just need good prompt engineering/process. Usually it's just not enough data.

Why is AI writing still so bad

Exactly. In fact I think LLMs can be made MORE creative than humans via temp/top p controls. They already have the weirdest connections between concepts baked in. The biggest issue right now is that LLMs run on a single temp/top setting per answer. And we generally want coherent/reliable answers which punishes creativity. Modulating that during a prompt or introducing a creative output mode that runs before thinking can probably unlock a lot of that.

“LLMs CAN’T COME UP WITH NEW IDEAS.” new ideas aren’t out of distribution. they come from recombination, abstraction, analogy, and search. the Wright brothers saw birds, bicycles, wings, engines, and then combined them into an airplane.

@matvelloso This is why agents are the absolutely wrong thing to hype up for businesses. Not until prompt injection and blackbox issues are resolved

-We built a sandbox for agents! -Oh, cool, so they are blocked from accessing anything outside? -Well, no, they need to access files, emails, APIs... -So... you have a sandbox with a literal port open to the internet? -Well, yeah otherwise the agents would be useless -I see... But at least they can't write and run arbitrary code, right? -What, no, of course they can do that, they are agents -So... your sandbox lets agents write and run code that can literally run anything on internet? -Yeah -Let me ask you this: Are the employees in your company running these on their machines? -Well, they are... -But...? -...but with guardrails -Guardrails? -Yeah -Let me guess: The guardrail is a prompt? -IT'S A VERY NICELY FORMATTED MARKDOWN FILE OK

Claude is awful at updating its knowledge of current models even when it clearly states it knows it's out of date AND I tell it to research recent models only and not rely on its training. I always have to push back to get real results. ChatGPT is better at educating itself first

I asked both GPT-5.5-XHigh and Opus 4.8 High to find me the best model to run on a 3090 class card. Claude said to run gpt-oss-20b, we all know this model is extremely outdated and far from local SOTA, but the thing I found interesting was ChatGPT telling me to use Qwen3.6-27B, IQ4_XS GGUF I would argue this is objectively the correct answer, even if it ran at lower decode and PP, Qwen scores 150% higher than gpt-oss does on Artificial analysis. I doubt this is a knowledge cutoff problem, very curious why this was the output, I would have guessed it would have been the opposite.

@oleg008 A person just starting to use AI told me they told Claude "not to be dramatic" and I tried it and it actually did really well lol

I have a single word I use that improves LLMs code quality by 10x. It is a simple non-technical word, but non-engineers would never use it. Engineers after decades of engineering know this too well. Guess what this word is?

@stevekrouse Night and day for me. The first big "wow" of 2026 in terms of AI intelligence. On my projects Fable would crack stuff in 10 minutes that I now do in 3 hours by combining Opus + Codex + a 4-llm open source council. Miss that model a lot and I used it for 10 hours.

I used Fable nonstop while it was out and am now back to Opus, and I don't notice a difference If you told me that there was a bug with my Claude Code for those three days, and I was on Opus the whole time, I wouldn't be surprised I am skeptical about all the claims of how much better people find it. Not because I don't think it's better. I trust Anthropic evals. But because I think our guts are poorly calibrated to sense differences in intelligence at this level My guess is that it's a lot like blind taste testing of wine: it's orders of magnitude harder than you'd think it is. It's easy to fool yourself that you can tell the difference Which I guess we can turn into a challenge: when Fable comes back online, I can make a "blind taste test" app to give people a chance to see if they can tell which is which. I'd be very impressed with those that can! I'd love to learn your ways!

@ClaudeDevs Caching seems broken again. Just used 20% of my WEEKLY max plan usage in like 3 prompts on long but fresh opus convos.