
1/ Excited to launch an experiment today - introducing Window, a way to use your own AI models on the web - including local ones! It's a bet on a new kind of AI app emerging, one that shifts model authentication and management to the user.
Window AI
113 posts

@windowai_io
Use your own AI models on the web

1/ Excited to launch an experiment today - introducing Window, a way to use your own AI models on the web - including local ones! It's a bet on a new kind of AI app emerging, one that shifts model authentication and management to the user.


According to the @scale_AI SEAL eval: Sonnet > Llama 405B > GPT-4o Group chat with all of them here! openrouter.ai/chat


Launching 3 new models, including a Llama 3 finetune (free for a limited time). Focusing on performance and dynamic routing this week. New Models 👇 - Soliloquy 8B, a Llama 3 roleplay finetune - Fimbulvetr 11B, a highly-acclaimed roleplay model based on Solar - Llama 3 8B Extended to 16k context. Might not last forever, depending on usage












Non consensus view: AI is already a commodity. OpenAI was not as good as Google’s best internal stuff (I know, was there, worked with teams building Google’s stuff). But they shipped faster and better. No one is 10x better, and OSS models are following fast. The winner will win by traditional techniques - better UI, better distribution, better marketing, etc.



I've become a big fan of "frankenmerge" LLMs that combine weights of open-source models and (inexplicably) result in something better than the sum of the parts. Feels like a very underexplored area of ML. Examples: Toppy by @Undi95 is now top of the fastest growing models on @openrouter, above GPT-4 Turbo, and MythoMax (red bar) has outpaced everyone. Goliath 120b is also new this weekend. Here's a search to track them all: openrouter.ai/models?q=%23me…


