Interconnects

358 posts

Interconnects banner
Interconnects

Interconnects

@interconnectsai

What you need to know about AI research trends, from @natolambert Wednesday mornings weekly, sometimes extra posts.

Katılım Haziran 2023
2 Takip Edilen8.7K Takipçiler
Interconnects retweetledi
Nathan Lambert
Nathan Lambert@natolambert·
When we were in China, @xeophon and I made a quick detour to visit Meituan. They continue to be one of our favorite open model builders, as they're showing how a variety of companies can succeed here and baffle a lot of people as to why they're making models. Meituan is one of the larger tech companies in China. They're building LLMs to add services to their own products. In China the notion of the "super app" is very popular, so this dream of more services for users with AI is very natural there. With this, Meituan wants to own the full stack of how they deliver value to their users. When we visited, they were very unassuming about everything. We just met a few people from the LLM team, a quick meeting about building models. They build general foundational reasoning models, and then fine-tune it further for their products. They can release the general model to support the ecosystem and learn how it can be used. Their focus was very clearly on ownership, and a hint of cost-saving, so the recent news of v2 being trained on asics fits with that mentality. They want to deliver real products to users with low cost. Companies like this will keep building models in China. It's a small micro study of how different the players in the AI ecosystem are. Kimi, Z ai, etc are all much flashier offices, come across as the "hot new thing" but Meituan has the talent and resources to build models as well. Congrats to the Meituan team & thx for having us!
Nathan Lambert tweet media
Meituan LongCat@Meituan_LongCat

Introducing LongCat-2.0 🐱 1.6T parameters · MoE with ~48B active · 1M context The full model behind Owl Alpha on @OpenRouter — now available. Built for agentic coding from the ground up: ◆ LongCat Sparse Attention (LSA) — scales efficiently for 1M-context tokens ◆ Zero-Compute Experts — dynamic activation 33B–56B per token, zero wasted compute ◆ MOPD — three specialized expert groups (Agent / Reasoning / Interaction), gate-routed per task How it stacks up: → Terminal-Bench 2.1: 70.8 → SWE-bench Pro: 59.5 (GPT-5.5: 58.6) → SWE-bench Multilingual: 77.3 → FORTE: 73.2 · RWSearch: 78.8 · BrowseComp: 79.9 📖 Tech Blog: longcat.chat/blog/longcat-2… Try it across different scenarios 🧵👇

English
17
34
345
77.8K
Interconnects
Interconnects@interconnectsai·
Artifacts 22: Zyphra, Cohere, Poolside, and others are expanding the breadth and diversity of the ecosystem. In this issue, a total of 30 models from may/june you should be aware of, from: NVIDIA @NVIDIAAI (3) Cohere @Cohere_Labs (2) Zhipu @Zai_org Zyphra @ZyphraAI (3) Poolside @poolsideai Moonshot AI @Kimi_Moonshot StepFun @StepFun_ai Dolphin @dphnAI Google @GoogleAI (3) Nex AGI @NexEcosystem Liquid AI @liquidai MiniMax @MiniMax_AI Swiss AI Initiative @apertusllm JetBrains @jetbrains Microsoft @Microsoft H Company @hcompany_ai Datalab @datalabto (2) Baidu @Baidu_Inc PaddlePaddle @PaddlePaddle Ideogram @ideogram_ai KREA @krea_ai Photoroom @photoroom_ML Read the issue below.
Interconnects tweet media
English
2
6
45
22.9K
Interconnects
Interconnects@interconnectsai·
🐐🐐
Nathan Lambert@natolambert

New podcast with @finbarrtimbers! We survey the latest post-training recipes, from GLM 5.1, Kimi K2.6, DeepSeek V4, Xiaomi MiMo V2.5, Nemotron Ultra, etc. and discuss: - Why the industry slowly shifted to multi-teacher on-policy distillation (MOPD). - What an Olmo-style recipe would need improvements in - How post-training works / suits larger organizational efforts - Career advice in the foothills of the singularity - and other topics I heard y'all wanted me to start doing this, so making some time when I'm in funemployment! Chapters: 00:00 Introduction & Olmo reflections 06:28 Post-train recipes review (history) 23:00 2026’s model recipes (MiMo Flash, DeepSeek V4, GLM 5, Kimi K2.6, etc.) 39:05 Open-ended post-training discussions 48:22 Career advice in the LLM race Links below, please follow @interconnectsai and like and subscribe and buy my book?

ART
0
0
4
849
Interconnects
Interconnects@interconnectsai·
Some ideas for what comes next, May 2026 Gemini Flash 3.5, Mythos, open-closed balance, America's open-source surge, emerging power struggles and more. interconnects.ai/p/some-ideas-f…
English
5
0
33
103.8K
Interconnects
Interconnects@interconnectsai·
Latest open artifacts (#21): Open model bonanza! Gemma 4, DeepSeek V4, Kimi K2.6, MiMo 2.5, GLM-5.1 & others. On CAISI's V4 assessment. An eventful month with one flagship release after another interconnects.ai/p/latest-open-…
English
1
6
25
14.2K
Interconnects
Interconnects@interconnectsai·
Reading today's open-closed performance gap The complex factors that determine the single evaluation number so many focus on. Plus, how this changes in the future. interconnects.ai/p/reading-toda…
English
1
3
10
13.3K
Interconnects
Interconnects@interconnectsai·
New video! Talking through my 10+ open model pieces from early 2026 and how they fit together. They're all trying to figure out where open models go next. youtube.com/watch?v=hKIXEg…
YouTube video
YouTube
English
0
0
4
852