
Dimitris Mitsos
4.1K posts

Dimitris Mitsos
@DimitriosMitsos
Creating: AgentsKB, Roam Code, AGI in md(Haiku beating Opus), Prism CLI, Deep Research tools, self-updating Claude guides and other wild ideas






OpenAI and xAI are finally deprioritizing side quests and focusing on coding, while Anthropic has been focused on coding from the start. We’re likely heading toward 3–4 top-tier coding models (including Gemini), it's not a winner-take-all market. Each model will excel in different areas (frontend/backend/infra/etc.) and programming languages. Competition is great for consumers.



Introducing 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔: Rethinking depth-wise aggregation. Residual connections have long relied on fixed, uniform accumulation. Inspired by the duality of time and depth, we introduce Attention Residuals, replacing standard depth-wise recurrence with learned, input-dependent attention over preceding layers. 🔹 Enables networks to selectively retrieve past representations, naturally mitigating dilution and hidden-state growth. 🔹 Introduces Block AttnRes, partitioning layers into compressed blocks to make cross-layer attention practical at scale. 🔹 Serves as an efficient drop-in replacement, demonstrating a 1.25x compute advantage with negligible (<2%) inference latency overhead. 🔹 Validated on the Kimi Linear architecture (48B total, 3B activated parameters), delivering consistent downstream performance gains. 🔗Full report: github.com/MoonshotAI/Att…





OpenClaw is not for coding. OpenClaw is not for coding. OpenClaw is not for coding. OpenClaw is not for coding. OpenClaw is not for coding.OpenClaw is not for coding.















