
Sambit Chakraborty
1.9K posts

Sambit Chakraborty
@SambitChakrabo8
Your go-to AI guy | Full-time @Bitwise_Updates (Bitwise)








Introducing 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔: Rethinking depth-wise aggregation. Residual connections have long relied on fixed, uniform accumulation. Inspired by the duality of time and depth, we introduce Attention Residuals, replacing standard depth-wise recurrence with learned, input-dependent attention over preceding layers. 🔹 Enables networks to selectively retrieve past representations, naturally mitigating dilution and hidden-state growth. 🔹 Introduces Block AttnRes, partitioning layers into compressed blocks to make cross-layer attention practical at scale. 🔹 Serves as an efficient drop-in replacement, demonstrating a 1.25x compute advantage with negligible (<2%) inference latency overhead. 🔹 Validated on the Kimi Linear architecture (48B total, 3B activated parameters), delivering consistent downstream performance gains. 🔗Full report: github.com/MoonshotAI/Att…










New Engineering blog: We tasked Opus 4.6 using agent teams to build a C compiler. Then we (mostly) walked away. Two weeks later, it worked on the Linux kernel. Here's what it taught us about the future of autonomous software development. Read more: anthropic.com/engineering/bu…

Started a week ago, not knowing how to write a single line of code I wanted to read the Bhagavad Gita daily, but couldn't find an app that felt right. So I built one. Ended with a full iOS app live @10minutegita on the App Store: → 239 daily readings of the Bhagavad Gita → Original Sanskrit shlokas + transliteration → Verse-by-verse translations & commentary → Personal daily reflections → Streak tracking with calendar heatmap → Shareable verse cards with 8 gradient themes → Hindi & English bilingual support → Light/dark mode, adjustable fonts → Completely offline after download Total cost: $200 Claude Max Subscription + $20 ChatGPT Pro Subscription + $99 Apple Developer fee Lines of code I wrote: 0 Claude Code wrote everything. I just described what I wanted in plain English (non-technical background). Codex reviewed it. Now it's live on the App Store. The barrier to building isn't coding anymore. It's just knowing what problem you want solved. Links & Full Process in 🧵↓ Built with @AnthropicAI's Claude Code





























