

cutfrom 🇮🇪🇵🇸
19.7K posts

@cutfrom
When the persimmons are green, even the crows don't come pecking



UK agrees to let US use British bases to strike Iranian sites targeting Strait of Hormuz Follow live: bbc.in/3PB0sHr

We are living through a French Fourth Republic-like collapse in national self-confidence and morale.

It’s easy to laugh this off with British gallows humour, but learning the lessons of how we spent £179 million to build nothing is crucial if we are to avoid existential decline.




The very basics, the things we rely on to build the foundations of a good life, have been taken out of our hands, sold for profit - and then sold or rented back to us at crushing rates. The Green Party is there to inspire people with hope. And now, it's hope and a plan.



🚨NEW: The state pension age could be raised to 75 due to UK's birth rate decline


Introducing 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔: Rethinking depth-wise aggregation. Residual connections have long relied on fixed, uniform accumulation. Inspired by the duality of time and depth, we introduce Attention Residuals, replacing standard depth-wise recurrence with learned, input-dependent attention over preceding layers. 🔹 Enables networks to selectively retrieve past representations, naturally mitigating dilution and hidden-state growth. 🔹 Introduces Block AttnRes, partitioning layers into compressed blocks to make cross-layer attention practical at scale. 🔹 Serves as an efficient drop-in replacement, demonstrating a 1.25x compute advantage with negligible (<2%) inference latency overhead. 🔹 Validated on the Kimi Linear architecture (48B total, 3B activated parameters), delivering consistent downstream performance gains. 🔗Full report: github.com/MoonshotAI/Att…