Sabitlenmiş Tweet
Oslo
124 posts

Oslo
@oslo
Maths, Research, and Domains.
pos ∼ sin(ωt), state ∈ ℝⁿ Katılım Mart 2007
266 Takip Edilen603 Takipçiler
Oslo retweetledi

Introducing 𝑨𝒕𝒕𝒆𝒏𝒕𝒊𝒐𝒏 𝑹𝒆𝒔𝒊𝒅𝒖𝒂𝒍𝒔: Rethinking depth-wise aggregation.
Residual connections have long relied on fixed, uniform accumulation. Inspired by the duality of time and depth, we introduce Attention Residuals, replacing standard depth-wise recurrence with learned, input-dependent attention over preceding layers.
🔹 Enables networks to selectively retrieve past representations, naturally mitigating dilution and hidden-state growth.
🔹 Introduces Block AttnRes, partitioning layers into compressed blocks to make cross-layer attention practical at scale.
🔹 Serves as an efficient drop-in replacement, demonstrating a 1.25x compute advantage with negligible (<2%) inference latency overhead.
🔹 Validated on the Kimi Linear architecture (48B total, 3B activated parameters), delivering consistent downstream performance gains.
🔗Full report:
github.com/MoonshotAI/Att…

English
Oslo retweetledi

Mercury 2 is live 🚀🚀
The world’s first reasoning diffusion LLM, delivering 5x faster performance than leading speed-optimized LLMs.
Watching the team turn years of research into a real product never gets old, and I’m incredibly proud of what we’ve built.
We’re just getting started on what diffusion can do for language.
English

@heyitszeth @shiftj I think this should be the ideal path to test your product out and let a few people use it so that you can pivot or upgrade for the better. Doing the same.
English

Remember: Do things that don't scale.
Automation is great but not on day 1 - just like hiring, don’t automate too early.
For example:
1/ Don’t automate your first outbound, do it manually first.
You have to feel the responses, see what clicks, and gauge metrics closely. Try to automate that and you won't get the pulse you need to right a truly great outbound.
You'll also lose touch with what messaging resonates.
2/ Don’t GPT your customer’s problems, get out and talk to them.
It's easy to google search for problems, scrape reddit, or ask Openclaw to do it for you - but there's no substitute for talking to customers.
You have to see their reactions and emotions in real-time.
That's how you know if you're onto something.
3/ Don’t hand your support to a bot, fix it yourself.
Same reasons as above. You need that visceral pain, that tight relationship.
These are painful in the short-term, priceless in the long-term.
--
Lesson:
1. Do the job until it hurts.
2. Then automate.
3. Then hire.
That's how you build a 20x company.
Skip steps? you’re left with a clunky setup full of slop.
Ben Lang@benln
YC on how to build a 20x company:
English

@3xHarrison but still people will use anthropic or chatgpt. Having a good domain is not related to better research. Meta gave $1 billion to hire individual researchers. Even they don't care about ai.com . It is all hype. Hype creates better visibility but not research.
English

when you invest in a great domain, you get it
when you don't, you don't
Jesse Tinsley@JesseTinsley
this is terrible advice. The founder of Crypto and AI dot com is worth a few billion dollars mostly from buying a premium domain name. I am worth close to ~$1B mostly based on spending ~$3m to buy: Recruiter, Employer and Mainstreet dot com. The numbers speak for themselves and the outcomes don’t care about your opinions. Distribution & Brand > Product
English

Ecstatic to announce Merge Labs! 🧠🚀
I’m honored to work alongside my co-founders—Tyson Aflalo, @mikhailshapiro, @sandroherbig, @alexblania, and @sama on bridging biological and artificial intelligence. They’re *the* team to take on a mission this ambitious.
We’re grateful to have partners like @OpenAI who share a long-term view on what it takes to build foundational technology.
If you want to work on hard, foundational neurotech problems, come build with us.
English

@Sullys_Blog i find : the better my research, the better the people I happen to interact with.
English

if you were farming yaps yesterday and woke up unemployed today
i'm going to do something stupid
i'm building @tapdotfun in public and rewarding early supporters
$200 every single day to random interactions on my posts
no API for X to revoke
indians and nigerians welcome
English

@katerleonid moves from "i want this" to "let's see who can beat me" - a classic primal urge.
English

@katerleonid appraised low i suppose. Estibot appraised 8th.ai for $51,000 and i am not sure the exact params it used
English

Someone bought musical.ai for $464 at an expired auction in 2021.
Today it’s appraised at $16,000.

Raising.fi@raisingfi
🏛️ Company: Musical AI 🔗 Website: wearemusical.ai 📊 Amount: $4.5 Million 🔄 Round: Undisclosed ⚙️ Industry: AI 🌍 Location: Ottawa, Ontario, Canada
English

Physical #AI and #Robotics will bring about the next industrial revolution
by @nvidiaomniverse
#Innovation #EmergingTech #Tech #Technology
English

Owning the exact-match .com is priceless
In this example, I removed my numero uno competitor from the equation, because Google now recognizes them as a fake website
wordleespañol.com 😂


English










