
Aws Albarghouthi
2.1K posts





That new LFM2.5-350M is super overtrained, right? And everyone was shocked about how far they pushed it? As it turns out, we have a brand new scaling law for that! 🧵 [1/n]

We expect agents to act like senior engineers, but most benchmarks still evaluate them like interns. Excited to introduce Senior SWE-Bench, an open-source and @harborframework-native benchmark that assesses agents as senior engineers on long-horizon tasks with realistically under-specified instructions. We expect agents to build real features going on just a quick Slack message, nothing like the super technical instructions most benchmarks provide. Senior SWE-Bench fixes that. Claude Opus 4.8 is the current leader at 24% high quality solves, but it took 117K tokens on average to get there. Claude Sonnet 5 looked like it was going to swoop in for the top spot, but we found it cheated on 26% of trials.




Tonight, Iranian missiles killed four Palestinian girls from the same family in the town of Tamra, northern Israel. -Manar Al-Fakhri Khatib -Manar Al-Qassem Abu Al-Heija / Khatib -Shatha Khatib -Hala Khatib May their memory be a blessing.
