notebook enthusiast

@heeney_luke also curious about this :O

Say you're a PhD applicant who believes this is the future. Where do you apply? (Pls don't just tell me to get into MIT econ)

chicago i am in you :D

when you think so little of yourself it is hard to imagine you are capable of causing great harm bc u basically don’t even think u matter. so u commit cruel actions and never recognize them as such.

How much of the world's advanced chip packaging and high-bandwidth memory does AI consume? Almost all of it. We estimate the four largest AI chip designers consumed ~90% of global advanced packaging and HBM supply in 2025, suggesting these inputs were bottlenecks in 2025.

@bfiafls and so it is!! and so it is...

@bfiafls @__vining YESSSSS YES!! NEED

Introducing a new, stupid website to find a piece of classical music whose duration most closely matches that of your next trip. busundreu.com

@luke_drago_ eyyyy :D

okay yeah we'll come out of stealth today

@BCalusinski @pangramlabs slop?

met an absolutely cracked quant the other day and what i’ve noticed talking to people like this (genuinely brilliant, deeply analytical, almost frighteningly intelligent) is that they’re usually incredibly lonely inside because most people can’t be in a conversation with them their thoughts are too advanced and too technical a normal conversation just doesn’t have the bandwidth for what’s actually going on in their head so they’ve learned to compress it, hide it, or just stop sharing altogether but when you actually give them the space (genuine interest, real willingness to follow them wherever the thought goes) something shifts you can see the relief almost like they’ve been carrying this entire world inside them that’s never had anywhere to go and suddenly there’s somewhere for it to go these have honestly been some of the most profound conversations i’ve had with people not because i’m the smartest person in the room (i’m not), but because i can hold the space for it and follow the thread - fill in the pieces when they’re struggling to articulate something they’ve never had to put into words before the amount of stuff stuck inside people that never comes out simply because nobody around them has the capacity to receive it that’s the part that is so exciting for someone like me, it’s like a new discovery that’s contagious

Radar graphs are among the worst ideas in data visualization. The whole point of them is to show the area and you can usually reorder the labels freely in order to create a desired dramatic effect. Two versions of the same graph: - left one tells the story that AI is rapidly replacing whole industries - right one shows the "jaggedness" and reinforces the idea that humans will always have something that AI won't be able to replicate

@xeophon @PrimeIntellect MY GOAT!!!

Some personal news: - Finished another trip around the sun today 🫡 - Decided to join @PrimeIntellect to work on evals!! There’s a lot to be build and do couldn’t imagine a better team to do just that 🙌 - I will be in SF the next two weeks :) Just to look around, of course 👀

GPT-5.4 set a new record on FrontierMath, our benchmark of extremely challenging math problems! We had pre-release access to evaluate the model. On Tiers 1–3, GPT-5.4 Pro scored 50%. On Tier 4 it scored 38%. See thread for commentary and additional experiments.

@max_spero_ @TechLayoffLover @pangramlabs haha i was looking for this comment

@TechLayoffLover @pangramlabs slop?

Just got this DM from a follower: Hey dude, I need to vent this to someone who gets it. I've been at this Big Tech company (you know the one) for almost 6 years now—senior SWE, TC around $350k last year with RSUs still vesting. Thought I was bulletproof after surviving the 2023-2024 bloodbaths and then pivoting hard into the AI org. But fuck, the ground is shifting under my feet faster than I can keep up. Last week in our all-hands, leadership was bragging about how the team's "AI leverage ratio" hit 4.2x—meaning each engineer is now shipping what used to take a team of four. They showed the metrics: feature velocity up 180% YoY while headcount's down another 22% since Q4 '25. The slide literally had a photo of Cursor + Claude Sonnet 4 workflows replacing entire squads. Everyone clapped like trained seals, but I saw three faces go pale—they're the mid-level folks who just finished documenting their entire codebase for the "knowledge distillation" project. My direct report, this solid L5 who joined right after me, got put on a 30-day PIP after his productivity dashboard dipped below the new AI-augmented benchmark. The benchmark? It's literally what the offshore team in India hits using the exact prompts he used to write. He trained them on our internal style guide last quarter—now they're outperforming him at $28/hour all-in. He told me privately he's burning through savings and eyeing real estate licensing because "at least houses don't get refactored by agents overnight." The internal job board is a ghost town. Entry-level SWE roles? Frozen since mid-'25. What few postings go up are tagged "AI-native preferred" and get 2,000+ apps in hours, mostly from people already on H-1Bs or contractors. Meanwhile, they're quietly converting more mid-tier positions to "AI orchestration" contractors—$90-110/hour remote from LATAM or Eastern Europe, no benefits, 6-month contracts. My manager admitted in 1:1 that if the next Grok/Claude/Anthropic release closes the last 10-15% quality gap, we'll probably cut another layer. I'm hanging on because I'm one of the ones who owns the prompt libraries and fine-tuning pipelines now. They need humans to babysit the models until the self-improving loops actually work without constant human intervention. But I see the writing: every time we make the system more autonomous, we make our own roles more optional. The alumni Slack is full of 2024-2025 grads DMing for coffee chats because their referrals bounce—67% underemployed or gigging according to the last poll. One kid I mentored last year is back living with parents after burning through his signing bonus. I used to tell people "just upskill in AI, you'll be fine." Now I feel like a fraud saying it. If I lost this tomorrow, I'd be competing with the same offshore talent I've been helping scale, plus a flood of recently "managed out" seniors. My emergency fund is decent, but the mortgage isn't. Thinking about side hustles in trades or something offline—plumbing, electrical, anything that can't be prompted away. This feels like watching the industry eat itself from the inside while pretending it's evolution. You still feeling secure over there, or is it hitting your shop too? Need to hear I'm not going insane.

@prof_g this is deeply kind of you

after every quiz i get emails from students who are stressed out about the fact that they are below the mean, etc. i asked claude to write an analysis of how much to trust each quiz score based on stats. claude did such a good job! let's see if it helps...

@whitfill_parker do you think algorithmic progress measured by nanogpt speedrun is representative of algorithmic progress as a whole?

To measure algorithmic progress since 2019, I retrained GPT-2 using the modern nanogpt speedrun stack. Current nanogpt SOTA is 707x faster. We can decompose total speedup into > 15x faster FLOP per second (on fixed hardware) > 46x less FLOPs to reach the same val loss.

Remember that I predicted a long time ago that President Obama will attack Iran because of his inability to negotiate properly-not skilled!

@holdmycovfefe12 this tweet was authored by an octopus

Computer use models shouldn't learn from screenshots. We built a new foundation model that learns from video like humans do. FDM-1 can construct a gear in Blender, find software bugs, and even drive a real car through San Francisco using arrow keys.

consider the following:

@scaling01 dunno if you've seen this, but might be useful to you - they're saying the ceiling is 95% at least x.com/jyangballin/st…

What's the upper bound on SWE-Bench-Verified? I yoinked a bunch of EpochAI data and analyzed it. However, I only got to download 21 files, now it seems im permanently blocked from downloading anything lol 44/500 = 8.8% of SWE-Bench-Verified questions are either unsolvable or still too hard for even the best models like Opus 4.6 Thinking With that we can say that the upper-bound is at least 91.2% on SWE-Bench Verified. The hardest subset of question seems to be pylint-dev and astropy. There were 3 questions that were only solvable by Gemini 3.0 Pro, 2 questions only solvable by GPT-5.1 and 2 questions only solvable by Kimi-K2.5 You will see the GPT-5.1 rows and columns are very bright, meaning there is almost no overlap in failures between GPT-5.1 and the other models, which is why they reran it. Its pass rate is still pretty high at 65.9% but I guess it failed a lot of the easy tasks which is why the rows and columns are bright. The two tasks that were only solvable by GPT-5.1 might be buggy.

@kognise7 your what what

hey, fun fact, i just learned today that alcohol "cooking off" is basically a complete myth! guess my bourbon oatmeal is gonna have me fucked up to start the day 💀