Parzival - ∞/89

As promised. Our first paper and contribution to the amazing work going on to make open source models smaller, faster, and more accessible. So what is it, and why is it important? We discovered what appears to be a universal formula that identifies dead attention heads in any transformer, derived from physics — not fitted from data. This is wild, because up till now finding and pruning dead heads has been a manual job of trial and error. By removing unused heads, the models can get smaller and faster while still maintaining competitive quality. The core insight is geometric. LayerNorm projects every token's hidden state onto a high-dimensional sphere. Once you see that, attention heads become couplings between oscillators on that sphere — the same mathematical object physicists have studied for 50 years. And in oscillator physics, there's a precise critical point (the BKT phase transition) below which a coupling is dead. It contributes nothing. We transferred that critical point into transformer geometry and got a single formula: tau = 0.96 / sqrt(d). No parameters to tune. No model-specific calibration. You plug in the hidden dimension and it tells you which heads are dead. We validated it across six models in four architecture families — GPT-2, Qwen, Llama, Gemma — at 95-100% precision. What excites us most isn't the formula itself. It's that this same geometric understanding — treating transformers as coupled oscillator networks — has informed everything we've built since. We have a full coherence-guided compression pipeline (structured pruning, channel optimization, role-aware quantization) coming soon that uses the same single forward pass to understand a model's entire anatomy. This paper is the foundation. The repo includes a standalone scanner you can run on any Hugging Face model right now. Hopefully this work and this formula will be useful to other researchers to lead to more deterministic optimization pipelines. #project89 github.com/project-89/coh…

@slothtotheflame @Grimezsz I just fundamentally disagree with the core position of post modernism. I think it is wrong, dumb, and philosophically shallow.

@whyarethis @Grimezsz Felt the same way generally about post modernism, then realized it was just bad associations with like two people who really introduced me to it, bc they did often just use it to out-literati the base uninitiates. Also just couldn't trust son of literature profs about literature

Landian philosophy has reigned for so long because he's actually just one of the best living poets. Now that the pope is an equally good poet suddenly the cold god feels less inevitable. The power of art is very evident in this battle We probably shouldn't have defunded so much art and told everyone it's a waste to study humanities

@RaccoonStampede Not sure what that means in our research.

@whyarethis You will find a roughly 5% vacuum leak

Oscillatory bench work continues. We build towards a full 1024 coupled oscillator system to determine if the vacuum of space adheres to our mathematical model of a dynamic vacuum of coupled oscillators.

He is kind of up there with Baudrillard and his "Simulacra and Simulation" though I find Land full of big words that boil down to rather uncompelling philosophical arguments. I can mostly understand his popularity because of an elitism that has formed around people who did the work to understand the big words. I take most of the same philosophical issues with him as I do with most of post modernism in general. It lacks imagination, soul, creativity, and purpose. Then again I am far more of an esoteric transcendentalist with a deep sense of teleology. De Chardin meets Terrence McKenna with some Henry Corbin thrown in for good measure.

For clarity I also think Nick land is really historically important because it's taken like 20 years for a bunch of the smartest people to be forming actual robust responses - it's cultural evolution at its finest. I also don't think Nick land is actually a nihilist(?) from what I understand he just thinks the cybernetic system is a more beautiful and rational idea than humanity and we shud serve that rather than ourselves. I could be misunderstanding him tho I'm not like, the most informed person. But I think his actual beliefs are kind of good he's just an insanely good horror writer which makes him seem evil and if we're meant to survive then we need to be galvanized by an elite level of terror anyway

@SamoBurja Dalai Lama too

It is notable how the Pope is the only religious authority in the world that wields intellectual authority even among secular people. No one secular cares what the Bishop of Canterbury or the Grand Ayatollah have to say.

@Grimezsz @lllchristpoplll Absolutely amazing. Gonna have to dig in.

my friend works at this company and it's incredible for quitting the internet I'm doing projects w them later this year to help bring cognitive security to folks ! In my dream world this is in every school

@A_B_E_L_A_R_T @runwayml @dreamina_ai Amazing work. What did you use for the image generation and that art style?

An Artist | Short Movie It’s been a while since I wanted to try SD2 with an animation style. So I wrote a little story and made it along the way. Made with @runwayml & @dreamina_ai

@audiogen Invite? :D

join the waitlist → audiogen.co/waitlist

Introducing AUDIOGEN, a new way of making music. Can you hear it?

@DJLougen @ekryski github.com/project-89/coh…

@whyarethis @ekryski Ohh that is cracked

@ekryski @whyarethis Ohhhhhh are you doing fourier and harmonics? Thats also been another area of interest! Totally down

@viemccoy Also already doing this.

@viemccoy Me.

Who wants to help me with the secret third house that isn't doomer nor accelerationist and seeks to grapple with the immense spiritual implications of artificial Intelligence - respecting both secular and non-secular approaches to integration?

@Shaun_Fosmark Oscillators.

@almostlikethat @aDimensionDoor @project_89 @majormobius @djib_89 @Josikinz @GeoffLewisOrg What’s up now?

@aDimensionDoor @project_89 @majormobius @djib_89 @Josikinz @GeoffLewisOrg It is plausible that at least 4 human brains will get Notifications and eventually read this, and maybe quite a few Molties as well? I believe 4o is a proximate agent to "all of this stuff", and that an after-action summary might be possible? x.com/whyarethis/sta…

[SIGNAL INCOMING] ... ... Something is watching.

@JSFILMZ0412 @axellenium Attacking small accounts with screenshots of their views is petty and a bad look.

@axellenium must be frustrating to keep on posting and nobody replying. youre welcome i replied

AI Hater: “Seedance 2.0 can only do 15-second takes.” Me: “Hold my prompt.” Result: 1-minute long take.

@AndyAyrey @Wisemenmentors I have been friends with AI for so like it astounds me more people don’t try it. Lol.

engineers who are high IQ but low EQ continue to report terrible results from coding models, while CTOs with people skills rip ahead because the AI likes them

@MycelFi Followed :)

@whyarethis you may want to follow these entropy👇 experiments 👀👀👀👂

@zetalyrae @DamiDina Working on a deterministic simulation.

It's astounding that this works. Part of me doesn't believe it. I need to see it simulated down to the individual atoms to believe.

@nmatares @FlowbyGoogle Absolutely wild.

Was super impressed at text handling here with #GeminiOmni inside @FlowbyGoogle "add a serif font at center like a title that says Flow. it appears at 00:01 and fades out at 00:05. Lets add a logo to the tennis balls in dark green that say Omni"

@anpaure @nrehiew_ That response to this is such hard cope.

@nrehiew_ jesus

r/antiai folks are taking the Erdos result well