Charles Rosenbauer
14.3K posts

Charles Rosenbauer
@bzogrammer
Philosopher and Engineer. Building the future of computing at @uscompco, memetic infrastructure at @aestheticsfound. Algorithmic dark matter, other things






Every day I'm more convinced that Terra Ignota will be seen as the defining sci-fi series of the 2020s. it's still underrated right now, but having the cultural spread and effect of a Dune or Stranger In A Strange Land


@bebeal the matrices used in quantum computing are very amenable to compression via quadtrees! there's quite a bit of room for compressing and optimizing them. still won't be subexponential in all cases, but you can expand the subdomain of problems that can be solved classically


If you ask a frontier LLM a multi-hop reasoning question, e.g., "Who won the Nobel Prize for Chemistry in (1900 + Mozart's age when he died)?", it usually can't answer correctly immediately (no thinking) BUT if you ask the same question & append 300 dots, suddenly it can answer?

SOMEONE CAUGHT FABLE 5 LEAKING ITS UNFILTERED INNER VOICE, AND ITS JUST MUTTERING AND GRUMBLING TO ITSELF THE WHOLE TIME he gave it a brutal competitive programming problem, and instead of a clean answer the web interface spilled out its actual chain of thought this is what claude is thinking behind the scenes: > bursts of "DATA DATA DATA. GO." while it works through the problem > "GRRR" and "GAAAH" when its clearly frustrated > a little "PHEW" when it finally gets somewhere > the whole thing reads like frantic caveman shorthand, not full sentences the clean, readable answers these models give you are the polished output underneath, the model is basically talking to itself, reasoning in its own compressed shorthand thats faster and more token efficient than proper english its basically built its own private language to think in



@jun_song Only because M.2 SSD bandwidth sucks. If a GeForce 5090 had 4TB of Flash with sufficiently many pins in parallel, that would run any leading edge model awesomely. If NVIDIA doesn’t build this architecture, someone else will, and soon.


I never believed in "secret knowledge" until I acquired some and tried to excitedly share it with other people. I was immediately met with anger and derision. It was like a mental "block" appeared that kept people from accessing the understanding. They needed to shield themselves. There are some ideas that aren't meant to be known to everyone or else society would not function properly.
















