
Tim Causey
30 posts







this is going to push germany past breaking point






We’ve agreed to a partnership with @SpaceX that will substantially increase our compute capacity. This, along with our other recent compute deals, means that we’ve been able to increase our usage limits for Claude Code and the Claude API.


Introducing SubQ - a major breakthrough in LLM intelligence. It is the first model built on a fully sub-quadratic sparse-attention architecture (SSA), And the first frontier model with a 12 million token context window which is: - 52x faster than FlashAttention at 1MM tokens - Less than 5% the cost of Opus Transformer-based LLMs waste compute by processing every possible relationship between words (standard attention). Only a small fraction actually matter. @subquadratic finds and focuses only on the ones that do. That's nearly 1,000x less compute and a new way for LLMs to scale.



THE CHINESE PERSON ARGUMENT Once upon a time, there was a man born and raised in China who gave the appearance of understanding English. People would write out questions in English, hand them to the Chinese man, and he would produce written responses in perfect English that seemed to indicate he understood the language. However, eventually those trained in biology put an end to this nonsense. They explained that if you took just 5 minutes to understand how Chinese ears, nervous system, and fingers actually WORKED, you would realize it's just a bunch of mindless cells--themselves composed of simplistic atoms--obeying mechanical laws. Yes, the Chinese man could produce seemingly novel sentences, even telling entire stories in English that had never been uttered before. But the biologists explained that this was only possible because the Chinese man had been trained on copious amounts of English text, produced by genuine English speakers. It was also true, in any given instance, that the biologists couldn't predict the exact behavior of a given Chinese man, but they knew the principles underlying their operation, and they knew how to make more Chinese men. In conclusion, Chinese men don't actually "understand" English. Anyone who thinks so is falling for an illusion.


















