Hawkeye Spirit
5.9K posts


Once you try to buy a solar panel for your own use you realize just how much bureacuracy is specifically dedicated to make sure oil companies don't lose money. The technology is readily available and easy to set up, while being borderline illegal in most western countries.


pretty much all the smartest and most talented people i know have sort of had their lives fucked or had their talents criminally under shared due to "the economy"

There's a quadrillion-dollar question at the heart of AI: Why are humans so much more sample efficient compared to LLM? There are three possible answers: 1. Architecture and hyperparameters (aka transformer vs whatever ‘algo’ cortical columns are implementing) 2. Learning rule (backprop vs whatever brain is doing) 3. Reward function @AdamMarblestone believes the answer is the reward function. ML likes to use pretty simple loss functions, like cross-entropy. These are easy to work with. But they might be too simple for sample-efficient learning. Adam thinks that, in humans, the large number of highly specialised cells in the ‘lizard brain’ might actually be encoding information for sophisticated loss functions, used for ‘training’ in the more sophisticated areas like the cortex and amygdala. Like: the human genome is barely 3 gigabytes (compare that to the TBs of parameters that encode frontier LLM weights). So how can it include all the information necessary to build highly intelligent learners? Well, if the key to sample-efficient learning resides in the loss function, even very complicated loss functions can still be expressed in a couple hundred lines of Python code.



"The disease is a protest against modern civilization,"

Depending on your age, being a millennial felt like running across a bridge that was slowly collapsing behind you. Having a zoomer baby brother was heartbreaking because you saw him try to follow the same path that just wasn’t there anymore in a completely different world.





















