Reminder that on the naive synapse ≈ parameter (which undersells synapses), the human brain has ~2Q params. The largest existing frontier models have 10-30T. Roughly ~2 OOM diff.

@N8Programs However, each synapse is basically binary, or close to it, while each parameter has 16bit info, which makes each parameter so much more information dense We simply have no good way to compare the two, but I wish we had

@AlejandroZarUrd afaik neural synapses have 4-5bits of precision...

@N8Programs Oh I wasn't aware of that, still that's much less than the typical parameter, I wonder If we could make AIs with the same number and definition of parameters as brain synapses

@AlejandroZarUrd @N8Programs And that’s if you discount Penrose entirely