Not the intention of this cartoon, but unironically a good explanation of how reward systems breakdown as LLMs reach "superhuman" performance (since our current rewards rely on expert labeling)

Honestly, from a philosophical perspective, I have a hard time understanding how LLMs could go much beyond peak human capabilities in any particular field. Ultimately, the training data is human generated/labeled and it is hard to see how LLMs wouldn't be bounded by that contraint.

@AdamRodmanMD Though of course the models could achieve mastery in many more fields than a single human, and could do things much faster, but in terms of expanding the universe of knowledge, I'm not sure.