I struggle with what to say about the new AI 2040: Plan A website. It all seems so implausible to me that I'm not sure where to start. There's an epistemic chasm between those who think superintelligence implies near-omnipotence and those (like me) who don't.

@binarybits Yup, can't understand your position. Superintelligence can trivially multiply itself, secure its existence, control people and factories and current system, and kill everyone. Where in this chain does your disbelief start?

@Vert_Noel It starts with "superintelligence can trivially."

@binarybits OK, so there's nothing that superintelligence can trivially do?

@Vert_Noel There are lots of things humans (and normal computers for that matter) can trivially do. I don't think anything on your list is obviously trivial.