twobitshifter
Joined 5 years ago
Joined 5 years ago
Prior to industrialization the closest you got to this was feudalism.
Already people are seeing that the lean proofs provided don’t match the paper and lean proofs have not been provided for all paper proofs.
First, if we are looking at risk we need to assign some probabilities to this. If it’s not well understood, how can we say it is very small?
Secondly, do we need consciousness to have AGI? Do we even need AGI to pose a risk to humanity? We already accept that unconscious things have a capability of wiping out humanity, whether that be a famine, pandemic, solar superflare, meteor, or volcanic eruption.
https://discoverwildscience.com/neuroscience-says-the-brain-...
It’s interesting that our conscious interpreter doesn’t let us know that this is going on like you are experiencing, it must be that it’s advantageous for us to not think about the prediction part of our mind.