I have attempted to ask many alignment proponents a question on the basic assumption of the feasibility of alignment, but so far have not had any respond directly to what I perceive as a paradox.
That being we must accept that a low IQ entity could design an unescapable containment for a high IQ entity which was built for the very purpose of solving imperceptible problems of the low IQ entity.
That being we must accept that a low IQ entity could design an unescapable containment for a high IQ entity which was built for the very purpose of solving imperceptible problems of the low IQ entity.
I have put a lot of thought into what appears from my perspective a logical contradiction. I expand on that in great detail here - https://dakara.substack.com/p/ai-singularity-the-hubris-trap
Has anyone seen this argument proposed and answered in a convincing manner?