This argument simply asserts that the LLMs (or their successor systems including scaffolding) will asymptote somewhere below human capabilities.
It’s possible that this could happen but you need to propose a mechanism and metric for this argument to be taken seriously (and to avoid fooling yourself with moving goalposts). Under what grounds do you assert that the trend line will stop where you claim it will stop?
Yes, if super-human AGI simply never happens then the alignment problem is mostly solved. Seems like wishful thinking to me.
It’s possible that this could happen but you need to propose a mechanism and metric for this argument to be taken seriously (and to avoid fooling yourself with moving goalposts). Under what grounds do you assert that the trend line will stop where you claim it will stop?
Yes, if super-human AGI simply never happens then the alignment problem is mostly solved. Seems like wishful thinking to me.