Comment by 11011001

> Why is the AGI interested in copying itself? Why is that more likely than the AGI becoming a nihilist, seeing no point in itself, and offing itself?

Because suicidal nihilism would be a "bug" from the perspective of the builders, which they would seek to fix in the next iteration.

An interest in "copying itself" seems like it could fall out accidentally from a self-improvement goal.