I agree with most of this, but you're misunderstanding "alignment" as coined. Yes, training powerful enough AI, any simple optimization target gets you malign behavior, because human values are not simple. If you insist on making powerful AI, you'd better instill respect for human values! That's "alignment".
https://www.lesswrong.com/posts/ZxWzCGKzX84S7DBZ9/when-was-t...