Another perspective if we consider AI akin to nuclear weapons (a simile many have made already): If the law-abiding cease development and malicious actors do not, the worst case may be that the resulting AI is non-aligned with humanity's interests. If the "good guys" develop an AI with alignment as an intention, then there are at least good AI to counter the bad AI.
Of course they may all ultimately end up colluding to destroy us. My point is it's not just as simple as "someone who's behind might catch up and make more money".
Of course they may all ultimately end up colluding to destroy us. My point is it's not just as simple as "someone who's behind might catch up and make more money".