Comment by tomasphan

“Bad ASI would pretend to be good *until* it could execute a plan to kill everyone all at once”.

So not today but tomorrow it could engineer an airborne virus. The point is it can come up with chess moves that are inconceivable to us.