Comment by smath

I think recent events (hugginface) offer clues. It is a lot like the paper clip machine [0]

[0] https://www.lesswrong.com/w/paperclip-maximizer-1