I am very likely in the minority here, but I think AI SHOULD be trained on everything that is in the public sphere. I'd be disappointed if it wasn't trained on everything they had access to.
If it is trained on private information, then I would have issue with it.
If it is trained on private information, then I would have issue with it.