I'm already getting personalized spam mail that's probably powered by AI ("use this API" type marketing in my work email.) I'm okay with this, even if I find it a little unsettling.
I think the dystopian future we're heading towards is personalized phishing and/or scams that sends to your hijacked accounts' contacts that you're going through a hard time and requesting donations, using training data from crowdfunding sites.
Or, one-level more dystopian, hijacking social media accounts and advertising AI-generated Patreon-style content using the actual account owner's likeness.
I think the dystopian future we're heading towards is personalized phishing and/or scams that sends to your hijacked accounts' contacts that you're going through a hard time and requesting donations, using training data from crowdfunding sites.
Or, one-level more dystopian, hijacking social media accounts and advertising AI-generated Patreon-style content using the actual account owner's likeness.