This is an expected outcome for lonely people + LLMs. And it will likely explode from here. There is a lot to be concerned about, but it's not going to go away.
The commercialization aspect might be what bothers me most. The article is full of people hurt when startups got them hooked on a feeling of intimacy and then took that away. Emotional manipulation for profit is nothing new but LLMs might turbocharge that ability.
The commercialization aspect might be what bothers me most. The article is full of people hurt when startups got them hooked on a feeling of intimacy and then took that away. Emotional manipulation for profit is nothing new but LLMs might turbocharge that ability.