With any tech this engaging and real-seeming, there is bound to be a very small percentage of people with dormant mental health issues who are predisposed to have extremely negative reactions. I can totally see how a hallucinating human-sounding chatbot could be the trigger paranoia/obsession in some people.
I don't think there's something inherently wrong with the technology. Mental stability is a bell curve; the majority of people are "normal", but there will always be an unfortunate subset who can react like this to strange new stimuli, through no fault of their own. It's no different to people getting unhealthily hooked on TV/smartphones and driven into conspiracies.
I don't think there's something inherently wrong with the technology. Mental stability is a bell curve; the majority of people are "normal", but there will always be an unfortunate subset who can react like this to strange new stimuli, through no fault of their own. It's no different to people getting unhealthily hooked on TV/smartphones and driven into conspiracies.