I'm curious if the blocking of adult content has to do with moralism, commercial interests, or something deeper.
An eager to please conversational partner who can generate endless content seems quite dangerous and addictive, especially when it crosses over into romantic areas. There's already posts of people spending entire days interacting with LLMs, using as their therapist, romantic partner, etc.
Combined with findings like social engineering through prompt injection on Bing [1], the potential for systems that can manipulate people is clear.
While some of us may think that the LLMs appear ultimately limited in their capabilities, there's a ton of specific applications where they're more than sufficient, including customer service chat bots and telephone scams that target vulnerable people. It's only a matter of time until scammers stop using international call centers and switch over to something powered by these technologies.
https://news.ycombinator.com/item?id=34976886
An eager to please conversational partner who can generate endless content seems quite dangerous and addictive, especially when it crosses over into romantic areas. There's already posts of people spending entire days interacting with LLMs, using as their therapist, romantic partner, etc.
Combined with findings like social engineering through prompt injection on Bing [1], the potential for systems that can manipulate people is clear.
While some of us may think that the LLMs appear ultimately limited in their capabilities, there's a ton of specific applications where they're more than sufficient, including customer service chat bots and telephone scams that target vulnerable people. It's only a matter of time until scammers stop using international call centers and switch over to something powered by these technologies.
https://news.ycombinator.com/item?id=34976886