That’s different. This is a suggestion. If the LLM follows such suggestions then that’s between the LLM and whoever deployed it. Not really any different than if you had an idiot employee who did whatever anyone told them.
I can’t imagine using an an AI that follows every instruction it finds in untrusted input.
I can’t imagine using an an AI that follows every instruction it finds in untrusted input.