People have hooked up shells running commands already. A few days ago someone managed to extract an OpenAI API key from an environment variable because someone was running prompt output through an eval() function: https://twitter.com/ludwig_stumpp/status/1619701277419794435
Developers who don't understand prompt injection will continue to make nasty mistakes like that.
Developers who don't understand prompt injection will continue to make nasty mistakes like that.