Comment by greshake

TLDR: With these vulnerabilities, we show the following is possible:

- Remote control of chat LLMs

- Persistent compromise across sessions

- Spread injections to other LLMs

- Compromising LLMs with tiny multi-stage payloads

- Leaking/exfiltrating user data

- Automated Social Engineering

- Targeting code completion engines

There is also a repo: https://github.com/greshake/llm-security and another site demonstrating the vulnerability against Bing as a real-world example: https://greshake.github.io/

These issues are not fixed or patched, and apply to most apps or integrations using LLMs. And there is currently no good way to protect against it.