How do you sanitize user input to an LLM? You can't!
Programmers aren't even particularly good at escaping strings going into SQL queries or HTML pages, despite both operations being deterministic and already implemented. The current "solution" for LLMs is to scold and beg them as if they're humans, then hope that they won't react to some new version of "ignore all previous instructions" by ignoring all previous instructions.
We experienced decades of security bugs that could have been prevented by not mixing code and data, then decided to use a program that cannot distinguish between code and data to write our code. We deserve everything that's coming.
Programmers aren't even particularly good at escaping strings going into SQL queries or HTML pages, despite both operations being deterministic and already implemented. The current "solution" for LLMs is to scold and beg them as if they're humans, then hope that they won't react to some new version of "ignore all previous instructions" by ignoring all previous instructions.
We experienced decades of security bugs that could have been prevented by not mixing code and data, then decided to use a program that cannot distinguish between code and data to write our code. We deserve everything that's coming.