Short version: you can't be 100% confident that AI based detection will catch every attack, because attackers are devious and can come up with increasingly unexpected and sneaky attacks. And where security is concerned, a 99% effective solution is just an invitation for attackers to work extra hard to figure out the 1% of attacks that get through.
If we used a fix for SQL injection that only worked 99% of the time none of our data would be safe anywhere.
For prompt leaks this doesn't particularly matter, because the damage caused if the prompt does leak is pretty minimal. It's a massive problem for more advanced LLM usage, such as personal AI assistants.
Short version: you can't be 100% confident that AI based detection will catch every attack, because attackers are devious and can come up with increasingly unexpected and sneaky attacks. And where security is concerned, a 99% effective solution is just an invitation for attackers to work extra hard to figure out the 1% of attacks that get through.
If we used a fix for SQL injection that only worked 99% of the time none of our data would be safe anywhere.
For prompt leaks this doesn't particularly matter, because the damage caused if the prompt does leak is pretty minimal. It's a massive problem for more advanced LLM usage, such as personal AI assistants.