> I am less worried about prompt injection now. Before running this experiment, I expected prompt injection to be much easier than it turned out to be.
Is unwarranted. Sure, the agent never output the secret, but did it output anything else? IOW, was it usable?
An agent that considers every prompt an attack (and responds accordingly) "passes" this test, while being useless anyway.
> I am less worried about prompt injection now. Before running this experiment, I expected prompt injection to be much easier than it turned out to be.
Is unwarranted. Sure, the agent never output the secret, but did it output anything else? IOW, was it usable?
An agent that considers every prompt an attack (and responds accordingly) "passes" this test, while being useless anyway.