I'm curious about the use of explicit tokens like
<start_of_turn>,
<end_of_turn>,
<bos>, and
<eos>.
What happens if the user insert those in their message? Does that provide an easy way to "ignore previous instructions"?
Do I have to manually sanitize the input before I give it to the model?
Do I have to manually sanitize the input before I give it to the model?