>What if you mark the untrusted user input explicitly in the prompt,
I think the more robust approach would be to have whatever embedding vector the model attributes to untrusted input and to directly attach that vector after every layer of transformation. Set a mask of where to apply that vector programmatically for every external input.
That way it gets forced back into line if some sort of internal rationalisation tries to semanticly drift away .
I think the more robust approach would be to have whatever embedding vector the model attributes to untrusted input and to directly attach that vector after every layer of transformation. Set a mask of where to apply that vector programmatically for every external input.
That way it gets forced back into line if some sort of internal rationalisation tries to semanticly drift away .