"Prompt injection as role confusion " [0] work showed us, that diffetent roles produce different types of text, which smell differently, have different structure.
Thus it should be possible to fine tune models to produce more human readable text in assistant role while keeping information density in thinking role. Or maybe not. That is interesting to test.
Thus it should be possible to fine tune models to produce more human readable text in assistant role while keeping information density in thinking role. Or maybe not. That is interesting to test.
https://role-confusion.github.io/