Comment by gima

This is the problem with "in-band signaling". Not just with LLM's, but Linux TTY suffers from this as well, among others.

Anything that doesn't separate control data from the actual data. See https://en.wikipedia.org/wiki/In-band_signaling