Comment by beret4breakfast

Question about system prompts in general. How are they affected by context rot/growing context windows. Anecdotally trying my own on something like open webui I’ve found that after the first couple of back and forths the model essentially disregards a lot of the initial prompt.