(1) If your first prompt is too long (50k+ tokens) but just below the limit (like 80k tokens or whatever), it cannot see the right-side of your prompt.
(2) By the second prompt, if the first prompt was long-ish, the context from the first prompt is no longer visible to the model.
Have you noticed either of these things:
(1) If your first prompt is too long (50k+ tokens) but just below the limit (like 80k tokens or whatever), it cannot see the right-side of your prompt.
(2) By the second prompt, if the first prompt was long-ish, the context from the first prompt is no longer visible to the model.