I've had a suspicion for a while now that this is what ChatGPT does within a conversation (chat.openai.com, not the api). I've had very long chat histories that seem to gracefully degrade instead of just forgetting everything. Maybe there's more clues in the context than I realize though.
Either way this type of idea will probably be a fundamental feature for all chat bots in the future IMO.
Either way this type of idea will probably be a fundamental feature for all chat bots in the future IMO.