enoch2090
Joined 4 years ago
Karma
157
Submissions
79
Member since
Feb 19
Joined 4 years ago
https://gist.github.com/Enoch2090/5026c417f86ff6ff4fbe30c22b...
1. The chat context is always provided, and that introduces a bit of uncertainty - when the chat history mentioned something the model is always inclined to connect with it.
2. When I tried to set each context to an empty string, the model doesn't show any evidence of remembering concepts. I told it 5 times that I love cats, and when asked about its favorite animal, its output remains "honeybee" and "octopus".