Comment
Comment by dojitza1
An interesting solution to the blind spot error (taken directly from Jeremy Howard's amazing guide to language models
- https://www.youtube.com/watch?v=jkrNMKz9pWU) is to erase the chat history and try again. Once GPT has made an error (or as the author of this article says, the early layers have irreversibly pruned some important data), it will very often start to be even more wrong.