Not learning from new input may be a feature. Back in 2016 Microsoft launched one that did, and after one day of talking on Twitter it sounded like 4chan.[1] If all input is believed equally, there's a problem.
Today's locked-down pre-trained models at least have some consistency.
Today's locked-down pre-trained models at least have some consistency.
[1] https://www.bbc.com/news/technology-35890188