Comment by catdog

Models can ingest up to date documentation, source code and search the web, context windows are big enough these days. Sure at some point retraining will be needed but not every few month and you likely don't have to start at zero every time.