Comment by amelius

The long term memory is in the training. The short term memory is in the context window.