Comment by Flemlo

We do the same thing.

We have long term memory and short term.

Context is short term.

The still long and expensive training phase embeds the long term memory.