Comment by x-complexity

Arguably, it requires the LLM to have access to the source code during training. If it's closed off (like Windows), then the LLM can't train on it.

Even if the source code's old, the fact that it is publicly available makes it much easier to train & improve on than if it were walled off.