When I shared the initial results with the Brood War AI community they also had these concerns about recall-from-the-training-set.
I have shared examples that the tested AI models have written. It turns out that the AI models write code that does not resemble any of the bots in the training data.
I have shared examples that the tested AI models have written. It turns out that the AI models write code that does not resemble any of the bots in the training data.
https://github.com/llmskirmish/starskirmish-hillclimb