Comment by maplethorpe

You could train an LLM on a dataset that intentionally excludes certain data, and see if it is able to extrapolate outside of its dataset and come up with those excluded items independently.

For example, remove all code from your training data, and then see if the model can code regardless.