Comment by fsh

I don't get the point. The model has presumably been trained on all public GitHub code, so the evaluation is tainted anyway.