The prompt and most reasoning is implicit inside the codebase. From every subsequent commit one can easily infer what the bugfix prompt was supposed to be or reasoning failures are.
All these repositories can easily be a part of the pre-training / post-training datasets. Perhaps the distillation the blog is speaking about is for text-generation not the code generation.
All these repositories can easily be a part of the pre-training / post-training datasets. Perhaps the distillation the blog is speaking about is for text-generation not the code generation.