Comment by ranyume

I did not ask the model which model it is, I'm not interested in the model answering the question either. The interesting bit is that this happens while doing another task. I'm not saying that this is because of distillation of openai's model either or a proxying. To me this looks like a side effect of their RL.