Comment by awestroke

I don't understand how you can compare against the base model output without generating with the base model, in which case what's the point?