Comment by didroe

I think there's a question of semantics here. RL is way more expensive in terms of compute, as you have to generate a significant amount of output before you can judge whether it's good or bad. So compute is one angle, but another is how much impact RL has on the weights vs pre-training