blah2244
Joined 5 years ago
Joined 5 years ago
Each token the model outputs requires it to evaluate all of the context it already has (query + existing output). By allowing it more tokens to "reason", you're allowing it to evaluate the context many times over, similar to how a person might turn a problem over in their heads before coming up with an answer. Given the performance of reasoning models on complex tasks, I'm of the opinion that the "more tokens with reasoning prompting" approach is at least a decent model of the process that humans would go through to "reason".
As for training, that's a pretty contentious topic in the running community right now -- some recent research concluded that training in supershoes might actually impair race performance: https://www.outsideonline.com/health/training-performance/su...
https://en.wikipedia.org/wiki/2024_California_Proposition_6