thinking step-by-step requires 100% accuracy in each step. If you are 95% accurate in each step, after the 10th step, the accuracy of the reasoning chain drops to 59%. this is the fundamental problem with llm for reasoning.
reasoning requires deterministic symbolic manipulation for accuracy. only then it can be composed into long chains.
reasoning requires deterministic symbolic manipulation for accuracy. only then it can be composed into long chains.