GPT has no reasoning ability, it has billions of parameters that make it pretend it has it, purely going off of previously digested material.
As long as it comes across some reasoning process that have not been seen before in the training wordset, which can be as easy as a middle school math question, it fails. Because it has no ability to extrapolate logic.
If it manages to pass Bar test, that says more about the Bar test than it says about GPT.
As long as it comes across some reasoning process that have not been seen before in the training wordset, which can be as easy as a middle school math question, it fails. Because it has no ability to extrapolate logic.
If it manages to pass Bar test, that says more about the Bar test than it says about GPT.