Try that same prompt with unusual wording and numbers:
* Replace 18 by 37
* Replace car with ice cream van
* Replace the first drive with
steer
I hypothesize that a truly reasoning model would see through such alterations whereas a "just" continuously better model would show somewhat degraded performance.
* Replace 18 by 37
* Replace car with ice cream van
* Replace the first drive with steer
I hypothesize that a truly reasoning model would see through such alterations whereas a "just" continuously better model would show somewhat degraded performance.