My favorite example is telling it to reverse some longer text character-by-character. Trivial for any human to perform perfectly, but all models I've tested struggle with it and make mistakes all over. It's really hard for them because they lack hidden state to perform algorithms - or what you would call thought in a human. Instead (essentially) for each step they have to re-consider the entire thing and their past output, figure out what they already did, and what they have to do next.
On the other hand they'll spit out python code that'll get you the reversed text just fine.
It's also one of their greatest shortcomings when it comes to coding: They lack the ability to do any meaningful symbolical execution.
On the other hand they'll spit out python code that'll get you the reversed text just fine.
It's also one of their greatest shortcomings when it comes to coding: They lack the ability to do any meaningful symbolical execution.
https://chat.openai.com/share/9faaae97-e20f-454e-b245-3e4c19...