The difference between 3.5 and 4 is gigantic even in my fairly limited experience.
I gave them both some common sense tests and this one stuck out to me.
Q: A glass door has ‘push’ written on it in mirror writing. Should you push or pull it
GPT-3.5:
If the word "push" is written in mirror writing on a glass door, you should push the door to open it
GPT-4:
Since the word "push" is written in mirror writing, it suggests that the instruction is intended for people on the other side of the door. Therefore, you should pull the door to open it.
I gave them both some common sense tests and this one stuck out to me.
Q: A glass door has ‘push’ written on it in mirror writing. Should you push or pull it
GPT-3.5:
If the word "push" is written in mirror writing on a glass door, you should push the door to open it
GPT-4:
Since the word "push" is written in mirror writing, it suggests that the instruction is intended for people on the other side of the door. Therefore, you should pull the door to open it.