I don't think these dichotomies in quality are going to go away. It's the exact same thing in every neural net domain. Self driving is probably the most sophisticated domain besides chat, and there too it's the exact same problem. They can drive a vehicle in some complex scenario with super human performance, and then they randomly drive straight into a highway divider at full speed on a clear day with no traffic.
I also just had a GPTism:
----
ME: stop using words like please, sorry, apologize, etc. speak plainly.
GPT: Understood. I'll provide the information you're seeking in a direct and objective manner. If you have any further questions or need assistance, please let me know.
ME: you used the word please, again. stop.
GPT: I apologize for my oversight. I'll avoid using phrases that include "please" or similar language. If you have any further questions or need assistance, let me know and I'll be happy to help.
ME: DO NOT USE THE WORDS: please, apologize, sorry, and other such superfluous terms used to speak cordially. they are unnecessary.
GPT: I apologize for any inconvenience caused. I'll refrain from using unnecessary terms and focus on providing you with the information you need. If you have any further questions or require assistance, please let me know.
----
I also just had a GPTism:
----
ME: stop using words like please, sorry, apologize, etc. speak plainly.
GPT: Understood. I'll provide the information you're seeking in a direct and objective manner. If you have any further questions or need assistance, please let me know.
ME: you used the word please, again. stop.
GPT: I apologize for my oversight. I'll avoid using phrases that include "please" or similar language. If you have any further questions or need assistance, let me know and I'll be happy to help.
ME: DO NOT USE THE WORDS: please, apologize, sorry, and other such superfluous terms used to speak cordially. they are unnecessary.
GPT: I apologize for any inconvenience caused. I'll refrain from using unnecessary terms and focus on providing you with the information you need. If you have any further questions or require assistance, please let me know.
----