That’s the beauty of using ChatGPT for programming questions. You don’t have to have confidence in the answer. You can easily verify correctness by running the code it outputs and testing it.
That being said, I realize you do have to be careful about subtle bugs.
My canonical example is “write a Python script that returns all of the AWS IAM roles that contain a given list of policies”.
The code it usually generates works correctly as long as you don’t have more than 50 roles in your account. It won’t add pagination support unless you spot the bug and tell it.
The second question I have is what type of questions do you find are better suited for Stack Overflow than ChatGPT? Are they questions based on post 2021 knowledge?
That being said, I realize you do have to be careful about subtle bugs.
My canonical example is “write a Python script that returns all of the AWS IAM roles that contain a given list of policies”.
The code it usually generates works correctly as long as you don’t have more than 50 roles in your account. It won’t add pagination support unless you spot the bug and tell it.
The second question I have is what type of questions do you find are better suited for Stack Overflow than ChatGPT? Are they questions based on post 2021 knowledge?