I've found that for questions that aren't super complex on things that are extremely likely to be in its training dataset (such as public documentation of popular Python libraries) the error rate is very close to 0%. Even compared to GPT from a few months ago I've found the accuracy of responses has increased dramatically.
I still believe anyone using these tools on a day-to-day basis should have a sense of "trust but verify."
I still believe anyone using these tools on a day-to-day basis should have a sense of "trust but verify."