Comment by nyfresh

The expectation seems a little harsh for the setup. GPT just generates acceptable text. You still need to model and verify object relationships, use facts from a knowledge base and discriminate the generated responses at the very minimum.

Any GPT model is just one component inside of a chatbot, not a chatbot itself.