Comment by causality0

One interesting weak point I've noticed with GPT is that if you ask it to give examples from a category which in the real world has hundreds or thousands of different possibilities, it will give you the same half dozen answers every time. You ask it to give you "opponents" and it will always give you male humans. You ask it to give you "monsters" to kill and it always gives you orcs, giant spiders, skeletons. If a chest is supposed to have "useful items", it's always a healing potion.