This is exactly the reason why I strongly dislike when people use the verb "lying" to describe when ChatGPT presents information that is factually inaccurate. It implies intent and people already have a tendency to over-anthropomorphize these systems.
Hallucinates is a far more accurate description.