It's statistical prediction. LLMs do not "understand" the world by definition.
Ask an image generator to make "an image of a woman sitting on a bus and reading a book".
Images will be either a horror show or at best full of weird details that do not match the real world - because it's not how any of this works.
It's a glorified auto-complete that only works due to the massive amounts of data it is trained on. Throw in any complex interactions it has not seen in the training data and it's all over.
Ask an image generator to make "an image of a woman sitting on a bus and reading a book".
Images will be either a horror show or at best full of weird details that do not match the real world - because it's not how any of this works.
It's a glorified auto-complete that only works due to the massive amounts of data it is trained on. Throw in any complex interactions it has not seen in the training data and it's all over.