Related - Meta recently found that the models have not been trained on data that helps the models reason about other entities’ perceptions/knowledge. They created synthetic data for training and retested, and it improved substantially in ToM benchmarks.
https://ai.meta.com/research/publications/explore-theory-of-...
I wonder if these models would perform better in this test since they have more examples of “reasoning about other agents’ states.”