I just don't know if "similar" is good enough. We know what thinking is based on biological brains, so if we are to conclude it happens in machines, the experiment should have identical results, or it's more probable that it's something completely different.
The way around this is to have a predictive theory of how thoughts work, and if that is proven true, then use that to analyze the LLMs. So far we have no such theory so I think the only tool is to look at the exact behavior match.
The way around this is to have a predictive theory of how thoughts work, and if that is proven true, then use that to analyze the LLMs. So far we have no such theory so I think the only tool is to look at the exact behavior match.