> and it always responds with a causal representation.
It responds with a language representation. It uses "causal" words because that's how the English language works: we have tenses.
> I think a secondary module explicitly for reasoning will come around soon.
This has been an unsolved, actively-researched problem for ages – certainly since before you were born. I doubt very much that a solution will "come around soon"; and even if it does, integrating the solution into a GPT-based system would be a second unsolved problem – though probably a much easier (and more pointless) one. If you have any ideas, I invite you to pursue them, after a quick literature search.
It responds with a language representation. It uses "causal" words because that's how the English language works: we have tenses.
> I think a secondary module explicitly for reasoning will come around soon.
This has been an unsolved, actively-researched problem for ages – certainly since before you were born. I doubt very much that a solution will "come around soon"; and even if it does, integrating the solution into a GPT-based system would be a second unsolved problem – though probably a much easier (and more pointless) one. If you have any ideas, I invite you to pursue them, after a quick literature search.