Comment by lfmunoz4

Penrose is saying a computer cannot understand / has no intelligence, and the incompleteness theorem proves this. Think in terms of the semantics (the meaning) of what the AI is outputting. The incompleteness theorem proves it does not understand and can never understand the semantics. It operates at the syntax level. How can something operating at the syntax level be intelligent? All it can do is look at symbols and rearrange them. There are algorithms to categorize and give these symbols (tokens/words) weights etc but all it can do is rearrange symbols. Do humans re-arrange symbols, no, they understand. They experience the color red, but to a computer the color red is a number. What is the connection between the number for red and the color red? AI pretty much collects every instance of red and in some sense approximates what red actually is.