How do you measure how much a person knows, and how do you objectively measure how much an LLM knows?
Here’s a very basic example of where an LLM is clearly more capable than a human: language translation. I would bet $10k at 10:1 that there are no humans who can reliably translate to and from as many languages as an LLM can.
It is very easy to measure knowledge: test the subject.
Personally, I can’t ever imagine scoring higher on a general knowledge test than a contemporary LLM.
Also, I don’t know of any humans that can run as fast as a car so I don’t know why any of this is surprising or farfetched.
Here’s a very basic example of where an LLM is clearly more capable than a human: language translation. I would bet $10k at 10:1 that there are no humans who can reliably translate to and from as many languages as an LLM can.
It is very easy to measure knowledge: test the subject.
Personally, I can’t ever imagine scoring higher on a general knowledge test than a contemporary LLM.
Also, I don’t know of any humans that can run as fast as a car so I don’t know why any of this is surprising or farfetched.