I don’t buy this “it is just statistics” dismissal. Practically speaking, any multiple choice question is ultimately a “predict the next character, A, B, or C” challenge. Should we dismiss all multiple choice questions because they are just “predict the next token” tasks?
There is a broader question about whether it is possible to learn from reading. Can a blind person ever really understand “blue”? If not, what can be learnt by reading? Why do we rely on reading and writing so heavily for learning?
Edit: just want to note that this is a great site, really like the author’s approach and style. And maybe if I’ve not learnt from his writing, at the very least it is a good read :-)
There is a broader question about whether it is possible to learn from reading. Can a blind person ever really understand “blue”? If not, what can be learnt by reading? Why do we rely on reading and writing so heavily for learning?
Edit: just want to note that this is a great site, really like the author’s approach and style. And maybe if I’ve not learnt from his writing, at the very least it is a good read :-)