The author has used weather prediction confidence as an example. I think it is not analogous to LLM's next-token prediction. LLM's next-token is predicted from a finite statistical model. And for the weather prediction model, there is no finite data-based statistical model.
I was surprised that the author hasn't mentioned Jev-like models. They're quite good for general purpose confidence rating.
I was surprised that the author hasn't mentioned Jev-like models. They're quite good for general purpose confidence rating.