Comment by mmargenot

You’re trying to get calibrated confidence, otherwise it’s less effective than you’d hope.

This approach with more data for calibration is basically the beginning of making a decision model like Jev.