Comment by h4nkoslo

You also have a problem with precision. A test with a 100% pass threshold is a really poor estimator of an underlying failure rate; at best it can bound it, but you really do care about the precise underlying odds of failure.