Comment by pcwelder

We just need transparency. It's okay if you change criteria, but pre-register the trigger for when you're going to change them.

Example could be, we'll update X criteria when top-N models are within 2 points of each other.