Comment by ht96

Do you use a tool for this? Is there some sort of tool which collects evals from live inferences (especially those which fail)