Thanks for the feedback! We actually had a feature for “what is the accuracy if I only consider >80% confident samples” but we iterated away from it because people found it complicated. We’ll definitely bring it back when we can make it simple enough.
We’ve also found that people can get lost in the filters; in particular the “Not assigned” annotation filter we probably need to remove for people who have annotated all of their data.
In terms of separating training / test data: we use cross-validation so that we can abstract away the concept of train vs. test vs. validate sets.
We’ve also found that people can get lost in the filters; in particular the “Not assigned” annotation filter we probably need to remove for people who have annotated all of their data.
In terms of separating training / test data: we use cross-validation so that we can abstract away the concept of train vs. test vs. validate sets.