Congratulatuions on launch! Models monitoring is really important and there is huge lack for tools to do this. How would you notify users (model owner) about potential problems? Are you going to use email notifications?
Does user need to manually set threshold when alarms should be triggered?
What to do if there is a data drift?
What is the most difficult to detect drift example that you see?
Does user need to manually set threshold when alarms should be triggered?
What to do if there is a data drift?
What is the most difficult to detect drift example that you see?