Comment by jackgolding

This is the case with all neural nets/black box AI models and a lot are used in various industries.