Comment by coef2

It's ironic that ML researchers don't fully understand why their models behave the way they do, yet continue to make progress using benchmarks to guide the efforts. Human understanding is important but whether and to what extent it's necessary seems to be a separate question, and the answer may depend on the nature of the field.