Ask HN: As a professional, does it worth it to learn the math behind NN?

In 2021, as a (junior) professional working directly with ML/AI, does it worth it to learn what's going on in terms of mathematics behind Neural Networks? Or should we just focus on the pratical side of things, like daily applications using frameworks/libraries and metrics/performance?