Comment by grunder_advice

The trick we use at work is to take note of the instantenous power consumed. The more it's consuming the more compute it is doing. As far as macro indicators, I'm not sure you can do better than that, without profiling.