Comment by etdznots

Inference needs very little compute, it’s mostly IO. hence the low power draw, training is compute-heavy and uses lots of power