Comment by bitvoid

Backpropagation happens after some number of inferences. You need to infer to calculate a loss function to then backprop from.