Comment by _0ffh

True, though the timeline was more the other way around. Error backprop was used as a method for training before using AD to automate the implementation work became the norm. Previously you had to write the backward pass by hand, now we use AD to derive it from the forward pass.