Comment by Gh0stRAT

IIRC backpropagation was a very significant breakthrough on how to update weights when training neural nets.