Comment by yonkshi

Sure theoretical advances may be evolutionary, but they resulted in exponential reduction of parameter space and sample complexity. These advances outpace Moore's law by a large margin.

Hardware served as a catalyst, but it was not a necessity.