Comment by BeeBoBub

It is true that photonic systems can multiply/add very efficiently. The limiting factor for optical neural networks are activation functions. Non-linear relationships are hard for photonics. State-of-the-art nonlinear features require optical elements that are difficult to manufacture or op-amps which slow the computational potential of the optical neural network by orders of magnitude.