Comment by bobinaz

They are also almost exactly functional composition. Were it not for the activation terms, this composition would reduce to a simple linear equation.