Comment by slowhadoken

orthogonal? Neural networks are a layered graph structure. When they talk about "parameters" they're referring to nodes and edges.