iirc, the human neocortex is only 6 layers deep with some interesting vertical connection structures, perhaps similar to skip connections in NN.
It would be interesting to see where the
deep vs wide analysis ends up when many problem types are used. Can a single network be trained on multiple problems at once and perform well on all?
It would be interesting to see where the deep vs wide analysis ends up when many problem types are used. Can a single network be trained on multiple problems at once and perform well on all?