I'm certain that AI business will plateau and there will be yet another AI winter without new big breakthroughs in fundamental research.
We are currently living in a era where the results from Hinton & Canadian Mafia are still begin adopted and refined. It's just alternating layers of affine transformations and nonlinearity with lots of tricks and improved routing.
There needs to be fundamental theoretical breakthrough in every decade or so, and not just refinements and new applications. Hinton made his "What is wrong with convolutional neural nets" speech years ago "https://www.youtube.com/watch?v=rTawFwUvnLE I believe that Hinton's capsule networks type attempts are what we need more. They may not deliver immediately impressive results because fundamental research involves lots of setbacks.
We are currently living in a era where the results from Hinton & Canadian Mafia are still begin adopted and refined. It's just alternating layers of affine transformations and nonlinearity with lots of tricks and improved routing.
There needs to be fundamental theoretical breakthrough in every decade or so, and not just refinements and new applications. Hinton made his "What is wrong with convolutional neural nets" speech years ago "https://www.youtube.com/watch?v=rTawFwUvnLE I believe that Hinton's capsule networks type attempts are what we need more. They may not deliver immediately impressive results because fundamental research involves lots of setbacks.