Isn't the current GPU-based stack which drives the progress of AI an early stage architecture which will become sub-optimal and obsolete in a longer term?
Having separate processors with separate memory and separate software stack to do matrix operations works, but it would be much more convenient and productive to have a system with one RAM and CPUs that can efficiently do matrix operations and would not require the programmer to delegate these operations to a separate stack. Event the name 'Graphics Processing Unit' suggest that the current approach for AI is rather hacky.
Because of this, in a long run there can an opportunity for Intel and other CPU manufacturers to regain the lucrative market from NVIDIA.
Having separate processors with separate memory and separate software stack to do matrix operations works, but it would be much more convenient and productive to have a system with one RAM and CPUs that can efficiently do matrix operations and would not require the programmer to delegate these operations to a separate stack. Event the name 'Graphics Processing Unit' suggest that the current approach for AI is rather hacky.
Because of this, in a long run there can an opportunity for Intel and other CPU manufacturers to regain the lucrative market from NVIDIA.