Comment by mrinterweb

If inference continues toward the trend of becoming a commodity, and inference hardware efficiency is doubling every two years, that will likely mean that the price of inference will continue to fall so long as the market is competitive. I don't see how companies investing billions in inference hardware today will see profit in the lifespan of the hardware.