Comment by flir

I don't think it will be the moment nvidia decide there's more money to be made in selling hardware for local-first inference. They'll do the training themselves and give the models away for free, like the toy in a box of cornflakes.

I'm sure cloud models will always have a slight edge but most tasks, most of the time, won't need that few extra percentage points of performance.