Comment by marshalla

My prediction is that soon every mid-size+ company will have their own hardware running an open-weight model and all employees will be required to connect to it and it alone for inference.