Comment by bugglebeetle

Isn’t this more a problem of running inference for closed-source AI services? Considering we have open models that are now within throwing distance of GPT-4, it would make sense to do those workloads outside data centers running a single service (or even on people’s devices). Of course training still requires lots of resources, but that doesn’t have to happen nearly as frequently.