Comment by still-learning

Why is there so much interest in local AI systems, am I missing something? Cloud providers have scale and expertise that would allow for much bigger throughput at lower costs. The small latency gains will be nice, but ChatGPT and Claude already come through blazingly fast via their API.