Comment by jameshart

What is the rationale for so many of these ‘run it locally’ AI ports to run as a server?

Have developers forgotten that it’s actually possible to run code inside your UI process?

We see the same thing with stable diffusion runners as well as LLM hosts.

I don’t like running background services locally if I don’t need to. Why do these implementations all seem to operate that way?