Comment by DrAwdeOccarim

LM Studio lets you run a model as a local API (OpenAI-compatible REST server).