Comment by darkvertex

Or why not stay fully local with WebLLM... https://webllm.mlc.ai