Can someone explain to me why this needs to connect to LLM providers like OpenAI or Anthropic? I thought it was meant to be a local GPT. Sorry if i misunderstood what this project is trying to do.
Does this mean the inference is remote and only context is local?
Does this mean the inference is remote and only context is local?