Sorry that is my mistake, to clear it up:
1. Yes the API key here is the OpenAI key
2. The tool at the moment cannot be pointed to local models, though I am adding support for that. My focus right now is the following, in order of priority:
- Self-hosting the proxy server (priority)
- Adding support for local models
Ideally having the self-hosting would also allow people to switch things to use their own models (hosted) as well if need be.
Ideally having the self-hosting would also allow people to switch things to use their own models (hosted) as well if need be.