Comment Comment by ssabev Would recommend just picking up a gateway that you can deploy and act as an OpenAI compatible endpoint.We built something like this for ourselves here -> https://www.npmjs.com/package/@kluai/gateway?activeTab=readm....Documentation is a bit sparse but TL;DR - deploy it in a cloudflare worker and now you can access about 15 providers (the one that matter - OpenAI, Cohere, Azure, Bedrock, Gemini, etc) all with the same API without any issues. parent ssabev 2 years ago
We built something like this for ourselves here -> https://www.npmjs.com/package/@kluai/gateway?activeTab=readm....
Documentation is a bit sparse but TL;DR - deploy it in a cloudflare worker and now you can access about 15 providers (the one that matter - OpenAI, Cohere, Azure, Bedrock, Gemini, etc) all with the same API without any issues.