Comment by omneity

Congrats for shipping!

Have you seen LiteLLM Gateway before? As a bonus it supports a lot of different providers.

https://docs.litellm.ai/docs/simple_proxy