Comment by sdeep27

check out LiteLLM... been using in (lite) production and they make it easy to switch between models with a standardized API.