I just found out about it and the first impression I got was this is basically a LiteLLM wrapper, a gateway/translation layer for OpenAI requests and a dashboard.
Is this an oversimplification of what that product is or not really?
To me, it feels like they just needed an "AI" product to say that ngrok also does AI stuff too!
I just found out about it and the first impression I got was this is basically a LiteLLM wrapper, a gateway/translation layer for OpenAI requests and a dashboard.
Is this an oversimplification of what that product is or not really?
To me, it feels like they just needed an "AI" product to say that ngrok also does AI stuff too!