Comment by aaronharnly

Congratulations on shipping! We are currently evaluating replacing our homegrown version of an LLM proxy with this project:

https://github.com/BerriAI/litellm

Any comparison or contrast you would point out?