Comment by blazarquasar

It may not be a huge resource hog, but it adds a ton of latency.

https://www.getmaxim.ai/bifrost/resources/benchmarks

Having ran both LiteLLM and Bifrost for months, I can largely confirm the numbers from those benchmarks for myself.