Comment by radeeyate

I'm a big fan of Crush: https://github.com/charmbracelet/crush

It's all BYOK but the also have Hyper (https://hyper.charm.land/) which is their hosted inference of OSS models.