Comment by xfalcox

We have vLLM for running text LLMs in production. What is the equivalent for this model?