Comment by larnon

Anyone tried this with vLLM yet? I am confused on how to turn this on tbh.