Comment by msp26

Do you have any advice on this front? I use vllm for a project but only for text tasks at the moment.