Comment by snklt

does this only work for vLLM or is generally applicable?