Comment by ipsum2

Ray doesn't offer anything if you use vLLM on top of Ray Serve though.