U ubicloud.com Life of an inference request (vLLM V1): How LLMs are served efficiently at scale 175 points samaysharma 1 year ago 21 comments
