Comment

Comment by wskwon

Not really. vLLM optimizes the throughput of your LLM, but does not reduce the minimum required amount of resource to run your model.
parent wskwon 3 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton