Top
New
Best
Ask
Show
Jobs

Continuous batching enables 23x throughput in LLM inference

2 points richardliaw 3 years ago 0 comments

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton