sherlockxu
Joined 4 years ago
Karma
419
Submissions
121
Member since
Sep 20
Hello world
View on Hacker NewsJoined 4 years ago
We created this handbook to make LLM inference concepts more accessible, especially for developers building real-world LLM applications. The goal is to pull together scattered knowledge into something clear, practical, and easy to build on.
We’re continuing to improve it, so feedback is very welcome!
GitHub repo: https://github.com/bentoml/llm-inference-in-production