Comment
Comment by crowwork
XGrammar is an open-source library for efficient, flexible, and portable structured generation. Bring 2x-10x speedup in grammar grammar-guided(JSON and CFG) LLM serving.
No comments yet
Be the first to share your thoughts.