G github.com Exllamav2: Inference library for running LLMs locally on consumer-class GPUs 322 points Palmik 3 years ago 125 comments
