Comment by spwa4

... but you'll be rewriting inference for any model that isn't a well-known LLM. Yourself.