Comment

Comment by ach9l

instead of ranting, maybe explain how to make a qat q4 work with images in vllm, afaik it is not yet possible
parent ach9l 1 year ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton