Comment

Comment by swifthesitation

I don't think so. It seems to just lower the ram needed for the context window. Not for loading the model on the vram.

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton