Comment

Comment by teilo

No quantization (8_0). The full 48GB model. As for token count, I haven't tested it on more than 200 or so.
parent teilo 2 years ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton