Comment

Comment by barbacoa

I'm running qwen 3.6 27b at 8bit quantization and 262k context. It takes 53gb of vram on my system.
parent barbacoa 4 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton