Comment Comment by chorizo That’s 24GB VRAM. Not enough to run a 27B model at a useful quant+context size. parent chorizo 4 months ago
