Comment Comment by yourMadness 14B with Q4_K_M quantization is about 9 GB.Remarkable that it is at all comparable to Sonnet 3.5 parent yourMadness 2 years ago
Remarkable that it is at all comparable to Sonnet 3.5