Comment by rreinold2

Guideline is (TOTAL_RAM - 5GB overhead) = max size, in billions of parameters. So 16 - 5 = 11, so <11B. Qwen 3.8 9B is a good fit