Comment Comment by Aurornis > gpt-oss-120b full quant runs on my quad 3090A 120B model cannot fit on 4 x 24GB GPUs at full quantization.Either you're confusing this with the 20B model, or you have 48GB modded 3090s. parent Aurornis 7 months ago
A 120B model cannot fit on 4 x 24GB GPUs at full quantization.
Either you're confusing this with the 20B model, or you have 48GB modded 3090s.