Comment by cfn

Or 4 thousand for the NVIDIA RTX A6000 which also runs the 120b just fine (quantized).