Comment by andruby

This is an open weights 22B model. The download on Huggingface is 44GB.

Is there a rule-of-thumb estimate for how much RAM this would need to be used locally?

Is the RAM requirement the same for a GPU and "unified" RAM like Apple silicon?