Comment

Comment by petu

158GB number is for Mistral Medium 3.5 128B model, Muse Spark is way larger.

  Muse Spark Open would require more than 1.6TB of RAM in its native precision (BF16) for the model parameters alone. In a 4-bit quantized (NVFP4) format, the model memory footprint is lowered to about 493GB.
parent petu 15 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton