Comment by Aurornis

Good point, but you still need KV cache and more. Fitting the model alone to RAM doesn’t get the job done.