Comment Comment by animal531 Doing some googling against DeepSeek for which more stats are openly available: We need~508GB+ Uncompressed memory~256Gb with 3-bit compression (about 3 bits per weight)~128Gb with 1-bit compression (1.58 to 2.3 bits per weight)So uncompressed is still about an order of magnitude out of most home systems' reach, but with compression it's not far off. parent animal531 12 days ago
~508GB+ Uncompressed memory
~256Gb with 3-bit compression (about 3 bits per weight)
~128Gb with 1-bit compression (1.58 to 2.3 bits per weight)
So uncompressed is still about an order of magnitude out of most home systems' reach, but with compression it's not far off.