Comment Comment by BoredomIsFun > single RTX 3080 20G, I got 10 tok/s initiallyAdd $200, buy a used 3060 and you won't need to offload cache to RAM. Yo'd have like 50-60 t/s with MTP enabled. parent BoredomIsFun 2 months ago
Add $200, buy a used 3060 and you won't need to offload cache to RAM. Yo'd have like 50-60 t/s with MTP enabled.