Comment by SparkyMcUnicorn

If active weight bandwidth is everything, then wouldn't Qwen 35b a3b (FP8) be roughly half the cost of dsv4f (FP4)?

dsv4f appears bigger and more memory/computationally expensive to run any way I look at it.