Comment by throwdbaaway

Hold on.. the routed experts are in FP8 now? Previously they were in BF16. Nice, this shall cut my download time by half!