Comment by zackangelo

I don't believe safetensors has a native int4 dtype, so they packed 4 int4s into a bf16 in this checkpoint.