Comment Comment by danielhanchen UD stands for "Unsloth-Dynamic" which upcasts important layers to higher bits. Non UD is just standard llama.cpp quants. Both still use our calibration dataset. parent danielhanchen 9 months ago