Comment

Comment by MallocVoidstar

That isn't unquantized, it's de-quantized. They went from Q5 to fp16 for use in Pytorch instead of the GGUF ecosystem.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton