Comment

Comment by bangaladore

Can someone ELI5 why the safetensor file is 23.8 GB, given the 12B parameter model? Does the model use closer to 24 GB of VRAM or 12 GB of VRAM. I've always associated a 1 billion parameter = 1 GB of VRAM. Is this estimate inaccurate?

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton