Comment

Comment by famouswaffles

Machine learning models don't store training data. The space a picture takes is irrelevant. For instance, stable diffusion would be the same size if it trained on 1 billion images than if it trained on 200 million or even 1 image(or 0 images).

Weights/parameters are configuration settings not training data storage. When weights/neurons/parameters are updated after each training loop, you are essentially updating configuration settings that direct generations, not storing any particular training text or image.

Weights are what take up the space. The bigger the parameter size/the number of weights, the bigger the size of the model.

Image generators don't need the huge parameter numbers text generators need to be useful. What they need to learn simply isn't as complex.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton