Comment

Comment by WarmWash

Pirated content can run on a $20 computer.

SOTA open models need tens of thousands of dollars worth of hardware to run.

I get your analogy, and it feels right, but the compute requirements to run these models are extreme. That analogy falls apart when it necessitates having a corporate 3rd party run the models for you. They will not tolerate breaking laws.

If China says no more, then the best the masses are gonna get on their high-end setups are the 30B class models. Which are decent, but not "hack my bank", errr, "protect our bank" decent.

Piracy flourished because you only need an operating laptop to participate. LLMs you need a server rack of GPUs to participate.

parent WarmWash 1 day ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton