Comment

Comment by minraws

That's the point I believe fast local 2-4 user service for cheap on very large models.

You have to pretend it's for servers to keep investors happy, it would be banks and similar with in house servers that have to run local large models buying these for experiments and cybersecurity. Likely.

parent minraws 19 days ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton