Comment

Comment by sandworm101

It is part of the trend to locally-hosted AI. I demoed my home rig (3x5060s) to my boss last week. It certainly was not as performant as commercial options, but was well above the 90% solution for what we needed. The boss was shocked at the price points for home-built hardware. Gaming GPUs are pricy, but are nowhere near the prices for commercial (rack-mount) compute hardware.

(People actually came by my desk to see "the AI", the physical thing. It blows people's minds to realize AI doesn't need a data center, that it is just some computer parts sitting on a desk.)

The big hitter AI companies see the writing on the wall: open source models and local AI rigs will decimate the market for big AI in the next few years.

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton