Comment

Comment by skrellm

Yep, I agree. You can already run them locally on a top-shelf gamer PC with decent token throughput: https://github.com/Niko1221/Strata That's today.

As for tomorrow, consider that literally every chip maker is working on better and better NPUs to boost local performance (Ryzen AI, Intel Ultra, Apple M7, Broadcom PON, Huawei Ascend, Snapdragon X Elite, etc.), and imagine optimized models running on these, yeah, insanely huge potential.

As of 2026Q4 I wouldn't bet on any cloud AI, that's for sure.

parent skrellm 1 day ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton