Comment

Comment by denn-gubsky

Ryzen 7 8700G is an APU, and it has built-in Radeon 780M GPU (12 CUs, ~12.6 TFLOPS, plus an NPU). This is not very strong, but this is floor which runs local models for me and saves a lot of paid tokens. Potentially this setup may be upgraded to AI MAX when AM5 APUs will become available in box packages (now they are OEM-availabe only). The most expensive part of my system is DDR5, and it may be reused in case of upgrade. Actually, this is my self-hosted NAS (TrueNAS Scale) which also runs Ollama and serves as my local inference machine.
parent denn-gubsky 3 months ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton