Comment by dannyw

If you like to experiment with training / finetuning / etc on LLMs, these are actually incredibly ‘cheap’.

1.2TB/s memory bandwidth unlocks a lot with 256GB unified, and agentic AI is pretty good at optimising performance.

For comparison, to get 256GB with NVIDIA, you’re looking at a DIY workstation build (need pcie lanes), and like $70k?

The spark’s ~250gb/s bandwidth doesn’t really count here.