Discussion

Ask HN: Cheapest hardware to run Llama 2 70B

Was wondering if I was to buy cheapest hardware (eg PC) to run for personal use at reasonable speed llama 2 70b what would that hardware be? Any experience or recommendations?
70 points danielEM 3 years ago 50 comments

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton