Discussion

Ask HN: What is the best LLM for consumer grade hardware?

I have a 5060ti with 16GB VRAM. I’m looking for a model that can hold basic conversations, no physics or advanced math required. Ideally something that can run reasonably fast, near real time.
240 points VladVladikoff 1 year ago 182 comments

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton