Discussion

Ask HN: What is the best local model that runs on your Mac at decent speed?

What are your own experiences on this? What mac/specs do you have? what is your preferred AI to run on it? at how many tok/s does it run and how much memory does it take?

I'll start:

I have a MacBookP M5 Pro with 48GB, my favorite model is Qwen 3.8 Flash running at 14-15 tok/s and takes 21-24 GB of memory

1 points carloslfu 1 month ago 0 comments

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton