Ask HN: What is the best local model that runs on your Mac at decent speed?
What are your own experiences on this? What mac/specs do you have? what is your preferred AI to run on it? at how many tok/s does it run and how much memory does it take?
I'll start:
I have a MacBookP M5 Pro with 48GB, my favorite model is Qwen 3.8 Flash running at 14-15 tok/s and takes 21-24 GB of memory
No comments yet.