Settings

Theme

Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB

ziraph.com

6 points by ABS a month ago · 1 comment

Reader

ABSOP a month ago

lol, it took me 48 hours to do (and re-do, and re-do) this test + write it up and now that I convinced myself to stop changing bits and just publish it... Google's just announced the Gemma 4 QAT models :-D

It would not change the core of my article since the bottleneck remains the memory bandwidth on the old M1 16GB though

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection