Settings

Theme

Patience Is Required for Local AI

kylemcgough.com

16 points by sosodev · 2 comments

Reader

2 threads
mberlove

The author makes a good point, but also, the visual appeal of this blog is very readable and appealing. Not a format I would have thought of but it's a pleasant surprise.

ch_sm

that is a very fair point i haven‘t seen being made thus far. it took a long time for gemma4 and qwen 3.6 to reach the speed and reliability that they have now, and many (including myself) made assumptions about their viability on day one. we ought to give ourselves and the foss runtime maintainers, and quants more time with new models. it‘s not a quick and easy process to optimize at this point.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection