Ask HN: Best open source way to run local open-weight LLMs in 2026?

4 points by samuell a month ago · 1 comment · 1 min read

As we are lucky to have great open weight models these days, I was wondering what is the recommended way to run these models locally, while staying with open source software that doesn't track you etc?

The only tool I've really tested is Ollama, but learned recently that it is pivoting into a less open direction, I'm not so sure about using it anymore, and was interested to hear your opinions and experiences.