Settings

Theme

Show HN: Run Full Kimi K3 with 29 GB of RAM

github.com

9 points by marcobambini · 2 comments

Reader

2 threads
freetoolsnova

Interesting approach running Kimi K3 in 29GB — curious what quantization/precision tradeoffs you had to make to get it there. I've been dealing with similar memory constraints running client-side AI models in the browser (background removal via ONNX runtime) — the tradeoff between model size and quality never really goes away, just moves where you hit it.

astaka

I keep seeing people sayi they can run Kimi K3 in personal PC so a small cluster server rented. I understand that will have a lots of performnace drop and trade-off but why need to do so if you can just spend a litte money to use full K3 in OpenRouter, I'm just curious...

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection