Unsloth Qwen3.8-27B GGUF files
huggingface.co
3 threads
Which quant would cut it closest on a 16GB VRAM card?
Need the mlx versions to test it out!
304 comments: https://news.ycombinator.com/item?id=49299605
This is specifically about unsloth having day-1 GGUF's available.
That was pretty darn fast :) I'm curious whether they got a headstart or if they're that reactive