Settings

Theme

Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses

quesma.com

3 points by stared · 2 comments

Reader

1 thread
mrrrcs

One run per cell is more noise than the gap you are measuring

  • staredOP

    These was some code budget there.

    But as from seeing various runs, errors bars are gross overestimation (as not "the same test", but "if we have different tasks from the same sample").

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection