Show HN: Livenerf – a benchmark for whether Opus 5.5 gets nerfed
github.com
2 threads
If you don’t trust and are on the lookout for silent nerfing, how are you protecting against it detecting a benchmark and using the un-nerfed model?
I have no idea how to do it. Keep rerunning benchmarking test can be costly.