Settings

Theme

Clarification: Regarding the Performance of IQuest-Coder-V1

github.com

1 points by bbatsell 2 months ago · 1 comment

Reader

bbatsellOP 2 months ago

Anchor to new information (HN strips it from the URL): https://github.com/IQuestLab/IQuest-Coder-V1/issues/14#issue...

Context: Earlier this week a new model was released and researchers discovered that during training it had "cheated" on SWEBench by issuing git commands to find information it should have been blinded to.

Previous discussion: https://news.ycombinator.com/item?id=46472667

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection