Settings

Theme

Absolute Zero: Reinforced Self-Play Reasoning with Zero Data

andrewzh112.github.io

7 points by dave1010uk 8 months ago · 2 comments

Reader

pk-protect-ai 7 months ago

Wow, so empty here, and it was 3 days ago... I wonder why?

I have a question if someone can answer. On github they are stating 8x80GB for 14B models but I found no information on how long this fine-tuning takes?

Given the toolchain, it probably takes significant time.

Another question wouldn't it be fun to hijack the training loop with some tasks set by humans? Would it improve results or opposite?

I wonder if at some point all tasks will degrade to the "uh-oh moment" tasks, which will be most complex and perplexing with no actual productive yield?

dave1010ukOP 8 months ago

Paper: https://arxiv.org/abs/2505.03335

Code: https://github.com/LeapLabTHU/Absolute-Zero-Reasoner

Thread: https://xcancel.com/AndrewZ45732491/status/19199204597489092...

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection