Settings

Theme

Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism

github.com

4 points by yzh · 2 comments

Reader
1 thread
ufotalent

An interesting playground to understand the scheduler is here https://huggingface.co/spaces/sail/zero-bubble-pipeline-para...

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection