Show HN: Phase Router – capacity-aware routing for MoE
github.com
1 thread
Reducing dropped tokens could also improve model training by reducing gradient noise
Reducing dropped tokens could also improve model training by reducing gradient noise