Settings

Theme

With software alone, one B200 beats the LPU and gets close to Cerebras

runinfra.ai

11 points by OsamaJaber · 1 comment

Reader

1 thread
rnrn

Which model wrote this bizarre article?

Lots of emphasis on no kernels written and nothing recompiled but the intro and conclusion somehow suggest this is also the value of runinfra’s agents the rewrite software ?

Walk through the theory of peak decode throughout based on memory bandwidth with one weight load pass per token to provide a target for optimized decide but then doesn’t address low bandwidth utilization in that scenario at all and uses speculative decode where that theory doesn’t apply

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection