Settings

Theme

Jagged Flash Attention Optimization

shaped.ai

24 points by tullie 10 months ago · 4 comments

Reader
platers 9 months ago

Flash attention natively supports packing multiple variable length sequences into a single call, what is the advantage of jagged flash attention?

  • bbstats 9 months ago

    If only there was a link to a page somewhere that could answer this question for you.

CapsAdmin 9 months ago

See also

https://github.com/thu-ml/SageAttention and https://github.com/thu-ml/SpargeAttn

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection