Settings

Theme

SIMD Softmax, Neon to WASM, with Google Highway

uchenml.tech

3 points by euos · 2 comments

Reader

1 thread
janwas

Great writeup, especially liked the line by line explanation :)

We actually did manage to get dynamic dispatch working in Compiler explorer with Matt's help: https://gcc.godbolt.org/z/KM3ben7ET

Maybe interesting to also refer to Gemma.cpp's version: https://github.com/google/gemma.cpp/blob/dev/ops/ops-inl.h#L...

We recently added a FastExpMinusOrZero, only valid for inputs <= 0, which is true for softmax.

  • euosOP

    Thanks

    I have not yet looked in dynamic dispatch - I train on Neon and deploy to WASM so I only target a single arch on each target...

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection