The LPU (Language Processing Unit)

Related:

"What is a Language Processing Unit (LPU)?":

https://groq.com/blog/the-groq-lpu-explained

>"Groq on-chip SRAM has memory bandwidth upwards of

80 terabytes/second

, while GPU off-chip HBM clocks in at about eight terabytes/second. That difference alone gives LPUs up to a 10X speed advantage, on top of the boost LPUs get from not having to go back and forth to a separate memory chip to retrieve data."