William Merrill (@lambdaviking) on X

X (formerly Twitter) ·

1 min read Original article ↗

✨Excited to finally drop our new paper: SSMs “look like” RNNs, but we show their statefulness is an illusion🪄🐇 Current SSMs cannot express basic state tracking, but a minimal change fixes this! 👀 w/

@jowenpetty

,

@Ashish_S_AI

arxiv.org/abs/2404.08819