Why do LLMs attend to the first token?
arxiv.org
1 thread
Curious if the authors had a chance to look at the Softpick paper? https://arxiv.org/abs/2504.20966
Curious if the authors had a chance to look at the Softpick paper? https://arxiv.org/abs/2504.20966