Recurrent Looped Transformer
yifanzhang-pro.github.io
2 threads
Is this just a theory about an architecture or are there actually some benchmarks/results to substantiate it?
appears it's just a theory, sort of surprised this lifted up so far on hn
not sure w/o context why this is important -- no results/implementation & i believe there are prior combinations of transformers/RNNs. but perhaps I'm missing the relevance/insight