Is this just a theory about an architecture or are there actually some benchmarks/results to substantiate it?

appears it's just a theory, sort of surprised this lifted up so far on hn

not sure w/o context why this is important -- no results/implementation & i believe there are prior combinations of transformers/RNNs. but perhaps I'm missing the relevance/insight