Comment by AlexCoventry

Have you seen the tables in Appendix E (starts p. 16) of the Transformer-XL paper? I think they're pretty good.

https://arxiv.org/pdf/1901.02860.pdf