Meanwhile, a revolutionary paper that brought for the first successful time a new paradigm to NLP (latent variational autoencoders) and that destroy GPT 3 on text perplexity on the Pen treebank
(4.6 vs 20) and with order of magnitudes less parameters
is talked about nowhere on the web...
https://arxiv.org/abs/2003.02645v2