Comment by zh217

This sounds pretty bad, right? Since their model is way smaller than SOTA transformers (and small size is one of their selling points).