Comment by imtringued

They advertised it as 10% to 15% worse than transformers

Not sure what the point of the paper's title is if the resulting model does not match the transformer.