Comment by harles

That could explain compute efficiency, but has nothing to do with the parameter efficiency pointed at in the paper.