Comment
Comment by fenazego
Without having read the article, I would say it demonstrates that benchmarks alone, without knowledge of how a model was trained (c.q. constructed), cannot reliably determine whether or not a model has certain capabilities.