Comment by tiredgirl4

One approach could be information theoretical. We could for instance try to quantify intelligence mathematically via von Neumann entropy on the linear maps present within the transformer architecture.