Gauging state of the art against what is available for free or for very cheap per token cost is like gauging the maximum theoretical transport potential by riding a bicycle.
You’re using something that is very energy efficient; you cannot extrapolate that experience to conclude that SOTA models are not doing something much different.
You’re using something that is very energy efficient; you cannot extrapolate that experience to conclude that SOTA models are not doing something much different.