Comment by nichochar

I think Karpathy[1] summarized why he thinks this is the case quite well (as described he was himself hyping it up a bit much, but there are some foundational reasons why it's a very interesting experiment).

[1] https://x.com/karpathy/status/2017442712388309406