Starting to feel more and more like chinese room experiment
The models are confidently answering physics questions, treating it as a math problem, but they don't fundamentally "get it" and even recently failed simple "should i drive to car wash" test
The sample efficiency is just crazy low
Still surprising that even with this they managed to saturate the benchmarks
The models are confidently answering physics questions, treating it as a math problem, but they don't fundamentally "get it" and even recently failed simple "should i drive to car wash" test
The sample efficiency is just crazy low
Still surprising that even with this they managed to saturate the benchmarks