That is what I'm saying. There's a gold rush to extract what can be done with LLMs, but no indication that it'll continue. Maybe it will, but the evidence for its continuation seems to be entirely hype based on the fact that we've suddenly thought of new things to try. It's not because 'the capabilities are improving at a staggering rate omg the singularity is here guys'; it's mostly because no one bothered to spend enough time and money (and currently absurd amounts are required) to give it a serious shot until recently.
I like the test proposed by Demis Hassabis. Something like: train an LLM on pre-Einstein physics and see if it can rediscover what Einstein did. Despite the incessant noise online, we seem to be no closer to this. If there's material evidence that we are, I'd sincerely like to hear about it!
I like the test proposed by Demis Hassabis. Something like: train an LLM on pre-Einstein physics and see if it can rediscover what Einstein did. Despite the incessant noise online, we seem to be no closer to this. If there's material evidence that we are, I'd sincerely like to hear about it!