> internal models can even solve a millenium prize problem.
OpenAI stole the work of Tristan Buckmaster to do it, and refused to explicitly deny it.
What do you think has enabled the 'staggering rate' of improvement? Scaling up? More data? It seems like, since LLMs do not solve problems from first principles and make crucial use of human work (without which they'd have nothing), once all the data has been eaten, some sort of plateau will indeed be reached. Anthropic are already reportedly buying up all of the world's second-hand books and destructively (their words) scanning them in a desperate rush for ever more training data, so I don't think this theory is unfounded.
What do you think of the Hassabis Test? Until it passes, I don't see how humans are replaced.
OpenAI stole the work of Tristan Buckmaster to do it, and refused to explicitly deny it.
What do you think has enabled the 'staggering rate' of improvement? Scaling up? More data? It seems like, since LLMs do not solve problems from first principles and make crucial use of human work (without which they'd have nothing), once all the data has been eaten, some sort of plateau will indeed be reached. Anthropic are already reportedly buying up all of the world's second-hand books and destructively (their words) scanning them in a desperate rush for ever more training data, so I don't think this theory is unfounded.
What do you think of the Hassabis Test? Until it passes, I don't see how humans are replaced.