But they have "learned to implement any of the algorithms we know that we have used to make strong chess engines". Ask Claude Code to write you a chess engine. Your objection is that they don't implement MCTS in the neurons themselves? Neither does a human, we use a C compiler when we want to play chess using MCTS.
That's a separate question from whether an LLM (unaided by a C complier) can learn to play chess as well as human (also unaided by a C compiler). Certainly humans can't become grandmasters only by reading chess transcripts on the web, and certainly humans require many "thinking tokens" during a game to play effectively. Do you know for sure that a transformer can't reach grandmaster level if it is allowed to learn by playing games (as humans do) and is given a sufficient number of thinking tokens during the game? It seems near certain that they could, if someone wanted to spend the money (and I don't see why anyone would.)
That's a separate question from whether an LLM (unaided by a C complier) can learn to play chess as well as human (also unaided by a C compiler). Certainly humans can't become grandmasters only by reading chess transcripts on the web, and certainly humans require many "thinking tokens" during a game to play effectively. Do you know for sure that a transformer can't reach grandmaster level if it is allowed to learn by playing games (as humans do) and is given a sufficient number of thinking tokens during the game? It seems near certain that they could, if someone wanted to spend the money (and I don't see why anyone would.)