So do I understand correctly: This is a new head on top of the AlphaZero model?
That is, in addition to the usual evaluation and policy heads, this takes the intermediate board representation and outputs a seed vector that is fed into a transformer text generator?
Or do other things go into the seed? Like the search tree somehow? Otherwise I suppose the commentary will not be able to comment on deeper tactics?
Or maybe this doesn't work using a seed vector at all, but with a custom integration from the board into the transformer somehow?
That is, in addition to the usual evaluation and policy heads, this takes the intermediate board representation and outputs a seed vector that is fed into a transformer text generator?
Or do other things go into the seed? Like the search tree somehow? Otherwise I suppose the commentary will not be able to comment on deeper tactics?
Or maybe this doesn't work using a seed vector at all, but with a custom integration from the board into the transformer somehow?