Comment by lawlessone

I've found they fall apart after a couple of moves and lose track of the game.

Edit: This might not be the case anymore it seems, my below point doesn't actually contradict you, seems it matters a lot how you tell the model your moves. Also saying things like "move my rightmost pawn" completely confuses them.