Comment by mikestaub

They have made genuine progress on 'reading' the mind of the model, but 'writing' perfectly is not mathematically possible due to the gauge freedom in the residual stream.