Comment by mangoman

huh, thanks for commenting this! I trusted the linked explanation post https://declaude.org/watermarking/ but actually reading the the synthid paper showed me that my understanding was wrong: https://www.nature.com/articles/s41586-024-08025-4

It is definitely blurrier whether you can say this approach changes the distribution then. By definition, it _has_ to change the probabilities of output tokens, but it's not totally clear that the pseudorandomly generated scoring functions does affect the learned distribution.

put another way, I think it's safer to do:

compute distribution -> sample -> watermark from sampled options

than it would be to do:

compute distribution -> watermark distribution -> sample