This article is wrong. SynthID-style watermarking does not affect one-shot generation quality. When news about the watermarking went around a couple of months ago I too thought there must be a quality/detectability tradeoff (as there is for images), but I dug into the math more and realized that my intuition was incorrect.
They key idea is this: changing the random seed for LLM generation definitionally does not change the distribution of tokens in expectation over all seeds.
This can already be used to embed information in LLM streams, leading to LLM steganography work (https://arxiv.org/abs/2606.09135, but the idea dates back much further). Take your target message, whiten it via a one-time pad (stream cypher), then use it as the 'compressed stream' under an arithmetic decoding process (https://en.wikipedia.org/wiki/Arithmetic_coding) with the LLM-supplied logits as the assumed probabilitiy distribution.
SynthID pulls off the same kind of trick, save that its 'tournament structure' allows application after the sampling step rather than before. The random seed under SynthID becomes context sensitive (keying on the prior N tokens as well as the watermark seed), but in expectation the next-token distribution is still the same as the unwatermarked case.
If there's no change in token distribution, then there can't be a change in quality.
However, the article and its sources are right about one factor: random generation diversity will suffer. Applying SynthID to an LLM stream acts like fixing the PRNG seed. Repeated generations with the same prompt and same seed will deliver the same result, up to small amounts of nondeterminism in the architecture (mostly GPU scheduling and roundoff). This matters under the same circumstances that it would matter if the provider said "we sample using the XYZ PRNG with fixed seed '42'".
In my opinion, 'sample diversity' and 'sample quality' are not the same thing, and conflating the two concepts leads to poor intuition. SynthID and the like probably matter most if one is trying to repeatedly sample an LLM in order to infer the probability distribution (e.g. using a commercial LLM provider as a Jev-style classifier, looking for calibrated answers).
They key idea is this: changing the random seed for LLM generation definitionally does not change the distribution of tokens in expectation over all seeds.
This can already be used to embed information in LLM streams, leading to LLM steganography work (https://arxiv.org/abs/2606.09135, but the idea dates back much further). Take your target message, whiten it via a one-time pad (stream cypher), then use it as the 'compressed stream' under an arithmetic decoding process (https://en.wikipedia.org/wiki/Arithmetic_coding) with the LLM-supplied logits as the assumed probabilitiy distribution.
SynthID pulls off the same kind of trick, save that its 'tournament structure' allows application after the sampling step rather than before. The random seed under SynthID becomes context sensitive (keying on the prior N tokens as well as the watermark seed), but in expectation the next-token distribution is still the same as the unwatermarked case.
If there's no change in token distribution, then there can't be a change in quality.
However, the article and its sources are right about one factor: random generation diversity will suffer. Applying SynthID to an LLM stream acts like fixing the PRNG seed. Repeated generations with the same prompt and same seed will deliver the same result, up to small amounts of nondeterminism in the architecture (mostly GPU scheduling and roundoff). This matters under the same circumstances that it would matter if the provider said "we sample using the XYZ PRNG with fixed seed '42'".
In my opinion, 'sample diversity' and 'sample quality' are not the same thing, and conflating the two concepts leads to poor intuition. SynthID and the like probably matter most if one is trying to repeatedly sample an LLM in order to infer the probability distribution (e.g. using a commercial LLM provider as a Jev-style classifier, looking for calibrated answers).