Comment by celrod

It seems like thinking should be the place where it can iteratively draft before creating an output. I've wondered if text diffusion models could in theory write better, thanks to iteratively rewriting/refining the text. It seems to me at least that avenues like that are worth pursuing, so I'm happy to see efforts like Mercury 3 and Diffusion Gemma.