Comment by in-silico

I like the enthusiasm but no they actually work fine without positional encodings: https://arxiv.org/abs/2512.12167