Comment

Comment by Isinlor

Transformers are very bad at counting due to how their internals work. But if you ask them to use explicit counter the problem disappears:

Basically one feed forward is not Turing complete, but autoregressive (feeding previous output back into itself) are Turing complete.

Discussion