Comment Comment by red75prime They do. For example, training transformers on addition creates circuits that perform modular addition. See "A Mechanistic Interpretability Analysis of Grokking" parent red75prime 3 years ago