Comment by willy_k

Mechanistic interpretability is a field that studies exactly this.