Comment by tnspacetime

Yes I read that one, and that’s why I said the explanation is not clear. Anyway, catastrophic forgetting is theoretically not possible. “ Existing capability must substantially learn new information, so its representation must change, while retaining its still-valid old knowledge”. I think your setup is demonstrating something weaker.