I think our experiments actually don't show catastrophic forgetting! The accuracy does not decrease as loss gets worse -- it's simply getting over-confident.
So I'm not even sure we're showing any problem to solve here -- it might be more of a opportunity, in fact!
So I'm not even sure we're showing any problem to solve here -- it might be more of a opportunity, in fact!