Localizing Catastrophic Forgetting in Neural Networks

Felix Wiewel, Bin Yang

Artificial neural networks (ANNs) suffer from catastrophic forgetting when trained on a sequence of tasks. While this phenomenon was studied in the past, there is only very limited recent research on this phenomenon. We propose a method for determining the contribution of individual parameters in an ANN to catastrophic forgetting. The method is used to analyze an ANNs response to three different continual learning scenarios.

Knowledge Graph

arrow_drop_up

Comments

Sign up or login to leave a comment