catastrophic forgetting

Loss of plasticity is different from catastrophic forgetting, which concerns poor performance on old examples even if they are not presented again, whereas loss of plasticity is about the inability adapt to to new tasks of the same difficulty.

In other words:
Maintaining stability is concerned with memorizing useful information.
Maintaining plasticity is concerned with finding new useful information when the data distribution changes.

Link to original

Todo

Overcoming catastrophic forgetting

References

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning