catastrophic forgetting

In other words:
Maintaining stability is concerned with memorizing useful information.
Maintaining plasticity is concerned with finding new useful information when the data distribution changes.

Link to original

Todo

Overcoming catastrophic forgetting

References

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning