Neuromorphic Symposium: Bayesian Continual Learning and Forgetting in Neural Networks (15 minutes)
Talk, Neuromorphic Symposium, Paris, France
When neural networks are deployed in the real world, data does not stay stationary. Environments evolve, tasks change, and distributions drift. Standard neural networks suffer from catastrophic forgetting: when learning something new, they overwrite what they learned before. But there is a second, often ignored challenge: catastrophic remembering, when networks become too rigid, stop adapting, and lose their ability to fit new data, leading to overconfident predictions.
