From Order to Distribution: An Exact Operator Framework for Forgetting in Continual Learning

Excerpt

arXiv:2604.13460v2 Announce Type: replace Abstract: A central challenge in continual learning is forgetting: the loss of performance on previously learned tasks after learning new ones. Prior theory has analyzed forgetting under random orderings of fixed task collections in overparameterized linear regression. We shift the focus from task order to task distribution, asking how its structure determines forgetting. In the linear setting with a shared solution, i.i.d. task sampling, and sequential