Selective Backpropagation for Efficient Few-Shot Class-Incremental Learning

Excerpt

arXiv:2610.04003v1 Announce Type: cross Abstract: Few-Shot Class-Incremental Learning (FSCIL) requires models to continuously learn new classes from limited samples while retaining prior knowledge, under strict constraints on compute and memory. Existing approaches lie along a difficult trade-off: simple fine-tuning is computationally efficient but suffers from catastrophic forgetting, replay-based methods mitigate forgetting at the cost of substantial compute and memory, and exemplar-free metho