acceptodds
Under review as a conference paper at ICLR 2027

DualTrack: Accessible Knowledge Transfer for Continual Learning under Long-Tailed Distributions

Abstract

Long-tailed continual learning requires models to acquire new classes from imbalanced task streams while retaining previously observed classes without replaying historical images. The challenge extends beyond catastrophic forgetting: few-shot classes provide unreliable representation estimates, and added experts can make historical knowledge inaccessible even when their parameters remain unchanged. We present DualTrack, a framework that couples stable coordinates, statistical routing, protected adaptation, and tail-class transfer. A frozen ViT-B/16 backbone is augmented with early shared orthogonal LoRA modules and late general/specific LoRA branches. An independent routing stream maintains class-conditional diagonal Gaussian statistics to decide whether a new class should reuse an existing expert or receive additional capacity. When an expert absorbs a class, rank expansion preserves its initial function, freezes the old rank prefix, and trains only newly allocated directions; historical gradient-direction projection further restricts updates to directions compatible with prior adaptation. Finally, image-free class prototypes are transferred to tail classes using visual similarity, cross-layer route overlap, and a count-adaptive shrinkage coefficient. We evaluate on long-tailed continual-learning benchmarks and compare DualTrack with replay, regularization, prompt, expandable-expert, and prototype-based baselines under matched ViT backbones.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.