- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how time-series foundation models continually adapt to new domains in classification tasks. In this setting, new domains have limited labels, and the domain identity is unknown during inference. The model must adapt to new domains without losing accuracy on old ones. To solve this, the authors propose PACT. PACT splits the frozen feature space into several local regions. For each new domain, it learns a region-specific, low-rank residual transformation. It then uses a gating mechanism with an identity branch to combine transformations from different domains. The authors test PACT on five datasets and eight backbone models. Across all five datasets, PACT beats the baselines in final average Macro-F1 and maintains low forgetting.
Critical strengths
-
The research problem has practical value. The paper focuses on how time-series foundation models adapt and avoid forgetting when new domains continually arrive and old domains may reappear. It also considers real-world limits where new domains have few labels and the domain identity is unknown during inference. Compared to traditional one-time domain adaptation, this setup better fits the needs of long-term model deployment.
-
The method is well-motivated and clearly structured. The authors observe that domain shift affects different feature regions to different degrees, and based on this, they introduce local low-rank residual transformations. They also freeze past transformations and learn soft routing to balance adapting to new domains and retaining old ones. Furthermore, an explicit identity branch makes it structurally possible to keep the original predictions, making the overall design reasonable.
Critical weaknesses
- The core novelty over existing modular continual learning methods (e.g., S-Prompts, SEMA) is limited. PACT mainly differs by using a fixed local partition with region-specific residual updates, but it does not clearly separate the gains of local geometric modeling from increased model capacity.
- The theoretical claim for low-rank transformations needs more care. In Figure 7, rank-8 matches or beats full-rank updates, but since the frozen linear head has at most 6 classes, rank-8 can already express any linear logit update. Thus, this result shows parameter efficiency rather than an intrinsic low-dimensional structure of local domain shifts.
Questions for authors
- Compared to existing domain-specific modular methods like S-Prompts and SEMA, what unique capabilities does PACT's fixed local partition provide? Given that local region count and model capacity increase together in Figure 3(b), can the authors separate the gains of local partitioning from those of added model capacity?
- Since the gating network is trained only with domain labels, how does it decide whether a specific sample needs correction? Can the authors analyze how predictions change after adaptation for originally correct versus incorrect samples, along with their identity branch weights, to verify this selective protection?
- Since the frozen classification head outputs at most 6 classes, how do the authors interpret the comparison between rank-8 and full-rank updates? To what extent does this result truly support the claim that local feature shifts have an intrinsic low-dimensional structure?
- What class sampling strategy is used for the calibration samples? Can PACT maintain performance when some classes in the new domain have no labels at all or suffer from severe class imbalance?
3 comments
Response to Reviewer mUHi 2/2
Q4. What happens when calibration labels are imbalanced or missing?
Our original experiments used class-stratified calibration sets shared by all labeled methods. We kept the label set identical across all baselines for comparison. We kept the total label budget fixed and varied which classes received labels.
| Calibration setting | Metric | Domain orders | FD | UCI-HAR |
|---|---|---|---|---|
| Class-stratified | AMF1 | 4 | 0.9575 | 0.7864 |
| 85% of labels from one class | AMF1 | 4 | 0.8667 | 0.7726 |
| Class 0 omitted | Class 0 recall | 4 | 0.995 | 0.154 |
| Class 1 omitted | Class 1 recall | 1 | 0.138 | 0.016 |
Imbalance reduced overall AMF1 by 9.08 points on FD and 1.38 points on UCI-HAR. Missing labels had a class-specific effect. On FD, PACT still recognized 99.5% of class-0 examples when that class was omitted, averaged over four orders. On UCI-HAR, recall was low for every omitted class tested, ranging from 1.6% to 15.4%. Only the class-0 omission was repeated across all four orders.
PACT learns corrections by region and condition. An omitted class can therefore receive a correction learned from labeled examples of other classes in the same region. The FD result shows that a class can remain recognizable without new labels, while the UCI-HAR results show why reliable recall cannot be assumed.
In the revised version, we will discuss this behavior more explicitly.
Follow-up on our response
Dear Reviewer mUHi,
Thank you again for the time and care you have put into reviewing our work. Your questions helped us strengthen the controls for state matching, examine potential side effects, and clarify how the offline training objective relates to next-step routing.
As the discussion period draws to a close, we would be very grateful if you could share your thoughts on our responses and the revised manuscript. If any concerns remain, we would welcome the opportunity to address them. We sincerely appreciate your time and your help in improving the paper.
Response to Reviewer mUHi 1/2
Thank you for the time and care you put into evaluating PACT. We especially appreciate your question about whether the gains come from the placement of the local charts or from the additional parameters. It motivated the equal-capacity comparison we report below. Your observation about the frozen classifier also helped us interpret the rank ablation more precisely.
Weakness 1 / Q1. Does local geometry contribute beyond modular capacity?
S-Prompts uses domain-specific prompts, and SEMA adds adapters inside the backbone. PACT operates on the final embedding and indexes each correction by both source region and arriving condition. The encoder, original classifier, and earlier corrections stay frozen as new corrections are learned. Our comparison with SEMA is architectural.
We held the number of transports and gates fixed within each comparison and replaced source k-means with bins from a fixed random projection and source quantiles. The table gives AMF1 averaged over four streams.
K-means scored higher in all 20 stream-by-configuration pairs. These are five configurations on four datasets, with the UCI-HAR streams evaluated twice. The differences range from approximately 3.1 to 7.0 points. At K=4 on UCI-HAR, the random partition had no masked cells.
Q2. Does a domain-trained gate identify incorrect predictions?
The gate is supervised by preserved chart information of previous increments combined with the new incoming calibration labels. We measured preservation and correction separately on one FD order, C→B→A→D.
a. Among initially correct source predictions, 890/891 were preserved.
b. Among initially incorrect target predictions, 889/1,042 (85.3%) became correct.
c. Among initially correct target predictions, 10/1,661 (0.60%) became incorrect.
The median identity weight was approximately zero both for target examples that stayed correct and for those that became incorrect. The observed behavior supports successful target correction and source retention on this stream. On source examples, median identity weight was 1.0 among the 890 preserved correct predictions and 0.894 for the one damaged prediction. The target medians pool three conditions. They support a distinction between source and target routing here and do not establish that the gate detects its own errors.
On HHAR, the median source identity weight was 1.00 for preserved correct predictions and 0.06 for correct predictions that changed to wrong. On UCI-HAR, the corresponding medians were 0.996 and 0.03. Thus, lower identity weight was associated with damaged source predictions on both activity datasets. The association alone cannot isolate the contributions of incorrect routing, transport size and initial classification margin.
Weakness 2 / Q3. What does rank 8 establish?
We thank the reviewer for the careful evaluation and agree that the frozen head limits what this ablation can tell us. Our tasks have at most six classes, so the prediction depends on at most five independent logit differences. A shift can affect many embedding dimensions while changing only these few quantities at the classifier. In our experiments, rank-8 transports achieved similar AMF1 to full-rank transports with fewer trainable parameters. We will revise Sec. 4.3 to report this as evidence of parameter efficiency and remove the claim that the underlying feature shifts are intrinsically low-dimensional.