- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Adaptive Low-Rank Model Editing (ALME) for few-shot continual cross-domain segmentation. The method decouples domain-specific knowledge acquisition from cross-domain knowledge accumulation. For each incoming domain, ALME independently adapts a pretrained segmentation foundation model using probe-guided low-rank adaptation. The acquired knowledge is then represented by layer-wise regression statistics, calibrated across domains, and integrated into a single model through pretrained-anchored regularized regression. Experiments are conducted on 13 sequential segmentation datasets using SAM3 under 1-shot, 5-shot, and 10-shot settings. The method achieves 76.81% mIoU in the 5-shot setting, outperforming the strongest non-rehearsal continual learning baseline by 4.92 percentage points.
Critical strengths
-
Comprehensive experimental evaluation. The paper provides relatively comprehensive experiments across 13 segmentation datasets covering diverse visual domains. Comparisons include several categories of continual learning methods, such as rehearsal-based, regularization-based, and parameter-efficient adaptation approaches. The evaluation also considers different shot settings, multiple performance metrics, ablation studies, and additional analyses of model merging strategies, domain order, and regularization. These experiments provide useful empirical evidence for the effectiveness of the proposed method.
-
A reasonably structured framework for knowledge accumulation. The proposed framework separates domain-specific knowledge acquisition from cross-domain knowledge integration, avoiding direct sequential updates to previously adapted model parameters. The use of adaptive low-rank updates and regression-based knowledge integration provides a coherent approach to accumulating knowledge from multiple domains. The framework also produces a single deployable model without requiring domain-specific adapters at inference.
Critical weaknesses
- Insufficient motivation and unclear significance of the proposed problem setting. The motivation for the proposed few-shot continual cross-domain segmentation setting is not sufficiently established. The paper essentially extends existing domain-incremental segmentation protocols, particularly SAMCL, by restricting each incoming domain to a few annotated samples. However, the authors do not convincingly explain why this particular combination of few-shot learning and continual domain adaptation is necessary or practically important.
More importantly, the paper does not clearly identify the unique challenges introduced by the few-shot constraint beyond the well-established catastrophic forgetting problem in continual learning. The motivation largely relies on general arguments regarding annotation costs and sequentially arriving domains, without sufficient empirical evidence or concrete application scenarios to establish the necessity of this specific setting. Consequently, the significance and practical value of the proposed problem formulation remain unclear.
- Questionable evaluation protocol involving ground-truth masks at test time. A more fundamental concern lies in the evaluation protocol. In Section 4.1, the authors explicitly state that three positive point prompts are sampled from the ground-truth masks during both adaptation and evaluation. This indicates that ground-truth information from test images is used to construct the prompts for inference.
Although ground-truth-derived prompts can be used in controlled evaluations of interactive segmentation models, their use is highly questionable in the context of the proposed few-shot continual adaptation setting. Such prompts provide oracle foreground locations that would not normally be available during real-world inference without additional annotation or user interaction. As a result, the reported performance does not directly reflect the model's ability to segment unseen images without oracle guidance.
The fact that the same prompting protocol is applied to all compared methods does not resolve this concern, as it affects the practical interpretation of the entire evaluation. The authors should clearly justify this assumption and provide evaluations using realistic inference-time prompts or a prompt-free protocol. Without such evidence, the practical significance of the reported improvements remains uncertain.
Questions for authors
-
Missing comparisons with cross-domain few-shot segmentation methods. Although the proposed setting involves few-shot adaptation across substantially different visual domains, the experimental comparisons focus almost exclusively on continual learning approaches. Relevant cross-domain few-shot segmentation (CD-FSS) methods are not included. While conventional CD-FSS methods may not directly support continual learning, comparisons under an appropriately adapted or clearly defined evaluation protocol would help establish the benefits of ALME over existing few-shot domain adaptation techniques.
-
Limited analysis of intermediate performance under different domain orders. The authors investigate domain-order sensitivity in Section 4.4 and Figure 2. However, the analysis mainly focuses on final performance after all domains have been incorporated. Given the additive and order-independent nature of the proposed knowledge integration, identical final results across different domain orders are largely expected by construction.
In continual learning, performance throughout the adaptation sequence is also important. It would be useful to examine how different domain orders affect intermediate-stage performance, particularly when domains with substantially different visual characteristics are introduced consecutively.
-
Insufficient analysis of computational and storage efficiency. The method involves an additional probing stage, domain-specific low-rank adaptation, extraction of regression statistics, and closed-form knowledge integration. Although the paper emphasizes compact knowledge accumulation and single-model deployment, the practical trade-offs associated with these additional operations are not sufficiently emphasized in the main evaluation. A more direct comparison of training costs, integration overhead, persistent storage, and inference efficiency against existing continual adaptation methods would strengthen the claimed practical advantages.
-
Limited clarification of domain shifts versus task differences. The 13 evaluated datasets involve not only different image distributions but also substantially different segmentation objectives, including medical lesions, camouflaged objects, shadows, and structural regions. The paper does not clearly distinguish whether its setting primarily addresses domain-incremental adaptation, task-incremental segmentation, or a mixture of the two. A more precise problem definition would help clarify the scope of the proposed method and the interpretation of the experimental results.