- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Progressive Trust Calibration (PTC) to address noisy-label continual learning, where label corruption and task distribution shifts interact over time. PTC initializes sample trust using neighborhood label consistency and local feature compactness in a frozen pretrained representation space. It then refines trust through global semantic verification using class prototypes. Finally, a task-specific expert dynamically reassesses suspicious samples and corrects their labels to recover useful supervision. Experiments on Split CIFAR-10, Split CIFAR-100, and CUB-200, together with ablation studies, theoretical analysis, and efficiency evaluations, support the effectiveness of the proposed method.
Critical strengths
The motivation is clearly stated and the method design is reasonable. The paper identifies the limitation that static noise filtering tends to mistakenly discard informative samples. By combining local neighborhood relations, global class prototypes and expert predictions, it develops a progressive trust calibration framework with desirable complementarity and interpretability.
Critical weaknesses
(1) The theoretical analysis lacks rigor. Some results in Appendix B rely on strong assumptions. The prototype consistency bound in Theorem B.8 and the sample recovery and convergence results in Theorems B.13–B.14 involve derivations that require further clarification. The authors should clearly state the assumptions and provide more rigorous proofs.
(2) The experimental evaluation is not comprehensive enough. Experiments with different noise rates are mainly conducted on Split-CIFAR-10, while similar evaluations on Split-CIFAR-100 and CUB-200 are missing. In addition, the paper does not provide a hyperparameter sensitivity analysis, leaving the effects of key parameters on performance and stability unclear. These limitations make it difficult to fully assess the robustness and generalization ability of the proposed method.
Questions for authors
(1) In Theorem B.8, the empirical prototypes are normalized, whereas the population class centers are defined as the expected features. Could the authors further explain why the consistency bound holds? In addition, do the relabeling error rate and convergence results in Theorems B.13–B.14 require additional assumptions, particularly regarding the conditional error on recovered samples and the stopping conditions?
(2) Equation (11) in the main text includes only the cross-entropy loss, whereas the expert training objective in Appendices C.3 and C.4 also includes a distillation term. Could the authors clarify the complete training objective used in practice, including the distillation weight and the definitions of the old and new feature representations? In addition, could the authors provide the complete optimization objective for the classifier alignment stage to improve reproducibility?
(3) Experiments with different noise rates are only conducted on Split-CIFAR-10. Could the authors supplement corresponding experiments on Split-CIFAR-100 and CUB-200? Also, how are the key hyperparameters selected?
Response 5-7: NCM controls, learner comparisons, and robustness
Q5: Frozen-feature NCM and the source of robustness.
A5: We agree that a strong frozen representation should be evaluated independently of classifier training. We therefore compare NCM using the original noisy supervision with NCM using PTC-curated samples and labels on CUB-200 at 40% label noise. Both use the same frozen ViT features and NCM decision rule. The NCM classification stage trains no parametric head and performs no Gaussian alignment.
SD denotes the sample standard deviation over three seeds. Gains and summary statistics are calculated before rounding. PTC improves NCM by more than 14 points in every seed. This isolates a substantial benefit from curated supervision while holding the representation and classification rule fixed; the improvement cannot be attributed solely to the pretrained features or additional classifier training. It also supports using PTC as a curation module for a simple prototype classifier. Here, training-free refers to NCM classification; obtaining PTC-curated supervision may still require expert training. The curated condition uses PTC's output, not oracle clean labels.
Q6: No Defense and the comparison with CL-LoRA.
A6: No Defense retains PTC's downstream learner, including expert training, relation regularization, classifier alignment, and the per-task training budget. It disables sample filtering and recovery and trains directly on the original noisy supervision. Expert training itself remains active. No Defense and PTC therefore form a within-learner control, whereas No Defense and CL-LoRA are different learners.
The 64.25% No Defense Avg in Fig. 3(a) is from one representative run; CL-LoRA's 77.62% Avg in Table 1 is a three-seed mean. Their 13.37-point difference is not PTC's defense gain and is not a matched single-seed comparison. The additional seed-1 controls in Answer 1 clarify the learner's behavior: without PTC, the aligned learner achieves 89.68% on clean data but 64.25% under 40% corruption; removing alignment raises the latter to 75.39%. Thus, the ablation identifies alignment as a source of vulnerability under uncurated noisy supervision, rather than attributing the original cross-method gap solely from aggregate scores.
The contribution of PTC also persists without that vulnerable component: under attack it raises Avg from 75.39% to 80.41% without alignment (+5.02 points), while the corresponding gain with alignment is 64.25% to 84.40% (+20.15 points). The new factorial control therefore separates PTC's curation benefit from the effect of Gaussian alignment. Separately, the original same-run comparison in Fig. 3(a) gives a 19.42-point Avg gain from Stages I-II (64.25% to 83.67%), and Table 2 gives Stage III gains of 2.00 Final points and 1.36 Avg points over three seeds. We have distinguished these experimental scopes and aggregation levels in the revised manuscript.
Q7: Noise-rate coverage and real-world noise.
A7: We supplement the CIFAR-100 and CUB-200 evaluation with clean training and 20% noise results. The table reports final accuracy (%) as mean ± sample SD over three runs; its 40% entries are the Attack II results already reported in Table 1.
These results extend the noise-rate evaluation beyond CIFAR-10. The complementary CIFAR-10N experiment and task-dependent cross-task contamination statistics are presented in Answer 3, where we also discuss their scope relative to a targeted coherent-subcluster attack.
We thank the reviewer again for identifying these issues. The additional NCM control, clearer inference specification, and explicit separation of learner components help us present the contribution and scope of PTC more precisely. We appreciate the opportunity to strengthen the experimental evidence and reproducibility.