- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies how noisy pretraining affects downstream transfer with frozen visual backbones. It characterizes feature changes using a normalized discriminative spectrum, its Jensen–Shannon divergence from a clean reference, and its spectral centroid. The proposed Self-Guided Spectral Adaptation (SGSA) adds a residual bottleneck adapter and regularizes its features using a spectral prior constructed from PCA-direction stability, augmentation consistency, and positional decay. Alignment, leakage, and feature-preservation losses are intended to mitigate inherited representation damage without requiring a clean checkpoint for adaptation. Experiments use ImageNet-1K- and YFCC15M-pretrained ResNet-50 backbones on Office31 and Office-Home, with adapter-only and component comparisons.
Critical strengths
-
The paper addresses a meaningful downstream constraint. Users often inherit pretrained checkpoints without access to clean pretraining data or the resources to retrain the backbone. An adaptation procedure that operates with a frozen backbone and does not require a clean reference would be useful in this setting. Separating feature variance from task-relevant discrimination is a reasonable motivation for studying which directions to preserve.
-
The experimental design includes initial controls for the adapter's contribution. The adapter-only baseline and component comparisons attempt to separate spectral regularization from the benefit of adding trainable parameters. These are relevant tests of the proposed approach, although the reporting problems below currently limit the conclusions that can be drawn from them.
Critical weaknesses
-
The central discriminative spectrum is not operationally defined. Section 2.3, Eq. (2), normalizes direction-wise strengths as , but the supplied manuscript does not specify how is computed. This is consequential for both the diagnostic and the algorithm: Eq. (15) uses the batch-dependent spectrum as a training objective. Different definitions of discriminability would produce different spectra, gradients, and interpretations of drift. Without the exact statistic, label dependence, handling of missing classes or zero denominators, and differentiation procedure, the central results cannot be reproduced or assessed for correctness.
-
The baseline results and experimental protocol do not support a coherent assessment of effectiveness. Table 1 reports clean-pretraining baseline accuracies of 57.21 and 47.01 for Office31 and Office-Home; Table 2 reports 74.6 and 33.3. At 30% noise, the corresponding pairs are 50.54 versus 63.0 and 42.89 versus 28.9. Table 1 explicitly averages over both backbone families, whereas Table 2 does not clearly identify a changed protocol. Table 4 is also described as averaging over both families and noise levels, but its baseline means match Table 2. Different settings could explain these discrepancies, but the manuscript needs to identify them to connect the diagnostic findings with the mitigation results. The lack of per-backbone/task results, clear label-access and split definitions, and repeated-run uncertainty further prevents assessing the roughly 0.5–0.6 percentage-point gains over NML in several Office-Home settings.
Questions for authors
-
Clarification essential to assessing the method: What is the exact formula and executable procedure for and ? Please specify the labels used, normalization and numerical stabilization, handling of batches with absent classes, and how gradients through the spectrum are computed.
-
Clarification essential to assessing the results: What protocol or aggregation difference explains the baseline discrepancies between Tables 1, 2, and 4? Please provide the corresponding per-backbone and per-transfer-task results, with the label-access protocol, train/validation/test splits, and run counts clearly identified.
-
Clarification of the reported comparative gains: What paired repeated-run uncertainty supports the small Office-Home improvements over NML, and were SGSA and the compared methods evaluated with matched data access and tuning budgets?
These questions concern the definition and validity of the reported work, rather than a request for a separate future benchmark study. Complete answers could materially change my recommendation.