- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper propose SAM with LQLR that combines slowly updated learned geometry with sharpness-aware minimization. The method use LLQR to learn a structed inverse metric and use it to construct anisotropic perturbations. Among various experiment settings, the results show improvements over SAM and various SAM variants.
Critical strengths
-
It is clear and reasonable to combine slowly updated geometry estimates with per-step sharpness-aware perturbations, reusing the same metric for perturbation and descent.
-
The experiments cover multiple architectures and settings. The method improves performance in several settings and can also be combined with variants such as F-SAM and ASAM.
Critical weaknesses
1.LLQR+SAM primarily combines the existing LLQR with SAM. The main adaptation is to construct anisotropic perturbation with LLQR metric and reuse it during the descent stage. However, beyond choosing LLQR as an metric estimator, I think this paper does not clearly establish a distinctive design specifically addressing localized sharp basins. Meanwhile, their are many existing algorithms such as FisherSAM discuss anisotropic geometry for the SAM perturbation. Thus, I think the contribution beyond the combination therefore remains insufficiently differentiated.
2.The ablation results do not sufficiently establish the need to apply the learned geometry to both perturbation and descent(Table16 and 19). The authors should clarify when this component helps and better establish the value of sharing geometry.
3.Evaluations on domain generalization, single-source domain generalization, or distribution-shift benchmarks would help clarify whether the method have better generalization ability under difficult generalization settings.
Minor: Some text in the figures is too small to read comfortably at normal viewing size.
Questions for authors
See weaknesses.
Thank you for the suggestions.
W1 — Novelty relative to FisherSAM. The question we study is the combination of coarse geometry learned on a slow timescale with per-step sharpness-aware optimization, rather than anisotropic probing alone. FisherSAM modifies the perturbation using a diagonal Fisher; LLQR provides a structured outer preconditioner and can also shape the probe. On TinyImageNet/ResNet-50, FisherSAM attains 71.69 ± 0.42%, near SAM's 71.63 ± 0.59%, versus 73.14 ± 0.26% for full LLQR+SAM. Adding LLQR outer preconditioning to FisherSAM improves CIFAR-100/ResNet-18 by 0.67 points [0.30, 1.02]; restricting LLQR to a diagonal metric reduces outer-only accuracy by 0.75 points [−1.08, −0.42]. The Fisher K-FAC comparison further shows that the improvement is not exclusive to LLQR (reply to eVJg). These findings distinguish the contribution of structured outer geometry from that of the probe.
W2 — Is a shared metric needed? No: outer-only already captures most of the benefit (general reply, Table 1). Full coupling changes the exploration geometry, but does not always help: on CIFAR-10-C, full trails outer-only by 0.68 points [−1.11, −0.24], and on TinyViT by 1.85 points (reply to eVJg). We will revise the manuscript to avoid presenting full coupling as necessary.
W3 — Generalization under distribution shift. We evaluated final checkpoints on CIFAR-10.1, CIFAR-10-C, and CIFAR-100-C, without tuning on shifted data (Tables E–F). LLQR+SAM improves over SAM on CIFAR-10.1 (+0.78 points [0.47, 1.09]) and on CIFAR-100-C on average (+0.47 [0.23, 0.72]), but not on CIFAR-10-C on average (−0.37 [−1.10, 0.36]). Results differ markedly by corruption: gains on blur and weather, losses on additive noise and pixelation. We will report both the improvements and this limitation without claiming uniform robustness or a verified causal explanation.
Table E. Shifted test sets, ResNet-18, final checkpoints, five seeds. Accuracy (%) ↑; differences are LLQR+SAM − SAM with 95% paired t-intervals.
CIFAR-C means average 15 corruptions over five severities. Clean entries are final-checkpoint accuracies, not the “best” scores used in the placement ablation and submission.
Table F. LLQR+SAM − SAM by corruption type (points), mean over five severities; five seeds, 95% paired t-intervals.
Minor. We will enlarge the figure labels.
References
Recht et al., Do CIFAR-10 Classifiers Generalize to CIFAR-10? CoRR abs/1806.00451 (2018)
Hendrycks and Dietterich, Benchmarking Neural Network Robustness to Common Corruptions and Perturbations (ICLR 2019)