- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Representation-Conditioned Complementary Damped-Filter Regularization (R-CDFR), which uses complementary damped filters over the representation-Jacobian gain spectrum to allocate adversarial regularization across local directions, yielding consistent robustness gains without a hard directional partition. Extensive experiments show consistent robustness gains across datasets, training recipes, convolutional and transformer backbones, and analytic tasks with known directional geometry.
Critical strengths
- The paper consider a interesting research problem.
- The experimental study is broad, which is conducted on multiple scenarios.
- The paper provides both theoretical and empirical analysis to support the proposed method.
- The paper provides the ablation study to show the effectiveness of the proposed method.
Critical weaknesses
- Baseline comparisons are insufficient and lack competitive recent methods. The paper does not provide sufficiently comprehensive comparisons with recent competitive adversarial defense methods. The two most recent baselines included in the experiments are from 2024 and 2022, respectively, while stronger methods available on RobustBench are not adequately considered.
- The proposed method remains less competitive than the current state of the art. Although R-CDFR achieves the highest robust accuracy among the selected baselines, its performance still falls behind current state-of-the-art methods reported on RobustBench.
- The manuscript contains several formatting and presentation issues. Seemingly transparent text appears in multiple places throughout the paper. Additionally, the term "R-LipACR" appears in Figure 9 but is never introduced or explained in the main text.
- The font size in Figure 3 is too small, making the figure difficult to read.
Questions for authors
See weakness
2 comments
Thank you for the rebuttal. Some of my concerns have been addressed, and I will raise my score.
Thank you for recognizing our research problem, broad empirical study, and theoretical and ablation analyses. In our revision, we promoted a 200-epoch comparison with competitive baselines (including DHAT, ICCV 2025 [1]) into Sec. 6.6 (Table 4), standardized all labels and embedded PDF text, and expanded Figure 3 into a wide two-panel layout for readability.
Regarding the review summary, our paper proposes R-CDFR (Representation-Conditioned Complementary Damped-Filter Regularization), allocating regularization continuously over the representation Jacobian spectrum; ATFeaturePure and the vector field in the summary belong to a different submission. Below we address all four concerns for R-CDFR.
W1. Comparisons with recent competitive baselines
To establish performance alongside stronger recent recipes, Sec. 6.6 (Table 4) and App. F.1 (Table 13) evaluate controlled 200-epoch cosine runs across tuned TRADES, TRADES-AWP, TRADES-AWP + EMA/CutMix, and DHAT (ICCV 2025) [1]. All runs use WRN-34-10, no extra/synthetic data, validation selection on a held-out split, and raw-pixel AutoAttack at ℓ∞,ϵ=8/255 (App. B.4, Table 7). Within this protocol, DHAT retains its 4/255 feature-inverse generation and frozen natural ResNet-18 Grad-CAM mask, and we explicitly distinguish this matched adaptation from the original DHAT setup.
Table R10. Competitive 200-epoch WRN-34-10 recipes and paired R-CDFR additions (Sec. 6.6, Table 4; mean ± SD %).
Adding R-CDFR improves mean AA across all four recipes: +2.33/+2.74 pp on Tuned TRADES, +1.57/+1.87 pp on TRADES-AWP, and +1.29/+1.36 pp on EMA/CutMix (winning every paired seed), plus +0.49/+0.61 pp on DHAT (reaching 59.57% / 39.38% AA, with Clean shifts of −0.25/−0.22 pp). Table 4 and App. Table 13 report 95% paired Student-t intervals, which are positive on C100 DHAT ([0.12,1.10]) and span zero on C10 DHAT ([−0.07,1.05]).
[1] K. Zhang, J. Weng, S. Li, and Z. Luo. Towards Adversarial Robustness via Debiased High-Confidence Logit Alignment. ICCV, 2025, pp. 2783–2792.
W2. Contextualizing performance vs. RobustBench state of the art
Fixed-backbone results without extra data must be distinguished from top RobustBench entries using millions of synthetic diffusion images, larger backbones (WRN-70-16), and longer budgets. Our revision separates system operating points (57.43% / 36.98% AA for 50-ep WRN-34-10 in Table 1; 59.57% / 39.38% AA for 200-ep no-extra-data DHAT + R-CDFR in Sec. 6.6, Table 4) from the modular effect of Jacobian-spectrum filtering, grounded in Sec. 5 via our spectral-scale ambient bound (Cor. 5.2) and smoothness-free finite-step margin bound (Prop. 5.3). At 1.19× TRADES epoch time vs. 1.45× for TART (App. Table 8), R-CDFR is an efficient plug-in regularizer alongside clean-accuracy and compute trade-offs.
W3. Formatting, embedded text, and consistent naming
We removed the legacy R-LipACR title from App. Figure 9, standardized R-CDFR across all panels, legends, captions, and text, and audited the PDF via rendering and text extraction so no stray or low-opacity labels remain.
W4. Font size and readability of Figure 3
We replaced the narrow inline
wrapfigure(0.30\linewidth) with a wide two-panel Figure 3 in Sec. 6.4, enlarging all axis titles, ticks, and legends. Panel (a) shows the CDF of 1D decision-changing distances along normalized residual-filtered gradients, and Panel (b) pairs it with pass-filtered KL consistency across step sizes ϵP, distinguishing this directional probe from unrestricted adversarial distances.