- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes Test-Time Visual Subspace Steering (T-VSS), a test-time adversarial defense based on a low-rank visual feature subspace. It constructs a sample-specific subspace from anchor-relative residuals across augmented views and learns a shared low-rank feature correction through reliability-weighted entropy minimization, improving CLIP zero-shot classification robustness.
Critical strengths
S1. The manuscript is complete and clearly organized, with a coherent presentation of the motivation, method, and experimental evaluation.
S2. The experimental evaluation covers eight fine-grained classification benchmarks, ImageNet, and ImageNet out-of-distribution datasets. The paper also reports results across CLIP backbones, attack methods, and inference-efficiency settings, providing a relatively broad empirical assessment.
Critical weaknesses
W1. The rationale for using stochastic multi-view augmentation to construct the correction subspace could be more explicit. Although the paper includes view-budget comparisons and analyzes multi-view residual structure, it remains unclear why augmentation-induced feature variation is the most appropriate basis for the proposed steering operation, or how essential this particular construction is relative to alternatives.
W2. The relationship between the residual-SVD subspace and effective adversarial correction directions is not directly established. The low-rank residuals primarily describe relative feature variations induced by augmentation, rather than the clean–adversarial embedding displacement itself. Although the reported results support the empirical utility of the subspace, they do not show how much of a useful correction direction it actually captures.
Questions for authors
Q1. Could the authors clarify why stochastic data augmentation is needed to construct the visual subspace from an attacked input? What would be lost without augmentation, and could an alternative subspace construction provide comparable feature steering?
Q2. What is the practical interpretation of the anchor-relative residual matrix? Since it does not directly estimate the clean–adversarial feature displacement, could the authors quantify its relationship to the actual correction direction, for example by analyzing the projection of the clean–adversarial displacement onto the residual-SVD subspace?