- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes Continuous Search Allocation (CSA) for black-box video attacks. It derives a continuous coordinate-wise allocation from the input before any victim query and applies it jointly to zeroth-order probing and perturbation updates. CSA uses codec motion-vector magnitudes through the Change Magnitude Feature (CMF), and evaluate it with NES and SPSA across multiple video recognition models. It has lower query cost than matched uniform controls and competitive performance against prior video attacks.
Critical strengths
-
CMF derives its allocation directly from codec motion vectors before the first victim query, without requiring additional model inference or surrogate access.
-
The experimental section is thorough: the authors use matched controls, paired statistics, two ZO optimizers, multiple victim architectures, a probe/update factorial, i.i.d.probe interventions, and perturbation-budget sweeps to isolate the source and limits of the observed query reduction. Across the main matched comparisons, CSA consistently lowers CANQ, and the additional ablations make the empirical effect substantially more convincing.
Critical weaknesses
-
The paper is written in an overly defensive and fragmented way: factorial results, matched controls, permutation studies, and other caveats appear before the central motivation and contribution are made sufficiently clear, which makes the paper unnecessarily difficult to follow. After separating the framing from the actual method, the main novelty seems to be the specific combination of "input-derived, pre-query, continuous coordinate-wise allocation with shared probe/update weighting", instantiated using codec motion information; I find this contribution relatively small, and its scope is not clearly delineated.
-
The paper explains in detail how CMF is used, but not convincingly why CMF should produce the right allocation "W", or why this particular signal is necessary. Motion magnitude captures where pixels move, not necessarily where the victim model is sensitive or where perturbations are most valuable. For example, for a person sitting on a moving train, the face may be task-relevant but nearly static, while the rapidly changing background may receive much larger CMF weights. This concern is reinforced by the paper’s own spatial-permutation result, where rearranging CMF weights within each frame preserves almost the same query saving, suggesting that the gain may come from generic heterogeneity/concentration of "W" rather than from motion-specific relevance; stronger comparisons against other query-free or synthetic allocations with matched concentration are therefore needed.
Questions for authors
-
How broadly does CSA generalize beyond NES and SPSA? Both are classical finite-difference estimators, so results on a structurally different black-box attack would materially affect the contribution.
-
How should the query-efficiency claim be interpreted under different distortion criteria? The advantage under norm are not conclusive.