- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work studies targeted white-box attacks on expressive human pose and shape estimation (EHPS). Given a clean image and a fixed estimator, CtrlRecon builds an image-specific target by substituting requested pose, hand, or expression blocks with prescribed values while keeping the remaining blocks at their clean predictions. It then optimizes a representation-aware objective that combines rotation matching, a hand-specific loss designed around non-unique 6D rotation outputs, expression matching, and camera preservation. Optimization proceeds in two stages: bounded continuous search followed by discrete 8-bit refinement, with final attacks evaluated after PNG export and reload.
Critical strengths
<1>Steering a reconstructed avatar toward a chosen pose, gesture, or facial expression is more security-relevant than merely inflating reconstruction error. Separating requested changes from preservation targets gives the attack a concrete definition, and the controlled white-box experiments show that such selective manipulation is feasible.
<2>Multiple raw 6D outputs can decode to the same rotation, and near-degenerate outputs can be fragile under perturbation. The appendix supplies propositions on when the hand loss reaches zero and on local conditioning of the Gram–Schmidt denominators. Evaluating exported and reloaded 8-bit images is also a sensible practical choice. Geometric metrics, joint-success measurements, and multi-view visual comparisons each capture a different aspect of the attack.
Critical weaknesses
<1>The classical baselines use a plain unweighted L2 distance over raw parameters, include shape in that distance, and lack matrix-level rotation, decoded-geometry, and positive-preimage terms; CtrlRecon excludes shape. Their update counts are matched only to accepted continuous steps, whereas CtrlRecon also uses line-search evaluations, curvature VJPs, and discrete refinement. The ablations remove entire articulation terms but do not isolate the hand loss from a decoded-rotation loss, or integer refinement from continuous optimization followed by the same quantizer. It therefore remains unclear how much of the improvement comes from the distinctive design rather than from objective scaling and extra optimization.
<2>Table 10 allows per-joint rotation errors up to 90° for Body and 50° for Hand, applies these tolerances to active and inactive rotations alike, and permits camera deviations of 0.30 m and 0.20 m. Shape is excluded from the success criterion, and clean inputs that already satisfy the target are counted in the denominator without a separately reported clean success rate. The VLM evaluation ignores inactive components and forces a winner even when no candidate matches the target. The high ASR and 60.10% vote share therefore do not by themselves establish accurate control with strong preservation.
Questions for authors
<1>Does CtrlRecon keep its advantage when PGD and C&W are given the same representation-aware objective, identical targets and preservation terms, and matched forward/backward computation? Please report actual computation and wall-clock time, including curvature construction and integer refinement.
<2>How do the results change under stricter rotation and camera tolerances? Please separate active-target errors from changes to inactive components, and report the clean-input success rate, so that target attainment and preservation can be assessed independently.
<3>Can the authors compare the hand loss against a decoded-rotation loss and a variant without the positive-pivot margin, while holding the optimizer fixed? Likewise, what is the incremental benefit of integer refinement over continuous optimization followed by the same feasible quantization?
5 comments
Follow-up on our response
Dear Reviewer t8Ew,
We have completed the matched-runtime experiments mentioned in our previous response. As reported in the newly added Appendix D.5 (Figure 6 and Table 18), CtrlRecon achieves joint ASRs of 98.2%, 93.4%, and 99.4% on Body, Right-hand, and Face, respectively, outperforming the strongest baseline by 7.4, 0.8, and 2.8 percentage points under the original success criteria.
As the discussion period draws to a close, we thank you once again for your detailed review and constructive suggestions. Your comments on computational fairness, target attainment, preservation, and visual evaluation have helped us substantially strengthen the experimental analysis in the revised manuscript (highlighted in blue). For your convenience, here is a summary of the key revisions:
-
W1/Q1Baseline fairness and computational cost: Evaluated baselines using CtrlRecon's objective and completed matched-runtime comparisons (Appendices D.4–D.5). -
W2/Q2Target accuracy, preservation, and VLM evaluation: Added stricter success criteria, clean-input analysis, and separate evaluations for target attainment and preservation (Appendices D.2 and D.7), while also clarifying the VLM voting protocol and reporting valid-response coverage (Appendices C.6, D.3, and D.8). -
W1/Q3Loss design and integer refinement: Added controlled comparisons between our proposed hand loss and standard rotation loss, analyzed the positive-pivot margin, and isolated the contribution of integer refinement (Section 5.4).
We sincerely appreciate your time and thoughtful feedback.
Follow-up before the discussion closes
Dear Reviewer t8Ew,
As the discussion period approaches its conclusion, we would like to thank you once again for your thoughtful review. We hope our response and the summary above have addressed your questions. In light of these results, we would greatly appreciate it if you could take another look and consider raising your score. Please let us know if any further clarification would be helpful.
Best regards,
The Authors
Response to reviewer t8Ew
We thank the reviewer for the detailed feedback. Additional experiments and clarifications are highlighted in blue (Section 5 and Appendices C–D).
W1/Q1: Baseline fairness and computational cost.
W2/Q2: Control accuracy, preservation, and VLM evaluation.
W1/Q3: Loss design and integer refinement.