- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
SCoPE introduces camera control into video diffusion transformers by adding projected Plücker ray features to queries and keys after the pretrained RoPE. This produces content–geometry interactions and a geometry-only attention term. A Normalize-Gate-Inject mechanism handles variations in pose scale and feature magnitude. Experiments on Wan2.2 at 5B and 14B demonstrate improvements in camera controllability, visual quality, and closed-loop consistency.
Critical strengths
-
The additive formulation is simple and practical (Section 4). It introduces explicit ray–ray and content–ray interactions while preserving pretrained RoPE and avoiding an additional attention branch. This provides a useful alternative to multiplicative camera encodings.
-
The empirical evaluation covers two backbone scales and complementary aspects of generation, including camera accuracy, visual quality, dynamic scenes, and closed-loop revisits (Tables 1–3). The substantial reported improvements across these settings support the practical value of the method.
Critical weaknesses
-
The conceptual advance is moderate, and the geometric interpretation has a limited scope. The reciprocal-product equivalence holds for a particular raw-ray configuration, while the practical encoding includes unconstrained projections, normalization, and gating. The flip is also an equivalent reparameterization, as acknowledged by the authors. Thus, the theoretical connection does not establish that the learned attention implements the corresponding geometric compatibility test.
-
Some experimental details remain insufficiently specified. The cross-term ablation needs clarification because retaining zero initialization for both geometry branches could prevent the remaining ray–ray term from learning (Table 4 and Appendix G.4). Additionally, the trainable backbone components and optimization budgets should be documented for each baseline to substantiate the controlled comparison.
Questions for authors
-
How was the “w/o (B)+(C)” ablation initialized and trained? If both geometry outputs start at zero, their remaining bilinear interaction gives zero gradients to both branches. Was initialization changed, a trained checkpoint used, or the intervention applied only at evaluation?
-
Could you provide the trainable backbone components, total trainable parameter counts, and training budgets for each baseline? In particular, were backbone fine-tuning settings matched to SCoPE?
4 comments
Dear Reviewer,
Thank you again for your valuable feedback. We have clarified the initialization of the ablation experiments and provided additional details on baseline training configurations and comparisons. We would sincerely appreciate your thoughts on our responses and are happy to address any remaining questions.
Thank you for your time and consideration.
Comments by Reviewer xwME
Thank you for the clarifications and additional experiments. The initialization explanation addresses my concern about the ray–ray-only ablation, and the controlled fine-tuning results substantially alleviate the concern about baseline fairness. I also appreciate the more precise scope of the geometric interpretation. I maintain my weak-accept recommendation.
Thank you very much for your positive feedback and for taking the time to review our additional experiments and clarifications. We sincerely appreciate your recognition of our rebuttal efforts and your continued support.
We will incorporate these clarifications and experimental details into the revised manuscript. Thank you again for your thoughtful review and consideration!
We thank the reviewer for recognizing the practical value of SCoPE's additive attention design and its improvements at both scales and on closed-loop revisits. We address the initialization concern, baseline training fairness, and the scope of the geometric interpretation below.
Q1. Initialization of w/o (B)+(C)
This was a separately trained ablation, with (B) and (C) removed throughout training rather than only at evaluation. Both Q/K geometry projections were initialized with small nonzero Gaussian weights (mean 0, std 0.01), with the geometry scaling factor initialized to α=1. This differs from the full-model initialization because, after removing the content–geometry cross terms, (D) is the only remaining geometry-dependent term.
Specifically, the retained ray–ray term (D) is a dot product between the Q- and K-side geometry features. Its gradient with respect to either feature equals the feature from the opposite branch. If both geometry outputs are zero, gradients to both projections vanish. With small nonzero initialization and an active geometry scale, both projections can receive gradients from the first training step, avoiding this deadlock. Thus, the ablation evaluates a trainable ray–ray-only interaction rather than a degenerate geometry branch. We will clarify this initialization exception in Appendix G.4.
Q2. Baseline training budgets and finetuning fairness
The comparisons in Tables 1–3 span 5B and 14B. Within each scale, methods use the same pretrained backbone and matched training/evaluation protocols. For Wan2.2-I2V-A14B, all methods use the same four-dataset mixture, 30k optimization steps, and 81-frame, 480 × 832 first-frame I2V setting. Only the high-noise expert is finetuned for every 14B method; the low-noise expert remains frozen. The exact trainable modules and parameter counts are listed in Table R3 of our response to Reviewer k9tv. Importantly, the optimization budget is matched, but the methods' default trainable scopes differ.
To test whether SCoPE benefits merely from updating more backbone parameters, we conducted additional 14B controls in both directions: (i) expand UCPE and ReRoPE to train backbone self-attention, FFN, and norm3, and (ii) restrict SCoPE to backbone Q/K projections plus its geometry modules. All variants use the same 30k-step budget.
Table R6. Controlled finetuning comparisons (Wan2.2-I2V-A14B).
Expanding baseline finetuning yields only marginal camera-accuracy gains, while FVD worsens (UCPE: 529.42 → 577.30; ReRoPE: 493.30 → 527.58). Conversely, SCoPE with Q/K-only backbone finetuning retains nearly the same RotErr (0.062 vs. 0.058) and achieves better FVD (261.54 vs. 280.17) than full SCoPE. Moreover, PRoPE already trains more parameters than SCoPE (10.908B vs. 10.148B for the high-noise expert), yet achieves weaker RotErr (0.097 vs. 0.058) and FVD (472.11 vs. 280.17). These 14B controls indicate that the gains cannot be explained simply by differences in backbone finetuning scope. We will document the configurations and controls in the revision.
W1. Geometric interpretation
We agree with the reviewer that the Plücker reciprocal-product identity describes the canonical raw-ray pairing, not an exact compatibility test enforced by learned attention. After learned projections, normalization, and gating, (D) is a general geometry-conditioned bilinear interaction. The Q/K flip can be absorbed into an unconstrained key projection, so it does not add expressivity; its role is to motivate the canonical coordinate ordering.
The substantive distinction is in the attention-score structure. With only (A)+(D), the appearance and ray contributions are additive and separable: A(xi,xj)+D(ri,rj). Terms (B) and (C) instead couple visual features and camera rays, allowing geometry-dependent attention to vary with token content. This preserves pretrained RoPE and requires no parallel attention branch. The 5B ablations in Table 4 support the usefulness of both interactions: removing (B)+(C) changes RotErr/FVD from 0.085/543.17 to 0.135/695.41, while removing (D) changes them to 0.159/733.08. We will distinguish this empirical benefit from the narrower canonical geometric identity in the revision.