- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CausalAlign, a framework for improving camera ego-motion consistency in video generation models. The authors analyze internal ego-motion representations using linear probing and causal interventions, and identify a rise-and-fall pattern during denoising, termed geometric state forgetting. Based on this observation, CausalAlign aligns VGM representations with a delta-token space learned from a 3D foundation model at causally selected layer–timestep locations. Experiments on Wan2.2-14B show improved camera motion, geometric consistency, and temporal dynamics while largely preserving visual quality, with additional gains on downstream RoboCasa365 tasks.
Critical strengths
-
The paper provides a systematic analysis of ego-motion representations inside VGMs rather than relying only on geometry metrics of generated videos. By combining linear probing with causal intervention, it distinguishes whether ego-motion information is decodable from hidden states from whether it actually influences the generation process, and further identifies the geometric state forgetting phenomenon.
-
The method is well motivated by the preceding analysis. Instead of aligning 3D features at arbitrarily chosen layers, CausalAlign targets locations where ego-motion information begins to decline, and uses delta tokens to emphasize inter-frame motion and geometric changes rather than static scene content.
-
The experiments provide fairly comprehensive evidence for the method. CausalAlign improves camera-motion consistency, geometric consistency, and temporal dynamics while largely maintaining visual quality. Its transfer to Fast-WAM also suggests that improving geometric representations in the VGM can benefit downstream robot-control tasks.
Critical weaknesses
- The ablations do not fully disentangle the contributions of the different components in the complete training recipe. Although the paper includes a matched layer-placement study on the 14B model, it would be useful to further compare against all-layer LoRA fine-tuning under a matched budget, delta-token alignment without the explicit pose loss, and random or uniformly selected layer–timestep locations using the same losses. Such controls would clarify how much of the gain comes from causal target selection, delta-token representation, and pose supervision, respectively.
Questions for authors
- The main analysis of geometric state forgetting is conducted on Wan2.2-14B. Have the authors repeated the causal diagnosis on other model backbones or model scales and observed a similar rise-and-fall pattern? This would help establish whether the phenomenon is general across video generation models and strengthen the claimed generality of the method.
3 comments
Thank you for your detailed response and additional experiments. I believe the rebuttal has effectively addressed my concerns. Therefore, I am happy to maintain my original positive rating.
Thank you for considering the new results and for sharing your positive assessment of the revised work.
Official Comment to Reviewer UpPY from Authors
Thank you for your careful review. We now respond to your questions as follows.
W1 (part 1). Additional ablation study on losses and token structure.
The short conclusion is that combining pose supervision and delta matching achieves the best results, and structured delta tokens performs best among the tested alignment targets. As requested by the reviewer, we compare the full objective with pose-only and delta-only training under the same settings. In Table 10, combining delta matching loss and pose supervision loss improves all five metrics(e.g.,reducing reprojection error from 6.9 to 6.5). Furthermore, We also change the alignment target while keeping pose supervision fixed. In Table 11, structured delta tokens yield lower geometric errors and jerk than unpartitioned 128D alternatives. These results show that delta matching loss adds value beyond pose supervision and that structuring the tokens improves the effectiveness of alignment.
W1 (part 2). Additional ablation study on diagnosed layers.
The short conclusion is that diagnosed layers achieve the lowest geometric errors among all tested layer sets. As requested by the reviewer, we compare them with random, evenly spaced, and all-layer selections while holding the timesteps, temporal weights, and losses fixed. For the all-layer control, we reduce the per-layer LoRA rank to keep the total number of trainable adapter parameters comparable. In Table 13, joint selection for diagnosed layers outperforms all other sets (e.g., reprojection error compared with all-layer LoRA, 6.5 px vs. 8.9 px). This comparison supports our design of using causal diagnosis to choose which layers to adapt.
W1 (part 3). Additional ablation study on diagnosed timesteps.
The short conclusion is that the diagnosed timesteps achieve the best performance among all tested timestep sets. As requested by the reviewer, we compare the diagnosed timesteps with random and evenly spaced selections while holding the layers and losses fixed. We first use uniform weights for all selections to isolate the effect of timestep choice. In Table 13, the diagnosed timesteps outperforms all other sets (e.g., reprojection error compared with evenly spaced timesteps, 6.5 px vs. 8.0 px). These results support using causal diagnosis to select the timesteps.
Q1. Does the pattern appear on a second backbone?
The rise-and-fall pattern can be also observed at a different model family with a different model size. As requested by the reviewer, we again perform the linear probing and causal interventions on the frozen CogVideoX-5B-I2V which is another open-source, widely-used model. Figure 6 shows that decodability and intervention effects both rise and then fall across layers and timesteps, which has the same trend of our main experiments. So this pattern might be general in video generation models and a study on more generation models would be interesting in the future work.
If these experiments and clarifications have addressed your concerns, we would be grateful if you could consider raising your rating.