- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
FCP adds future-chunk prediction losses to autoregressive video diffusion, encouraging current representations to support later predictions. Parallel auxiliary heads condition on clean/noisy features and are discarded at inference. Wan 1.3B/5B experiments examine physical plausibility and auxiliary design choices.
Critical strengths
-
Consistent gains without added inference cost. FCP improves Physics-IQ Verified from 27.6 to 30.9 on Wan2.1-1.3B and from 30.4 to 33.8 for I2V and 40.6 to 44.4 for V2V on Wan2.2-5B (Tables 2 and 4). Table 3 reports gains on complementary benchmarks.
-
Relevant design ablations. Tables 2, 4, 6, and 7 examine prediction structure, source features, text, offsets, and feature injection. On 5B, parallel prediction exceeds the chained variant by 2.8 I2V and 4.5 V2V IQ points.
Critical weaknesses
-
The shortcut explanation rests on indirect evidence. Sections 1 and 5.5 link the benefits of FCP and parallel prediction to reduced reliance on local continuity and intermediate future targets. The ablations show performance gains but do not isolate these mechanisms from other auxiliary-training effects. Figure 3 shows two successful examples; the distribution of improvements, regressions, and remaining physical errors across scenarios is unclear.
-
Uncertainty and compute accounting are incomplete. Appendix A.3 reports four-generation-seed means without dispersion or paired intervals, including for the 0.8-point 1.3B parallel/chained gap. Figure 4 derives 42.6%/50.7% compute savings over full-context FCP from exponential fits to non-monotonic scores. The FLOPs estimator, fitting procedure, and threshold-crossing sensitivity are unspecified (§5.5).
Questions for authors
- Which physical scenarios improve or regress, and which errors remain? Report paired per-scenario changes, representative failures, per-seed scores, and confidence intervals for TF/FCP and parallel/chained comparisons, grouping camera views of each scenario.
- What evidence distinguishes reduced reliance on local continuity or intermediate future targets from other effects of the auxiliary objective and parallel architecture? Connect this explanation to the offset and component ablations in Tables 2 and 4.
- Does increasing the prediction horizon saturate or reverse the gains? Retaining information for distant predictions may compete for capacity with next-chunk fidelity. Extend the fixed-head offset comparison and vary auxiliary-loss strength at matched backbone capacity and training compute. Measure physical consistency and near-term fidelity to identify the best trade-off in the tested range.
- How are the main/auxiliary forward-backward FLOPs and Figure 4 fits computed? Report checkpoint values and the sensitivity of the claimed savings to fitting choices and observed checkpoint crossings.
6 comments
Response to Q2: Shortcut Mechanism and Parallel versus Chained Prediction
We conducted experiments with different prediction-offset configurations on the 5B model. The I2V Physics-IQ results are summarized below:
| Method | Prediction offsets | Physics-IQ Verified ↑ |
|---|---|---|
| Teacher forcing | — | 30.4 |
| FCP — adjacent only | {1} | 30.1 |
| FCP — distant only | {2,3,4,5} | 33.5 |
| FCP — full configuration | {1,2,3,4,5} | 33.8 |
Auxiliary supervision restricted to adjacent-chunk prediction does not improve physical adherence in this setting, whereas supervision of more distant chunks yields substantial gains. These results support our motivation that predicting more distant future evolution benefits model training, with FCP’s auxiliary objective serving as a practical implementation of this principle. For the rationale behind retaining the branch, please refer to our response to Reviewer PWCw (Q1).
We additionally evaluated the three-offset chained configuration, extending the parallel/chained comparison in Table 2. The complete 5B I2V comparison is shown below:
| Number of offsets | Prediction structure | Physics-IQ Verified ↑ |
|---|---|---|
| 3 | Parallel | 32.1 |
| 3 | Chained | 30.7 |
| 5 | Parallel | 33.8 |
| 5 | Chained | 31.0 |
Chained prediction remains inferior even when the chain is shortened to three offsets. This rules out an explanation based solely on the longer five-offset configuration used in the original 5B comparison (§5.5, L427–429). We therefore focus our interpretation on potential leakage of adjacent-future information through the chain (Fig. 2a).
We have tried our best to align the predictor configurations, prediction targets, auxiliary-loss weights, and training settings within each offset set to isolate the connection pattern as closely as possible. In an end-to-end chained design, input dependencies and gradient paths are coupled through the sequential connections [1]. These factors cannot be varied independently within the present comparison without altering the chained design itself.
References
[1] DeepSeek-AI. DeepSeek-V3 Technical Report. arXiv:2412.19437, 2024. §2.2, Eqs. 21–25.
Response to Q3: Effect of Auxiliary Prediction Strength on Performance
We conducted an ablation study on the FCP auxiliary-loss weight. The Physics-IQ results are summarized below:
| Method / FCP loss weight | Physics-IQ Verified ↑ |
|---|---|
| Teacher forcing | 27.6 |
| FCP, weight = 0.1 | 29.6 |
| FCP, weight = 0.5 (default) | 30.9 |
| FCP, weight = 2.0 | 28.1 |
Limited computational resources and job-queue delays during the rebuttal period precluded a finer-grained sweep. Nevertheless, the degradation at the largest tested weight shows that further strengthening FCP can become counterproductive. This is consistent with the need to balance auxiliary supervision against the primary generation objective: an excessively large auxiliary-loss weight can dominate optimization at the expense of the main task.
We further compared offset configurations on the 5B model under matched computation, using three auxiliary predictors in each case. The I2V results are shown below:
| Prediction offsets | Physics-IQ Verified ↑ |
|---|---|
{1,2,3} | 32.1 |
{1,3,5} | 33.1 |
{1,4,7} | 33.2 |
These results show that extending the prediction horizon can yield additional gains at the same computational budget. Although we observed no decline within the tested range, we expect gains to eventually saturate or reverse, as predicting increasingly distant futures without access to intervening context becomes increasingly underdetermined. Our exploration was limited by computational resources during the rebuttal and the scarcity of valid supervision pairs at larger offsets in 5 s training clips. For example, at , only the first chunk of each sample can serve as a prediction source, making stable training more difficult.
We have not sufficiently explored combinations of loss weights and offsets to identify a joint optimum. Our resources are limited, and our experience suggests that suitable settings depend on the model, task, and training data. As an initial exploration, our work provides broadly applicable settings, while the optimal configurations for specific applications remain to be explored.
Response to Q1: Scenario-Level Results, Remaining Errors, and Statistical Reliability
The official Physics-IQ Verified score aggregation is equivalent to first averaging the three camera-view scores within each scenario and then averaging across scenarios. We report category-level mean scores using the official Physics-IQ categories below:
FCP achieves higher mean scores than TF across all five physical categories, indicating that the gains are not limited to a particular type of physical phenomenon.
We will share additional video examples following our open-source release, alongside all checkpoints and training/inference code, to support community comparisons across scenarios and applications. Despite the overall gains over TF, our qualitative impression is that errors in rigid-body collisions, magnetism, and buoyancy remain readily noticeable to the human eye, potentially reflecting humans’ familiarity with rigid-body dynamics and limited training coverage of the latter two. We expect improved data coverage and curation to help address these limitations and will pursue these improvements in future versions.
To address the request for multi-seed evidence, we additionally provide representative aggregate IQ results for the TF/FCP and parallel/chained comparisons in Table 4, reported as mean ± standard deviation across four generation seeds:
The complete IQ mean ± standard deviation table covering all six configurations in Table 4 is provided in our response to Reviewer PWCw (Q6).
During training, we monitored the overall convergence curves of parallel and chained prediction. Parallel outperformed chained at 10k, 15k, and 20k steps, which represent only a subset of the checkpoints examined. Together with the scale-up results in Table 2, this supports a consistent advantage rather than an isolated checkpoint fluctuation. The standard deviations reflect the stochastic nature of autoregressive rollouts and the sensitivity of the evaluation metrics.