- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the computational waste of repeatedly regenerating videos in text-to-video generation, which can also destroy content that was already correct. It proposes to first check errors on low-cost drafts, make targeted edits on the draft’s generation trajectory, and fully render only once at the end. On Wan2.2, it show higher quality and alignment scores with roughly half the time cost. However, the evaluation lacks evidence that supports its core claims.
Critical strengths
(1)The motivation of the paper is commendable, and it is backed by corresponding experimental exploration, which provides some reference value.
(2)The paper is well written.
Critical weaknesses
(1) Although the motivation is reasonable, the paper does not verify whether “a correct draft leads to a correct final video” actually holds.
(2) The core selling point of the paper, that fixing one part breaks another, lacks quantitative evidence; there are only two simple illustrative examples.
(3) The numbers in Table 6 look somewhat strange (e.g., apart from Wan2.2-T2V-A14B, the entries all end in 0 or 5). Could the authors explain this?
(4) Please report the number of prompts and seeds for each table/figure, as well as the prompts that were excluded.
(5) How were the PreCoG AB/GN values in Table 6 and Table 4 obtained?
Others: In the Microsoft Edge browser, the formulas in Figure 1 are displayed as “?”.
Questions for authors
Pls see weaknesses.
5 comments
Author Response to Weakness 3, Weakness 4, and Weakness 5
W3. Numerical precision in Table 6. To accelerate preliminary validation of PreCoG's generalizability across backbones, we evaluated configurations other than Wan2.2-T2V-A14B in two batches, each covering half of the evaluation samples. The batch-level mean scores were inadvertently saved with insufficient decimal precision before aggregation, producing the recurring trailing zeros and fives in Table 6. We apologize for this reporting error. The corrected means, calculated from the unrounded evaluation results, are provided below.
| Task | Backbone | VBench Direct | VBench PreCoG | Delta | T2V-Comp. Direct | T2V-Comp. PreCoG | Delta | VS2 Direct | VS2 PreCoG | Delta |
|---|---|---|---|---|---|---|---|---|---|---|
| T2V | Wan2.2-TI2V-5B | 79.78 | 81.07 | +1.29 | 48.61 | 54.22 | +5.61 | 3.419 | 3.608 | +0.189 |
| T2V | SkyReels-V2-T2V-14B | 81.21 | 82.37 | +1.16 | 52.83 | 58.91 | +6.08 | 3.578 | 3.752 | +0.174 |
| T2V | Helios-Base | 80.71 | 81.64 | +0.93 | 50.42 | 55.69 | +5.27 | 3.490 | 3.652 | +0.162 |
| I2V | Wan2.2-TI2V-5B | 82.10 | 82.84 | +0.74 | 54.29 | 59.12 | +4.83 | 3.598 | 3.740 | +0.142 |
| I2V | Wan2.2-I2V-A14B | 83.38 | 84.03 | +0.65 | 58.21 | 63.42 | +5.21 | 3.758 | 3.889 | +0.131 |
VBench and T2V-Comp. are reported on a 0-100 scale; Delta denotes the change from direct generation. We have updated Table 6 accordingly. The corrections are small and preserve the improvement over direct generation in all three metrics across the tested configurations.
W4. Prompt coverage, generation seeds, and timing samples. All quality scores use the same randomly selected set of 180 prompts from each of the seven T2V-CompBench categories, giving 1,260 prompts in total, with matched generation seeds across the compared methods. The full benchmark contains 200 prompts per category (1,400 in total); the remaining 20 prompts per category are outside this quality-evaluation subset. The generation seeds used in our experiments are 17 and 20260822.
Our original timing evaluation used those remaining 20 prompts per category, giving a separate set of 140 prompts. We have now recomputed inference time on the same 180 prompts per category used for quality evaluation, so the revised quality and timing comparisons use the same prompt population.
W5. AB/GN evaluation. We evaluate videos generated by PreCoG using prompts from the official Action Binding (AB) and Generative Numeracy (GN) categories of T2V-CompBench. Both the visual models and evaluation procedures follow the standard T2V-CompBench pipeline. AB uses Grid-LLaVA to assess whether each subject performs its specified action, with scores normalized and averaged across videos. GN uses GroundingDINO to compare detected object counts with the requested quantities, averaging scores across frames and then videos. Both category scores are reported on a 0–100 scale.
Other comment. Figure 1 rendering. We thank the reviewer for bringing this rendering issue to our attention. We have rasterized the main figure, so its equations no longer depend on PDF font rendering.
Thanks for the rebuttal and new experiments. Some concerns are addressed, but I still have a few questions:
(1) The false acceptance rate increases from 1.71% to 3.54% after editing. Does this affect the correction loop?
(2) The new comparison is helpful, but it still relies on VLM judgments. Not sure how well this matches human evaluation.
(3) The explanation for the strange numbers in Table 6 makes sense, but the original reporting issue still raises some concerns about the experimental reliability.
Overall, the rebuttal helps, but I'm still a bit concerned about the reliability of the results. I'll keep my original score for now.
Author Response to Weakness 1, Weakness 2
We thank the reviewer for the thoughtful review and constructive feedback.
W1. Preview-to-final reliability. Figure 3(a) quantitatively evaluates this premise using paired previews and full renders. Among accepted previews, approximately 96.69% also yield accepted full renders. Conversely, all accepted full renders have accepted previews, with no false rejections observed in this sample. These results support preview-based assessment for the initial candidates evaluated.
To avoid relying solely on Gemini 3.1 Pro or initial candidates, we further evaluate both initial and edited candidates using the deployed Qwen3.8-27B evaluator (Appendix G, Fig. 9).
These results support preview-based assessment across evaluators and for both initial and edited candidates.
W2. Preserving satisfied content during correction. The risk of altering already correct content during correction is an established challenge discussed in multi-turn image editing (MT Forcing [1]), regeneration-based video refinement (VideoRepair [2]), and video editing (Vera [3]). We invoke this documented challenge as motivation, rather than introduce it as a new empirical finding based solely on our two examples. Figure 4 illustrates how this challenge manifests in our setting, while Table 2 quantitatively evaluates the effectiveness of our proposed correction mechanisms.
To further quantify this issue in our setting and evaluate PreCoG’s effectiveness in addressing it, We have added a quantitative comparison of VSR, GENMAC, and PreCoG, all using Qwen3.8-27B as their feedback VLM. An independent Gemini 3.1 Pro evaluator compares each method’s initial candidate (iteration 0) with its final selected candidate, assessing whether the original problems are resolved and whether new problems are introduced.
These outcomes are assessed separately: a sample may resolve its original problems while introducing new ones. The results quantitatively confirm that existing feedback-based correction methods can introduce new errors during refinement. PreCoG achieves both the highest problem-resolution rate and the lowest new-problem rate, supporting the effectiveness of its targeted editing mechanism in correcting identified failures while limiting unintended changes.
References
[1] Houyuan Chen et al. MT Forcing: Towards Stable and Consistent Multi-Turn Image Editing with Autoregressive Diffusion. arXiv:2610.25404, 2026.
[2] Daeun Lee et al. VideoRepair: Improving Text-to-Video Generation via Misalignment Evaluation and Localized Refinement. arXiv:2411.15115, 2024.
[3] Hongkai Zheng et al. Vera: A Layered Diffusion Model for Content-Preserving Video Editing. arXiv:2606.23610, 2026.