- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Existing RL post-training for video editing scores only the final generated video, so it cannot tell at which depth of the network editing quality is formed, or which instruction words are responsible for it. The authors observe that hidden states decoded from intermediate DiT layers are already recognizable edits, and that their rewards increase with depth. Based on this, they propose VISTA: at selected intermediate layers, the model decodes a group of candidate edits and scores them with a single reward model, and each layer is credited with its own reward plus the rewards of subsequent layers. The best candidate at each layer is then converted into a token-importance weighting over the instruction, which strengthens the conditioning of later layers on the key words and reweights the GRPO update at that layer. Experiments start from Kiwi-Edit (5B) and SAMA (14B) and evaluate on OpenVE-Bench and FiVE-Bench, together with ablations, hyperparameter analysis, and a human preference study.
Critical strengths
- Densifying the reward along network depth rather than along denoising steps is a novel perspective, and it requires only a single reward model.
- The evaluation is comprehensive: four VLM judges, FiVE-Bench, and a human preference study with 24 participants.
- The paper is well written with a clear motivation, and the framework and qualitative comparison figures are intuitive and well designed.
Critical weaknesses
- The 14B model is initialized from SAMA, yet its OpenVE-Bench average is essentially unchanged under all four judges (3.27→3.22, 3.99→3.99, 3.31→3.33, 4.00→4.06; Fig. 15), which contradicts the conclusion that VISTA improves over its initialization at both scales.
- The claim in Sec. 4.2 that the 5B model surpasses SAMA holds only under the two non-official judges (3.31 vs 3.27, 4.05 vs 3.99); under the official judges in App. G.4 it is lower or tied (3.09 vs 3.31, 4.00 vs 4.00). How do the authors interpret this inconsistency?
- In Table 2, removing either component drops the average to 2.47 / 1.43, far below both the base model (3.16) and outcome-only GRPO (2.98). Why does removing a single component make the model much worse than not training at all?
- Minor: The two ablation rows in Table 2 (2.47 / 1.43) are swapped relative to the text in Sec. 4.3.
Questions for authors
- Is the decoding head gϕ in Eq. (1) the backbone's final output projection applied to H(ℓk), or a separately trained module?
- See weakness.
5 comments
I would like to flag a formatting issue in the revised PDF. The text block appears to be wider than the ICLR template allows. It looks like the page geometry was modified on top of the template. Could you please restore the official margins in the next revision? I wanted to raise this early so it does not cause problems later.
Thank you so much for bringing this to our attention! We truly appreciate your careful reading and helpful feedback. This was something we had overlooked during the revision, and your comment helped us identify the issue. We have now uploaded a newly revised PDF to fix this issue.
We are genuinely grateful for your time and attention to these details. We would also really appreciate it if you could let us know whether our responses have adequately addressed your concerns. We remain happy to clarify any further questions and are open to continued discussion.
We sincerely thank the reviewer for the positive assessment, in particular for recognizing depth-wise reward densification as a novel perspective and for finding the paper clear and well motivated. We address each point below.
W1: 14B against SAMA.
We would like to offer a fuller reading of the 14B results. The 14B model is LoRA-adapted from SAMA, which is already the strongest baseline in our comparison, so the headroom is considerably smaller than at 5B. Even so, it obtains the highest average among all methods under both judges (3.33 vs. 3.31 under gemini-3.1-pro and 4.06 vs. 4.00 under qwen3.5-35b-a3b), and it is on par with SAMA under the two additional judges. On FiVE-Bench, it improves 28 of 36 task–metric entries over SAMA, including Struct, PSNR, and LPIPS on all six edit types and MF on five. The 14B model therefore does improve over its initialization, mainly in source preservation, while maintaining or slightly improving overall editing quality. We agree that the OpenVE margins at 14B are small, and we have revised Sec. 4.2, the abstract, and the conclusion to state that the improvement at 14B lies mainly in source preservation.
W2: 5B against SAMA.
We thank the reviewer for this careful cross-check. Across the four judges, the 5B model scores higher than SAMA under two judges (3.31 vs. 3.27 and 4.05 vs. 3.99), ties under qwen3.5-35b-a3b (4.00 vs. 4.00), and is lower under gemini-3.1-pro (3.09 vs. 3.31). We attribute this to differences between the judges, which score on noticeably different scales and weight the evaluation axes differently; this is also why Appendix G.4 compares methods by their rank within each judge. The more robust observation is the change from initialization: Kiwi-Edit is below SAMA under all four judges (e.g., 2.94 vs. 3.31 under gemini-3.1-pro), and RL post-training brings the 5B model to match or exceed SAMA under three of them, with about a third of SAMA's parameters. We have revised Sec. 4.2 to report all four comparisons and to state that the 5B model matches or exceeds SAMA under three of four judges, while SAMA remains ahead under gemini-3.1-pro.
W3: Why the ablations fall below the base model.
We thank the reviewer for raising this point; the answer also explains why the two components are designed together. Regarding the minor comment, the correct mapping is w/o Self-eval: 2.47 and w/o TI memory: 1.43. The Sec. 4.3 explanations describe the correct mechanism for each number, and only the component names were inconsistent; we have aligned them in the revision. The complete ablation, with a new random-memory control (5B, gemini-2.5-pro), is:
Both ablations still take K=4 gradient steps per rollout, but removing either component makes these steps largely redundant. Without self-evaluation, every step uses the same terminal-reward advantage; without the memory, every step uses the same conditioning. The model therefore repeats nearly the same update four times on one rollout and over-fits it, which is why both ablations fall below the base model and even below outcome-only GRPO (2.98), which takes a single step. Random memory, which carries no attribution, reaches only 2.49, so the memory must reflect the tokens that drive reward. With both components, each step receives a distinct signal, and the full method reaches 3.31. We have added this explanation to Sec. 4.3 and will include a four-step outcome-only control.
Q1: Decoding head.
We thank the reviewer for the question. The reviewer's first reading is correct, and no separately trained module is used. Each H(ℓk) passes through the backbone's own final output projection and is then decoded by gϕ, the VAE decoder of the base model, kept frozen throughout training. The decoding path adds no parameters, so the intermediate outputs are decoded exactly as the final output is. The revised Eq. (1) shows both steps, and Sec. 3 and Appendix E.1 state this explicitly.
We hope these clarifications address the reviewer's questions, and we would be happy to provide any additional details.