- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes NARRA, a test-time adaptation method for long camera-controlled video generation on top of SANA-WM. Given an image, a caption and the full camera trajectory, the frozen model first generates a video, which is then used as self-supervision to fine-tune the generator before a second, final generation. The adaptation is nested: a fast weight update on the last block's feed-forward projection runs inside slower updates of the Gated DeltaNet projections and of the fast update's starting point, which is meta-learned offline. Two more components target long-range scene memory: a camera-return loss that uses the known trajectory to pull the prediction at a revisited view towards the matching earlier frame of the first pass, and a channel-weighted retrieval of memory states from earlier segments. Experiments use a new 45-scene departure-and-return benchmark and a 50-video subset of the SANA-WM benchmark, with revisit-consistency metrics (including new time-stratified ones), VBench and camera errors, plus a 16-second comparison with other world models. At 60 seconds NARRA improves revisit consistency and VBench over the frozen backbone.
Critical strengths
-
The gain over the frozen backbone is seen in most individual scenes and shows up again on a second benchmark. On the 45-scene benchmark at 60 seconds (Table 1), NARRA raises PSNR from 15.50 to 16.33 and N-PSNR from 16.21 to 17.16, with higher PSNR on 34 and higher N-PSNR on 39 of the 45 scenes. On the SANA-WM subset (Table 3), all five adapted variants beat the frozen backbone on PSNR, MSE, N-PSNR, N-SSIM, VBench and N-LPIPS, on both simple and hard trajectories. But the only 60-second comparison is with the frozen backbone, since the other models the paper tried often drifted or left the return path at this length (Sec. 3.1, App. A.4).
-
Sec. 3 points out a real problem with the existing revisit protocol: SANA-WM averages over the five closest revisit pairs, but in 90.4% of these pairs both frames lie within 1 s of another selected pair, so the five pairs mostly measure the same few returns. The departure-and-return benchmark and the time-stratified metrics are a sensible fix, and neither is tied to NARRA.
Critical weaknesses
-
I consider the source of the main gain unclear. The adaptation target is mainly the first-pass video, which already contains the drift the method should remove. The flow-matching loss covers all of it, drifted return frames included, without filtering. Why would fitting it make the regenerated video more consistent rather than reproduce its errors? The conclusion leaves "selecting reliable self-supervision to avoid reinforcing generation errors" to future work. Yet plain fine-tuning with this loss already gives 0.60 of NARRA's 0.87 dB N-PSNR gain (Table 3). The camera-return loss, the only component that explicitly uses revisit pairs, gives only 0.04 dB more when added alone to nested adaptation. Larger gains at 60 s than at 16 s hint at memory, but no controlled test separates remembering this scene from a general gain. So I consider the claim that NARRA lets video world models "learn and remember at test time" not yet supported.
-
NARRA's additions to plain fine-tuning give under a third of the N-PSNR gain (0.27 of 0.87 dB), each with a small or mixed effect. NARRA needs two full generations per video plus K slow iterations, each backpropagating through R fast updates. Without step counts or per-video time, I cannot check whether the variants had equal budgets or compare NARRA with the frozen model at equal compute. On hard trajectories, camera rotation error rises from 4.73° for the frozen model to 7.32°–8.28° for every adapted variant (Table 3), which the text never addresses. The step behind most of the gain, test-time fine-tuning on the generator's own output, was already done during generation by SlowFast-VGen (ICLR 2025) and in a recall test by CoME (ICLR 2026). Neither is cited or discussed.
Questions for authors
Q1. What happens if the model is adapted on an unrelated video, on a temporally shuffled first pass, or on a first pass cut before the return segment? Does the final generation reuse the first pass's noise?
Q2. NARRA is tested only on SANA-WM, and App. A.3 links the effect to how its Gated DeltaNet blocks construct and propagate their recurrent state. Does the gain, at least the part from plain fine-tuning, carry over to a backbone whose long-range memory does not rely on such a state?
Thank you for the rebuttal, the three controls, and the DreamX-World results. The new controls do not fully resolve my concerns about the main claim. Adapting on an unrelated scene already gives 0.74 of the 1.53 dB N-PSNR gain over the frozen model, the first 30 s of the target scene is on par with the unrelated video (15.93 vs. 15.95), and the shuffled first pass gets the highest score with noticeably less motion. At matched time, NARRA is also only about 0.3 dB ahead of plain fine-tuning.
For DreamX-World, the 16 s result reflects the full pipeline with earlier pose-matched views blended into the attention cache, so the 11 dB gain does not show how much comes from adaptation alone, which was my question.
I appreciate the additional experiments, but I still consider the scene-memory claim only partially supported, so I am keeping my score.