- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses 4D video editing, where a monocular video is lifted to a 4D point cloud, edited (camera trajectory and/or object transforms), and re-rendered as a coarse condition for a video diffusion model. The authors propose PREX, which partitions every target pixel into Preserve, Reveal and Expand. PREX retrieves appearance directly from source frames, computes a continuous confidence map, and injects these together with Reveal/Expand masks into a frozen model through a trainable adapter. The authors also introduce PREBench, a benchmark with nine region-specific diagnostic metrics.
Critical strengths
-
The paper breaks 4D editing into sub-problems of preserve, reveal and extend. Building on this decomposition, the authors construct PREBench, covering camera-only and joint camera/object edits, with failure-specific metrics for each region type.
-
Practical training strategy that requires no paired editing data. The self-supervised proxy tasks sidestep the requirement of paired editing dataset by artificially removing 4D support from source videos.
Critical weaknesses
- Heuristic P/R/E partition.
(1) Every target pixel must be exactly one of Preserve, Reveal, or Expand. This significantly limits the application to general 4D editing which should be able to edit both camera and motion. Current method is only a small extension to novel view video generation by enabling to transform object’s position and size. For example, they exclude non-rigid object deformation, articulated motion changes, and appearance or illumination changes.
(2) Most synthesis is reduced to background completion. It is unclear how PREX behaves when the text prompt asks for new content in the expanded region rather than a plain continuation of the background. No metric measures prompt adherence in Expand, and E-Copy only penalizes copying boundary texture.
(3) The Reveal/Expand boundary is confusing and inconsistently defined. In Eq. 15 the authors define Reveal and Expand with scene geometry In lines 877–880 the authors instead reassigns unsupported connected components by assigning a component touching an 8-px image-border band to Expand, otherwise to Reveal. When does each rule hold? And when do they disagree? The paper does not state which rule produces the final masks used for conditioning and for PREBench, nor how often the two disagree.
- Validity of PREBench.
(1) Proxy errors become ground truth. Masks and references are derived from the edited 4D proxy, not a ground truth edited target. If the proxy contains errors, a method that faithfully copies these artifacts scores well, while one that corrects them with its generative prior is penalized.
(2) R-Ghost only rewards dissimilarity to the ghost reference, and E-Temp only rewards low temporal change. Blurry or near-static completions can still score well. No metric measures whether the Reveal/Expand content is plausible or semantically correct.
Questions for authors
-
The Related Work groups ReCamMaster with methods that "render or generate videos from new viewpoints by warping source observations and inpainting disoccluded regions" (lines152–154). As far as I understand, ReCamMaster does not warp: it conditions the generator on the source video and camera parameters directly, without an explicit 3D proxy.
-
The human validation of PREBench is too small to support the claim that the metrics reflect human judgment. Each of the nine metrics is validated on only 30 pairs rated by 3 annotators, and the aggregate score on 30 pairs rated by 5 annotators. At this scale, the reported agreements carry wide uncertainty.
-
PREX doesn’t outperform baselines on the camera-only split. On the full set, the remaining comparators are either not designed for source-preserving editing (Yume, Perception-as-Control) or use different and weaker backbones. This raises the question of whether PREX is particularly strong on object edits, or whether object edits are simply harder to evaluate fairly. In joint camera/object cases, the Reveal regions, dynamic-preserve masks, and ghost references all depend on the edited proxy, the same information PREX receives as input. Could the authors also report Table 2 separately for the joint camera/object split for all full-set methods?
Summary of Manuscript Revisions
We sincerely thank all reviewers for their detailed reviews and constructive feedback. We have made the following changes to the paper and uploaded a new revision (all updates are highlighted in blue in the revised PDF):
Overall, we are pleased that the reviewers found our method sound and well-presented. Thank you once again! Your feedback has been invaluable in improving our paper, and we believe these revisions will strengthen our work.