- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes World-δ, a framework for incrementally expanding and correcting a generated 3D scene as new RGB observations arrive. Its persistent world state stores latents together with provenance, observation confidence, and generative uncertainty. New evidence is compared against this state, and each region is assigned one of four actions: KEEP, FUSE, REVISE, or EXTEND. Masked flow matching then regenerates only the regions marked for change, and only the affected chunks are decoded.
Critical strengths
-
The problem is well motivated. Distinguishing observed content from generated content, so that wrong completions can be revised later, is a real issue in incremental scene generation.
-
The idea of updating and decoding only the affected regions is reasonable and saves computation.
Critical weaknesses
-
The qualitative results are poor. The generated scenes in Fig. 5, Fig. 6, and the appendix are blurry and overly smooth, with obvious artifacts. They are clearly behind current 3D scene generation methods, and the visuals do not match the strong numbers reported in the tables.
-
The reported numbers are hard to trust. The flow model is very small (six transformer blocks) and is trained only on indoor Gaussian datasets. Yet it is reported to outperform Lyra on single-image generation, including on outdoor Tanks and Temples, and to outperform Splat-SLAM on observed-view rendering while also running faster. The appendix tables also follow unusually regular patterns. In Table A4, the failure-rate gap between “w/o Q” and “Full” is exactly 4.0 points in every non-zero-perturbation setting, and the gap between predicted and GT poses is exactly 2.0 points in every row. In Table A1, several timing entries scale by exact factors. Please explain these patterns and provide per-scene raw results.
-
The method is heavily hand-designed, and its novelty is limited. The discrete KEEP/FUSE/REVISE/EXTEND actions, combined with several metadata fields and loss terms, make up a complex hand-crafted pipeline. Masked latent updating is essentially standard diffusion inpainting. CUT3R is cited as related work but is not compared against.
-
The evaluation is narrow. All continual-update experiments are on indoor scenes, and the baselines are mostly SLAM methods, which is a mismatch for a generation task. The single-image comparison also uses older baselines.
Questions for authors
-
Why are the gaps in Table A4 constant across all settings? Could you release per-scene raw results?
-
How can such a small model trained only on indoor data outperform Lyra on Tanks and Temples?