- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work introduces SceneAE, which represents a scene using sparse 3D anchors with learned content features. An encoder aggregates geometry-foundation-model features at these anchors, and a projection-based decoder renders queried RGB-D views. For generation, a point model first predicts the anchor layout conditioned on a camera trajectory, followed by content diffusion with geometry refinement. Experiments evaluate scene generation, reconstruction, camera following, and consistency, with additional out-of-distribution tests and component ablations.
Critical strengths
-
The representation provides a useful connection between compact generative latents and queryable scene reconstruction. Explicit anchors support spatially localized feature aggregation and decoding, while allowing the same scene representation to serve multiple viewpoints. Table 5 shows improvements over SceneTok and LVSM on novel-view synthesis.
-
The geometry-first generation design has encouraging empirical support. Table 9 reports improvements over joint and content-only alternatives, while Table 3 shows better trajectory following. Together, these results support explicit geometry as a useful intermediate variable for camera-controlled generation.
Critical weaknesses
-
The geometry evaluation does not establish a consistent comparison across methods. Table 2 evaluates Gen3R against VGGT-derived geometry, but SceneAE and GLD against DA3-derived geometry. These scores measure agreement with different references and therefore cannot directly establish the reported ranking in geometric accuracy. The shared-reference comparison with GLD remains informative, but an independent common reference is needed to substantiate the broader claim.
-
Important details needed to assess the generation and efficiency claims remain unclear. Equation (7) interpolates between separately sampled reference and target point sets, but does not explain their correspondence or ordering. Equation (10) specifies a residual target without explaining its timestep scaling or sampling update. Meanwhile, Table 1 reports per-step cost despite the method using two generation stages and subsequent geometry correction. Without the correspondence rule, sampling procedure, and total inference cost, reproducibility and the claimed efficiency advantage remain insufficiently established.
Questions for authors
-
Can you evaluate all methods against the same geometry reference, preferably independent measured geometry, and report the alignment and scale-normalization protocol?
-
How are reference and target anchors paired for Equation (7)? Please specify the inference updates and sampling steps for both stages, clarify the timestep treatment in Equation (10), and report total latency including reference encoding, geometry generation, content generation, correction, and decoding.
Dear Reviewer JcsQ,
We sincerely thank you for your valuable feedback and thoughtful comments on our work. We have carefully addressed your concerns and provided detailed responses in our rebuttal.
We would greatly appreciate it if you could take a moment to review our responses and let us know whether they adequately address your concerns. We would be happy to provide further clarification if needed.
Thank you again for your time and consideration.
Best regards,
The Authors