- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
LEG4D addresses complete and language-queryable dynamic scene reconstruction from monocular videos and object masks. It uses pretrained SAM 3D to complete partially observed objects, aligns the generated objects with the scene, and adapts their appearance using MV-Adapter. The completed objects are incorporated into a dynamic Gaussian representation through shared object-level motion coefficients. Language features are subsequently distilled into the reconstructed scene, with shared object embeddings transferring semantic identity to unobserved regions. Experiments evaluate novel-view synthesis on two synthetic datasets and text-based querying on one dataset, alongside qualitative demonstrations of object removal and appearance editing.
Critical strengths
- This paper addresses a problem: in monocular dynamic reconstruction, it is difficult to reconstruct regions of objects that have not been observed for an extended period. Integrating generative object completion techniques into a 4D representation that can be queried via language is both practical and meaningful.
- LEG4D improves new-view rendering on Mesh4D-6, boosts the mIoU for text queries on Kubric4D-25, and supports object querying, removal, and appearance editing.
Critical weaknesses
- The model’s methodological innovation is limited, and the performance ablation is unclear. The model’s core architecture relies heavily on existing techniques, including SAM3D, dynamic Gaussian motion modeling, MV-Adapter, and language feature distillation. The main contribution of this paper lies in combining these techniques with object-level motion/semantic sharing; however, the lack of targeted ablation experiments fails to demonstrate the extent to which these new designs contribute beyond a simple combination of existing components.
- Validation with real-world experimental data is insufficient. Both evaluation datasets consist of synthetic data, and several claimed capabilities are demonstrated primarily through qualitative means.
Questions for authors
Under conditions where object masking, generative priors, appearance supervision, and preprocessing are all identical, how does the simplified combination of base components perform compared to LEG4D? Please include targeted ablation studies to isolate the effects of alignment, object-level motion sharing, and semantic sharing, respectively, to clarify the contribution of this method beyond the pre-trained components.
Which views and timestamps were used for the semantic results in Table 2? Do these improvements hold true in object regions not observed in the training videos? Given the synthetic nature of the dataset, can the available geometric and motion information support direct metrics for completeness and motion/temporal consistency?
How does LEG4D generalize to real monocular videos with imperfect masking, depth estimates, and correspondences? Please provide results from real-world scenarios, as the current evaluation is based solely on synthetic data.