- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Persistent3D is an open-vocabulary framework for persistent object-level 3D perception from monocular video. It combines local bidirectional mask propagation, global identity constraints, and geometry-aware track reconnection to maintain object identities across occlusions and reappearances. These identities support multi-view geometry aggregation and functional orientation estimation. Experiments on ScanNet report improved overall association performance and reconstruction completeness, with ablations evaluating the main association components.
Critical strengths
-
The paper addresses the practically relevant problem of maintaining object identities under occlusion, re-entry, and confusion among similar objects.
-
The reported ScanNet results demonstrate better overall tracking performance and more complete instance-level reconstructions than competing methods.
-
The ablation study examines several key design choices and provides evidence for the effectiveness of the individual components.
Critical weaknesses
-
The novelty is unclear. While the problem is practically relevant, the paper does not clearly identify the specific bottlenecks in existing methods or explain what is new beyond combining existing techniques. In addition to the methods compared in the paper, relevant recent work includes MaskClustering [1] and Open3DIS [2] for multi-view instance aggregation, and OpenTrack3D [3] for cross-view instance consistency through visual-spatial tracking. The authors should more clearly explain how their method differs from these approaches and to what extent the reported gains stem from the proposed mechanisms rather than the use of stronger pretrained models.
-
The evaluation is largely confined to ScanNet, limiting the evidence for generalization. The main quantitative results with clearly identified data sources are reported on ScanNet, and reconstruction is evaluated on only five scenes. Although ICL-NUIM, self-collected videos, and public online videos are listed in the dataset descriptions, no results or visualizations are explicitly attributed to them, leaving their role in the evaluation unclear. The authors should provide additional quantitative experiments on other datasets and clarify how these listed data sources were used..
-
The computational cost and practical applicability are not evaluated. The framework combines multiple large pretrained models, bidirectional mask propagation, and multi-view VLM inference, potentially introducing substantial computational overhead. However, the paper reports neither end-to-end runtime nor a module-level timing breakdown. The authors should report the runtime along with the hardware configuration used.
[1] MaskClustering: View Consensus based Mask Graph Clustering for Open-Vocabulary 3D Instance Segmentation. CVPR, 2024.
[2] Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance. CVPR, 2024.
[3] OpenTrack3D: Towards Accurate and Generalizable Open-Vocabulary 3D Instance Segmentation. CVPR Findings, 2026.
Questions for authors
-
How does the method handle inconsistent category labels for the same object across views, such as synonyms or different levels of specificity, given that track reconnection requires category consistency?
-
How sensitive is track reconnection to pose drift and reconstruction errors in MASt3R-SLAM, especially when revisiting an object after a long trajectory?