- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Argos, a scene change detection framework that leverages geometric priors from a pretrained geometric foundation model. It introduces a camera-aware cross-session comparator for change detection, together with new datasets and an online SLAM system for change-aware 4D mapping. Experiments demonstrate strong performance on multiple benchmarks and promising synthetic-to-real generalization.
Critical strengths
-
The idea of leveraging implicit 3D priors for scene change detection is well motivated. The proposed design is relatively simple yet achieves substantial improvements over existing methods.
-
The experimental evaluation is extensive, including cross-domain generalization and real-world robotic deployment. The integration with SLAM also makes the work practically relevant.
Critical weaknesses
-
The robustness to large-scale environmental changes remains unclear. In particular, significant illumination changes or substantial scene rearrangements may affect both feature matching and change detection. While the paper demonstrates promising cross-domain generalization, these challenging conditions are not explicitly evaluated. If suitable evaluation are unavailable, the authors should at least discuss these potential limitations and failure cases.
-
The online system still relies on historical keyframe retrieval and geometric verification to establish cross-visit correspondences. This raises concerns about its robustness when the scene changes substantially, as relevant historical frames may fail to be matched and thus be excluded from change detection. It would be helpful to clarify how much the overall performance depends on this retrieval pipeline and discuss its potential failure modes.
Questions for authors
See the weaknesses.
3 comments
Response to reviewer [2/2]
W2. The online system still relies on historical keyframe retrieval and geometric verification to establish cross-visit correspondences. This raises concerns about its robustness when the scene changes substantially, as relevant historical frames may fail to be matched and thus be excluded from change detection. It would be helpful to clarify how much the overall performance depends on this retrieval pipeline and discuss its potential failure modes.
We added this analysis to App. A.7.
Retrieval works well when SLAM is accurate. On the real-world sequences, fewer than 2% of keyframes are skipped in four of the five sequences, and 6.2% on the largest one, processed at real-time rate (Table 12). Retrieval is therefore reliable in typical robot deployment. Occasional skips are also tolerable: Argos-SLAM fuses change predictions into the 3D map, so detections from neighboring keyframes can still propagate change labels to the points of a skipped keyframe.
| Sequence | Capture | Keyframes (prior / current) | Skipped |
|---|---|---|---|
| Office | Handheld | 55 / 21 | 1.3% |
| Home | Handheld | 103 / 83 | 0% |
| Atrium | Robot | 283 / 324 | 0.3% |
| Workshop | Robot | 180 / 159 | 0% |
| Full-floor loop | Robot (real-time) | 841 / 805 | 6.2% |
Pose quality matters more than retrieval itself. Skips mostly come from SLAM drift. On Argos-CD-SceneSmith, skips concentrate in House scenes, whose long, fast trajectories were designed for data generation rather than SLAM. Each follows a single open path without revisits (Fig. 8), so VGGT-SLAM cannot close loops to correct the accumulated drift. As a result, change IoU is 76.56 on Room scenes but 49.53 on House scenes (Table 11), and accuracy drops as the skip rate grows (Fig. 12).
Failure mode. Under substantial scene changes, drift makes retrieval noisy and degrades change detection (Fig. 13). We acknowledge this dependence on SLAM as a limitation in Sec. 6, and reducing it is a promising direction for future work.
Thanks for the responses. I'll maintain my positive rating.
Response to reviewer [1/2]
We thank the reviewer for the thoughtful comments and for recognizing the promising cross-domain generalization of our method. Both questions concern robustness under challenging conditions, and we address them with new analyses of illumination changes, scene rearrangement, and the retrieval pipeline, together with an explicit discussion of the remaining limitations. Below we indicate where the paper changed.
W1. The robustness to large-scale environmental changes remains unclear. In particular, significant illumination changes or substantial scene rearrangements may affect both feature matching and change detection. While the paper demonstrates promising cross-domain generalization, these challenging conditions are not explicitly evaluated. If suitable evaluation are unavailable, the authors should at least discuss these potential limitations and failure cases.
We agree that these conditions deserve explicit evaluation. We added a failure and limitation analysis to Sec. 6, with details in App. A.8.
Robust to moderate illumination changes. We simulate lighting changes by relighting every frame of the current visit while keeping the prior visit unchanged (Table 13). Mild changes barely affect the model, and even extreme darkening reduces change IoU by at most 2.7%. Extreme brightening causes the largest drop, because image saturation destroys image detail. Results of Ours-foundation, with relative change (%) to the unaltered input in parentheses:
Extreme real-world illumination. Beyond simulation, we newly evaluated the model qualitatively on real-world scenes with extreme lighting changes. In the most extreme case, an outdoor scene captured at noon and at night, the pretrained VGGT-Ω backbone fails to register the two visits, which leads to poor change detection (Fig. 6a). This failure stems mainly from the backbone's registration under extreme lighting rather than from our change-detection design, and our model can directly benefit as GFMs become more robust.
Substantial scene rearrangement. When furniture is heavily rearranged, VGGT-SLAM drifts (App. A.8, Fig. 13). Even under this drift, our pipeline still retrieves correct frames in parts of the scene and detects sensible changes in better-aligned areas, such as the kitchen and the table, which shows some robustness to SLAM drift. It does miss the largest changes, which we acknowledge as a limitation in App. A.8.
Limitations. Sec. 6 now states that our datasets mainly cover indoor, object-level changes, so very large-scale settings such as outdoor scenes are beyond the current scope. It also notes that small objects far from the camera in cluttered scenes are hard to detect (Fig. 6c).