- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper mainly analyze if monocular depth estimation models will predict fake 3d patterns as 3d geometry. The paper compare the predicted depths from two stereo images which can be viewed as a virtual camera move, and if the discrepancy between the depth after warping can be a indicator of ambiguous region. The proposed method can identify some ambiguous regions and eliminate false physical certainty.
Critical strengths
The motivation to address the hallucination of 3d prediction is clear, which is important for applications on robots and cars.
The proposed method is reasonable where the consistency across views can be useful to identify ambiguity.
The proposed method show effectiveness to identify planar surface hallucination.
Critical weaknesses
The paper makes a strong assumption on the planar geometry of the fake 3d, which is not general for real-world cases.
The proposed method has not been validated on real world setup despite a simplified stereo-image-based evaluation.
For the proposed method, it is not clear if it will lead to false alarms of ambiguity prediction on general 3d scenes without ambiguous regions like reflection.
Questions for authors
Could you please clarify for the proposed method, how to disentangle error prediction or inconsistent prediction across views, and the ambiguous regions?
Could you please detail the simulation setup on the diversity and realism of the simulated planar geometry?
Thank you for your careful review and for recognizing the motivation and the effectiveness of the method. We agree that the method needed validation beyond stereo pairs and a clearer explanation. Guided by your comments, the revision evaluates Intervene3D on real camera motion and in a hand-held capture, and it explains the method step by step.
Q1 (prediction error, cross-view inconsistency and ambiguity): Thank you for this question. The revised Section 2.6 and Figure 1 now walk through this step explicitly: the depth network runs only once, on the first image, and each hypothesis turns this single prediction into a prediction of the second view. Two comparisons follow:
On sheets, posters and monitors in the frame, panel answers lower the median surface error from 9.4%, 16.3% and 4.1% to 4.2%, 7.6% and 1.1% (Table 3). Inconsistency across views is a weaker signal: two predictions fooled in the same way still agree, and cross-view disagreement detects failures poorly (area under the ROC curve 0.56–0.62, Section 3.6).
Q2 (diversity and realism of the simulation): We agree that these details matter, and Appendix A.3 lists every parameter of the generator, drawn uniformly per base scene:
The benchmark is built so that all mechanisms produce exactly the same first view, verified below 3×10⁻¹³ pixels. Photometric realism would break this guarantee, so the simulation stays geometric. Instead, realism comes from real data: 404 stereo photographs, 1,620 executed-motion combinations, 123 Mirror3D frames and the hand-held capture.
W1 (planarity assumption): We agree that planarity is an assumption, and we clarify its scope. It applies only to the interface, that is, the panel, the mirror or the glass pane. The content shown on it can have any 3D structure. Printed sheets, posters, monitors and flat mirrors are planar in fact, and a real image enters the evaluation only when its reference disparity fits a plane (Section 2.6). Moreover, curved interfaces are handled as well: the residual-adequacy test lowers wrong answers on strongly curved mirrors from 56.8% to 12.4%, and a mirror hypothesis with known curvature answers those scenes at accuracy 1.000 (Section 3.3).
W2 (real-world validation): We agree, and the revision adds two real settings with executed camera motion (Section 3.4, Figure 4):
W3 (false alarms on ordinary scenes): This is an important check, and the results answer it: on scenes without displays or mirrors, Intervene3D does not report a false panel or mirror. On the direct scenes of the synthetic benchmark, every answer it gives is correct (154 of 154), and an abstention returns the network's own depth. Likewise, on real panels, Intervene3D makes the surface worse on only 0.8% of stereo combinations, compared with 52.7% for a detector that replaces every flagged region by a plane (Section 3.6).
Finally, we take the presentation concern seriously and are grateful for it: Figure 1 now shows the whole pipeline on one real stereo pair, Figure 2 gives the decision order at the start of Section 2, each term is defined once, and Appendix A.1 collects the notation. We hope the clearer explanation and the real-world validation make both the method and its evidence easy to follow. We would appreciate your reconsidering the score in that light, and we are happy to answer any further question.