- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents an analysis regarding negative disparities in stereo matching and a simple fix for SOTA deep learning-based stereo matching models. In particular, negative disparities can appear in isolated cases, such as 3D movies or imperfectly calibrated stereo rigs; thus, running most of the SOTA stereo matching methods will fail on a large number of pixels.
To fix existing image and video SOTA stereo matching methods, the authors proposed two fixes: 1) shift the right image to simulate negative pixels during model training; 2) fix non-correlation cost volumes (e.g., GWC cost volumes) using both positive and negative indices (pure correlation volume-based solutions like RAFT-Stereo already support negative disparities natively).
To evaluate the fine-tuned models, the authors proposed a novel benchmark created starting from open-source movies like Spring, with customizations such as the capability to shift the zero disparity plane or the removal of artist effects such as depth-of-field blur (an issue present in already published stereo benchmarks based on open movies like Spring).
The fine-tuned models drastically reduce errors on the negative disparity side (Tab. 3), while keeping the models sufficiently accurate on the positive range (Tab. 4).
Critical strengths
Major
- A novel stereo benchmark from open movies. The new ZDPShift dataset contains scenes from different open movies like Spring and Settlers, reduces artist effects such as lens flare, and introduces multiple zero-disparity planes.
- Simple fix for existing SOTA architectures. The GWC indices fix and the right image disparity shift can extend existing SOTA stereo models to the negative disparity regime. Those are very easy edits. Furthermore, the fine-tuning is affordable (i.e., a few hours) on a top-tier GPU (probably even on a smaller GPU), since, as demonstrated by the authors, the matching features are already compatible with the negative disparity regime.
Minor
- Clean writing. The paper is easy to read and well structured, with clear explanations of the method and the experiments.
Critical weaknesses
Major
-
Given the recent literature, the novelty is quite limited. The main claim of the paper -- i.e., "Restoring negative disparity" -- is already explored in the literature (1). In particular, the right image shift is already used as an augmentation for the S2M2 model family, which supports negative disparity values. Probably, the most novel parts are the novel benchmark and the GWC cost volume fix, which are quite limited for an ICLR paper.
-
The positive regime accuracy is not fully preserved. While the simple fix proposed is interesting, the claim that the positive regime accuracy is preserved when applying the fine-tuning is not well supported by Tab. 4. In particular, we observe a drop on KITTI2015 with all image architectures -- with a ~2x drop when observing RAFT-Stereo -- or we can observe drops in all other benchmarks -- such as Middlebury, where FoundationStereo Bad2 drops from 1.1 to 2.9. I consider this a minor weakness since the fine-tuned stereo models are mainly used for 3D movies: for standard usage, we can use the non-fine-tuned version.
Minor
- Limited applications of negative disparity values. As written in the paper (rows 40-43), the standard procedure is to place ZDP at infinity, removing de facto negative disparity values. From my experience, the only two cases where negative values appear are in the case of imperfectly calibrated stereo rig setups (1) and the case of 3D movies.
References
(1) Min, Junhong, et al. "S 2 m 2: scalable stereo matching model for reliable depth estimation." 2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025.
Questions for authors
Questions
- Can the authors provide more details about the usage of stereo matching for 3D movies? The only referenced scenario is in row 161.
- Can the authors provide more applications for negative disparity other than 3D movies and an imperfect stereo rig?
- Can the authors provide a comparison with S2M2?
Suggestions
- Row 102: "[...]though it has been considered essential for decades in 3D movie production.". Please justify this part better.
- Row 166: FoundationStereo has an iterative recurrent module.