- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents EgoDepth, a framework for stereo video depth estimation.
EgoDepth builds on two existing frameworks, Stereo Video Anything (SVA) and FoundationStereo, and combines them. Specifically, it uses FoundationStereo disparity predictions as initialization for SVA iterative inference. Additionally, EgoDepth adds a few minor modifications to SVA, such as operating 3D GRU refinement at a single scale rather than at multiple scales, and introduces a regularization term that encourages EgoDepth predictions not to deviate excessively from the initial FoundationStereo predictions. A fast variant is proposed alongside EgoDepth, reducing inference time by roughly .
Experimental results on standard stereo video datasets such as Sintel, Dynamic Replica, Infinigen Stereo, vKITTI, and KITTI establish EgoDepth as state-of-the-art in video stereo depth estimation, while ablation studies conducted on FlyingThings3D measure the impact of the different design choices. A final experiment is reported, comparing the accuracy of EgoDepth against a commercial IR-based depth sensor on images containing calibration patterns.
Critical strengths
The main strength of this paper definitely is in the quantitative results.
-
Tables 1 and 2 highlight that EgoDepth achieves state-of-the-art stereo video depth estimation.
-
Table 3 studies the impact of the different components and design choices, showing that FoundationStereo and single-scale 3D GRU processing play the main role in the whole framework.
Critical weaknesses
The paper, unfortunately, exposes several critical weaknesses:
-
Limited novelty and technical contribution. The method itself is mainly a simple combination of existing components: Stereo Any Video (SVA), the previous state of the art in stereo video depth estimation, and FoundationStereo. Other design choices departing from SVA consist of using single-scale 3D GRU processing rather than multi-scale processing (whose effectiveness is known: the original RAFT paper used a single-scale approach), plus a regularization term during training to encourage final predictions to be consistent with FoundationStereo ones, whose impact is the least significant. This amounts to a limited contribution.
-
Undefined fast variant. The text refers to a fast variant of the method, but it is never formally introduced or described anywhere in the paper. Accordingly, it is hard to consider EgoDepth-fast a contribution itself, in particular if it only differs from the original EgoDepth by using mixed-precision, TensorRT compilation, and Triton-based operation fusion rather than in terms of topological design.
-
Unbalanced paper structure. The method section covers little more than a single page, while two pages go to an "Application" section reporting experiments of questionable value. Indeed, adding a comparison between an IR-based depth sensor and EgoDepth alone adds little value to the paper, in particular in the absence of any other stereo backbone reported in this experiment. This reinforces the impression of a thin contribution. In addition, the related work section is barely half a page, looking more like a list of references without any explanation of what the different methods propose. This would be acceptable in a very dense manuscript, which seems not to be the case here.
-
Insufficient experimental evaluation. The lack of novelty alone could be compensated for in case of thorough comparisons and studies, which are currently absent. For instance, FoundationStereo is used as a backbone without any empirical comparison with other backbones (e.g., Selective-IGEV, MonSter, Stereo Anywhere, or DEFOM-Stereo).
Questions for authors
To address the aforementioned critical weaknesses, I would ask the authors to provide the following during the rebuttal:
-
Sensitivity study across stereo backbones. Please report results when initializing the method with different stereo backbones, such as Iterative-IGEV, MonSter, Stereo Anywhere, and DEFOM-Stereo. This would show whether the gains hold beyond the specific FoundationStereo + SVA combination and would make the evaluation considerably more exhaustive.
-
Formal introduction to the fast variant. Please describe EgoDepth-fast in detail (architecture, differences from the full model) and report its accuracy and runtime. At the current stage, it is hard to consider it a contribution by itself.
-
Revise the "Application" section. The current content adds very little to the paper. Replacing the current experiments with some other kind of evaluation on a higher-level application would definitely add more value to the manuscript. For instance, showing that the more accurate disparity maps can improve a downstream task, such as surface reconstruction with a framework like GS2Mesh (Wolf et al., 2022), would demonstrate practical value far better than the current experiments.
Depending on the answers provided to these points, I could consider increasing my score despite the rather limited technical novelty.