- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an event-first framework for stereo depth estimation using two event cameras and one frame camera. A state-space network first estimates disparity from stereo events alone. The paper focuses on when frame information should enter stereo estimation. Establishing event-only geometry first provides an appearance-independent reference for subsequent refinement. This gives the two modalities distinct roles and offers a sensible way to limit the influence of degraded frames on correspondence. The experiments include an event-only control with the same refinement capacity, helping distinguish the benefit of frame information from additional model capacity. Under blurred nighttime frames, gating reduces MAE from 0.560 to 0.412, while the matched event-only control achieves 0.414. This supports the gate’s practical value under the tested degradation.
Critical strengths
This paper proposes a Geometry-before-Fusion framework for Event–Frame Stereo. By adjusting the role and fusion timing of different modalities in stereo matching, event data is first used to establish geometric relationships independent of Frame Appearance, and then image information is introduced for parallax refinement. Specifically, Geometry-Structured Event States, Cross-view State Propagation and Coarse-to-Fine Epipolar Matching are first used to estimate the initial disparity, and then disparity refinement is completed through Reliability-Aware Frame Integration and Disparity-Conditioned State-Space Refinement. The proposed method has achieved competitive experimental results on serval benchmarks, and the overall experimental design is relatively complete.
Critical weaknesses
- Existing methods (such as EGEI-Net mentioned in the Related Work section) already utilize image-derived edge guidance to steer recurrent disparity updates. Furthermore, coarse-to-fine disparity refinement and reliability-aware fusion are also well-established strategies. The authors should clarify why the proposed geometry-before-fusion strategy represents a significant innovation in the context of event-frame stereo compared to existing multi-stage, confidence-guided fusion approaches.
- In Table 5, the early fusion configuration performs worse than the event-only Stage I (which uses only event data), while post-D_0 fusion demonstrates a notable performance improvement. The authors should further analyze whether the gain is attributed to the change in fusion timing or to the inherent advantages of matching within the event domain.
- In Section 3.2, the authors describe the reversible rearrangement operator within the Geometry-Structured Event States as lossless and reversible. However, if the dimensions of the feature map are not perfectly divisible by the neighborhood size, the defined rearrangement operation cannot guarantee reversibility. For instance, with an input resolution of 480 × 640, the width is not divisible by 3. The authors should explicitly explain how boundary regions are handled and how the lossless, reversible nature of this operation is maintained.
- While the paper highlights the proposed method's advantages in terms of parameter count, the results indicate a high computational cost. It would be helpful to provide additional measurements of actual inference latency, GPU memory usage, and throughput for a more comprehensive assessment of the method's computational efficiency and feasibility for practical deployment.
- Table 6 demonstrates that the reliability gate effectively improves matching performance when dealing with blurred frame inputs. However, the current experiments do not sufficiently validate the relationship between the frame gate and actual reliability. It is recommended to further analyze the gate's response under varying degrees of frame corruption or different levels of event consistency error.
Questions for authors
- Existing methods (such as EGEI-Net mentioned in the Related Work section) already utilize image-derived edge guidance to steer recurrent disparity updates. Furthermore, coarse-to-fine disparity refinement and reliability-aware fusion are also well-established strategies. The authors should clarify why the proposed geometry-before-fusion strategy represents a significant innovation in the context of event-frame stereo compared to existing multi-stage, confidence-guided fusion approaches.
- In Table 5, the early fusion configuration performs worse than the event-only Stage I (which uses only event data), while post-D_0 fusion demonstrates a notable performance improvement. The authors should further analyze whether the gain is attributed to the change in fusion timing or to the inherent advantages of matching within the event domain.
- In Section 3.2, the authors describe the reversible rearrangement operator within the Geometry-Structured Event States as lossless and reversible. However, if the dimensions of the feature map are not perfectly divisible by the neighborhood size, the defined rearrangement operation cannot guarantee reversibility. For instance, with an input resolution of 480 × 640, the width is not divisible by 3. The authors should explicitly explain how boundary regions are handled and how the lossless, reversible nature of this operation is maintained.
- While the paper highlights the proposed method's advantages in terms of parameter count, the results indicate a high computational cost. It would be helpful to provide additional measurements of actual inference latency, GPU memory usage, and throughput for a more comprehensive assessment of the method's computational efficiency and feasibility for practical deployment.
- Table 6 demonstrates that the reliability gate effectively improves matching performance when dealing with blurred frame inputs. However, the current experiments do not sufficiently validate the relationship between the frame gate and actual reliability. It is recommended to further analyze the gate's response under varying degrees of frame corruption or different levels of event consistency error.