- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper addresses self-supervised monocular depth estimation under adverse weather conditions, aiming to improve depth prediction robustness against weather-induced appearance variations. The authors propose SW-Mamba, a framework consisting of three main components: (1) State Propagation, which employs multidirectional Mamba to aggregate spatial context; (2) State Gating, which combines inter-frame RGB differences with spatial features to estimate correction weights; and (3) State Correction, which selectively updates latent features using clean references during training and spatially averaged feature proxies at inference. Experiments on WeatherKITTI, nuScenes, and DrivingStereo demonstrate improvements in depth estimation accuracy under adverse weather conditions, including zero-shot cross-dataset generalization, with relatively low computational overhead.
Critical strengths
- The paper addresses self-supervised monocular depth estimation under adverse weather conditions, which is a challenging and practically important problem for robust visual perception and autonomous driving.
- The proposed method achieves competitive or superior results compared with existing approaches across WeatherKITTI, nuScenes, and DrivingStereo, demonstrating improvements under various adverse weather conditions and promising cross-dataset generalization.
Critical weaknesses
- The paper identifies weather-induced violations of inter-frame photometric consistency as a major challenge in self-supervised depth estimation. However, the proposed method primarily corrects latent features without directly addressing unreliable photometric supervision. The connection between the identified problem and the proposed solution is not sufficiently established.
- The method relies on raw inter-frame RGB differences to guide weather-related feature correction. However, such differences can arise from camera motion, moving objects, and occlusions rather than weather corruption. For example, a moving vehicle or an occluded object may produce large frame differences, even though the corresponding features do not necessarily require weather-related correction. Conversely, severe but temporally stable degradations, such as dense fog, may produce relatively small frame differences. Therefore, the motivation for using raw frame differences as weather-related guidance is insufficiently justified.
- The method assumes that weather corruption is spatially irregular and temporally unstable. While this may hold for isolated raindrops or snowflakes, many adverse weather conditions, such as heavy rain and dense fog, affect large portions of an image. The paper does not adequately explain how the proposed mechanism handles these different degradation patterns.
- During inference, the method constructs reference features using local and global average pooling of weather-corrupted features. However, there is no convincing justification that spatial averaging can recover clean structural representations. For example, averaging cannot reliably remove widespread degradation caused by fog. Moreover, local averaging may suppress important geometric details, such as object boundaries and thin structures. In regions with large correction weights, the method may therefore replace useful geometric information with oversmoothed features.
- The paper lacks direct evidence that inter-frame differences can effectively identify weather-related corruption or that the predicted correction gates distinguish weather disturbances from genuine geometric changes. For example, visualizations of temporal cues and correction gates, as well as comparisons with geometry-aligned frame differences, would help validate the central hypothesis. Similarly, the authors do not directly demonstrate that the constructed reference features are more geometrically reliable than the original features. The existing ablations mainly demonstrate improvements in final depth accuracy rather than validating the claimed working mechanism.
Overall, although the proposed method achieves promising quantitative results across several benchmarks, I have substantial concerns about its methodological soundness and underlying motivation. Several key assumptions, particularly the use of inter-frame differences to identify weather corruption and spatially averaged features as reliable correction references, are neither sufficiently justified nor directly validated. Consequently, the reported performance improvements alone are not convincing evidence that the method operates according to the proposed selective weather-forgetting mechanism. The improvements may instead originate from additional feature modeling or regularization effects, rather than the claimed identification and correction of weather-corrupted representations.
Questions for authors
Please see the Weaknesses part.