- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
WeatherShift proposes a two-stage framework for generating transitional-weather driving videos. It first constructs frame-aligned extreme-weather references from nuScenes clips using depth-guided fog synthesis or prompt-driven weather editing with particle effects. It then estimates a weather-change mask and applies a temporal severity schedule to blend or transform the source and target weather states. Transitions between two non-sunny conditions are composed through an intermediate sunny state. The authors introduce nuScenes-WT, containing 20 directional transition categories generated from 1,000 front-camera nuScenes scenes, and evaluate both video preservation and downstream detection/segmentation behavior.
Critical strengths
None
Critical weaknesses
-
The methodological novelty is limited. The framework mainly consists of two parts: extreme-weather generation, which applies several customized transformations for a small set of weather types, and transition synthesis, which primarily performs temporal weighted blending between weather references. The overall design therefore appears to combine task-specific weather effects with a simple frame-wise transition mechanism, without a sufficiently novel modeling contribution.
-
The experimental comparison is insufficient. The quantitative metrics mainly measure scene and object preservation, but do not directly evaluate the quality or realism of the generated weather effects. The baselines are limited to general-purpose closed-source commercial video models, with no comparison against dedicated autonomous-driving generation or weather-simulation methods. In addition, the qualitative comparison figure is too low-resolution to support a reliable visual assessment.
Questions for authors
- How does the method compare with autonomous-driving generation and weather-editing approaches when the two stages are evaluated separately: extreme-weather generation and weather-transition synthesis?
- Can the authors report quantitative measures that directly assess the quality and realism of the generated weather effects, beyond scene and object preservation?
- What additional experimental results and evidence support the claimed improvements in downstream perception?
7 comments
Thank you for the authors' response. However, it did not provide additional useful information, so I will maintain my score.
Evaluation of Weather Realism, Generation Quality, and Temporal Consistency
We thank the reviewer for this important and insightful observation. We clarify that our initial focus on scene-preservation metrics was intended to establish a critical baseline ensuring that WeatherShift does not hallucinate objects or warp road geometry (a frequent failure mode of general-purpose video generators). However, to directly address the reviewer's concern regarding weather realism and temporal dynamics, we have expanded our evaluation across two dedicated axes:
- Temporal Coherence & Motion Consistency: To verify that our weather transitions evolve smoothly without flickering, warping, or ghosting artifacts, we incorporate RAFT Optical Flow Warping (OFW) Error ( vs. ), DINOv2 Feature Similarity ( vs. ), and the RAFT Flow Acceleration Ratio ( vs. ).
- Generation Quality & Realism Alignment: To rigorously assess whether our synthesized weather effects match real-world adverse conditions, we evaluate distributional alignment using Fréchet Inception Distance (FID), Kernel Inception Distance (KID), and CLIP Maximum Mean Discrepancy (CMMD) against established real-world benchmarks (ACDC and BDD100K).
To make these enhancements explicit, we have integrated the following quantitative evaluations into the revised manuscript:
1. Temporal Coherence and Motion Consistency (Table 4)
Evaluates frame-to-frame stability and motion preservation across transitional sequences.
| Metrics | RAFT OFW Error | DINOv2 Feature Similarity | RAFT Flow Acceleration Ratio |
|---|---|---|---|
| Discrete Baseline | 0.042 | 0.82 | 0.52 |
| NuScenes-WT (Ours) | 0.037 | 0.86 | 0.54 |
2. Generation Quality and Realism Alignment (Table 6)
Assesses distributional alignment across 100 scenes against real-world adverse-weather benchmarks.
| Dataset Comparison | FID | KID () | CMMD |
|---|---|---|---|
| nuScenes vs. ACDC | 65.30 | 22.71 | 0.72 |
| nuScenes vs. BDD100K | 75.15 | 15.18 | 0.61 |
| nuScenes-WT vs. ACDC | 90.55 | 28.10 | 0.83 |
| nuScenes-WT vs. BDD100K | 84.12 | 20.71 | 0.70 |
| nuScenes-WT vs. nuScenes | 8.14 | 8.00 | 0.002 |
By coupling these generation quality metrics with our content preservation scores, we demonstrate that WeatherShift achieves high weather realism without compromising structural scene integrity. We have updated Section 3 of the revised manuscript to include these analyses.
Response to Reviewer Comment: Methodological Novelty and Unified Framework Contributions of WeatherShift
We thank the reviewer for this observation. We would like to clarify that WeatherShift does not claim a novel standalone weather editor or a new mathematical blending operator. Rather, its contribution lies in integrating weather-specific reference synthesis, spatial weather-change localization, and temporally controlled transition composition into a unified framework for generating directional weather transitions in autonomous-driving videos.
Thus, the contribution is not the individual use of existing editing or blending operations, but their integration into a unified, severity-controlled framework for constructing spatially localized and temporally aligned weather transitions. The additional downstream perception experiments further demonstrate the practical necessity of these transitions: models trained on discrete weather conditions exhibit substantial performance degradation when evaluated on transitional-weather sequences, while nuScenes-WT provides a dedicated benchmark to train and evaluate perception under these evolving conditions.