- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MeteoVerse, a weather-controllable video generation model which takes a single image, a weather-free scene description, a target-weather instruction, and a camera trajectory. Built upon LingBot-World, it freezes the original backbone weights and trains LoRA adapters together with a weather-conditioning module, MeteoMoE. A weather-state predictor estimates source and target rain, snow, and fog intensities. Their difference modulates category-specific weather features injected into the video backbone. The authors also construct a dataset from over 50K real adverse-weather clips and generated sunny counterparts. Experiments evaluate weather preservation, introduction, and removal.
Critical strengths
- MeteoVerse supports adverse-weather inputs and weather removal. It unifies weather preservation, introduction, and removal within one model.
- MeteoVerse achieves great Weather Alignment performance on both qualitative results and quantitative scores, in introduction and removal tasks
Critical weaknesses
- The metrics of Weather Alignment: In Table 2, target-weather text conditioning achieves 80.85% Weather Alignment, nearly matching the proposed transition representation at 81.00%. Although VLM and human scores improve, no uncertainty estimates are provided. Intuitively, the parameter-based guidance should provide a more smooth control to the results and the images in Figure 5 can support this conclusion. However, the value itself does not strongly support it since the improvement is limited.
- The quality of the pseudo-paired training data is insufficiently validated. Sunny counterparts are generated by editing the first adverse-weather frame and synthesizing a new video with LingBot-World. This procedure does not ensure that object motion, geometry, and newly visible content remain aligned with the original video. The paper describes filtering but provides no quantitative audit of pair correspondence, scene preservation, or filtering effectiveness. Consequently, the extent to which supervision isolates weather changes from unrelated content changes remains unclear.
- The demonstrated transition coverage is limited. Training and evaluation focus on clear-to-adverse, adverse-to-clear, and preservation settings. The adverse-to-adverse benchmark evaluates preservation rather than changes between weather categories. There is no systematic evaluation of rain-to-snow transfer, partial intensity reduction from an adverse input, or selective removal within mixed weather. These cases would directly test the proposed multicomponent transition formulation.
- Fine-grained weather control lacks quantitative validation. Intensity control is primarily demonstrated through selected visual examples. Weather Alignment measures the presence of the requested condition, while the VLM score combines several qualitative criteria; neither directly measures achieved intensity. The predictor’s intensity MAE does not establish that generated videos follow the requested intensity. Calibration, monotonicity, and cross-category interference remain unmeasured.
Questions for authors
Please refer to my weaknesses and concern about the following questions:
- How are generated sunny image/video pairs assessed for preservation of geometry and object motion? Please provide filtering acceptance rates and a quantitative or human audit of correspondence quality. How are camera trajectories assigned to the cross-weather training pairs after re-estimation?
- How does MeteoVerse compare directly with the Nano Banana 2 → LingBot-World pipeline used to construct sunny training targets, particularly for weather removal, scene preservation, and inference cost?
- Can the model perform cross-category transitions, reduce existing weather intensity, or independently manipulate mixed weather? For example, translate a rainy weather to a snowy weather Please provide quantitative intensity-following and monotonicity results across multiple scenes.