- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes TCWeatherGen to mitigate small-target drift during weather augmentation while preserving the structural and semantic integrity of road scenes. The proposed framework addresses three major challenges: weakening of source-image evidence, competition among condition tokens, and area-dominated supervision. To overcome these limitations, TCWeatherGen integrates three complementary components: SegRGBHeat, SC-LoRA, and CATP. SegRGBHeat strengthens source-image guidance to preserve small-target details, while SC-LoRA minimizes interference among weather-conditioning signals. CATP addresses area-dominated supervision by emphasizing small yet critical objects during the generation process. Together, these components enable realistic weather augmentation while maintaining spatial consistency and improving the preservation of small targets under diverse weather conditions.
Critical strengths
-
The paper investigates target degradation during Diffusion Transformer (DiT) based weather editing, where critical objects such as vehicles, pedestrians, and traffic signs can be distorted even when the generated weather looks realistic. This is an important problem because such distortions can invalidate the original annotations and reduce the usefulness of synthetic data.
-
By emphasizing object-aware supervision and source-content preservation, the method targets a practical limitation of synthetic driving datasets: visually plausible images may still contain incorrect object geometry or semantics. Improving target consistency could make generated data more reliable for downstream detection and segmentation. Further, Achieved computational efficiency via Context AwareToken Pruning.
Critical weaknesses
-
The proposed method combines existing ideas. The paper needs to clarify what is the benefit of combining these methods over straight forward integration. Is there any theoretical guarantee that combining these methods would make annotations remain valid.
-
The qualitative figures shown, especially in figure 9 the traffic sign has no fog, rain, or snow. But realistic adverse-weather images should show weather effects on traffic signs, vehicles, pedestrians, and other objects when physically appropriate. The proposed generative approach may produce unrealistic images.
-
Sparse semantic anchors may fail to preserve small objects, such as distant traffic signs and pedestrians, and their precise boundaries, potentially compromising annotation validity and downstream perception.
-
Condition-token pruning may inadvertently remove tokens representing small or distant objects, such as traffic signs and pedestrians, potentially degrading image quality and annotation consistency.
-
The evaluation is limited to the ACDC dataset. Evaluating the method on additional autonomous-driving datasets would help establish its generalizability across different environments and adverse-weather conditions.
-
Although the authors report downstream detection and segmentation results, it remains unclear whether the original annotations are independently verified after weather editing. Can the authors provide direct evidence of annotation consistency, particularly for small and distant objects.
-
There are typographical mistakes Line 470, 374.
Questions for authors
-
The metrics used for evaluation FID, LIPSIS, SSIM measure the visual comparison. Further downstream metrics show perception performance. How can we verify that weather editing doesn’t distort annotated critical objects?
-
How can we ensure that preserving object structure does not suppress realistic weather effects?
-
Although downstream detection and segmentation results are reported, it remains unclear whether the original annotations are independently verified after weather editing. Provide direct evidence of annotation consistency, particularly for small and distant objects.