- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RaViP-Bridge for generating complete 4D radar tensors from camera sequences. It extracts depth, semantic, and motion cues from images, projects them into a radar-aligned visual prior, and translates the visual latent into a radar latent using a diffusion bridge. Experiments on K-Radar show improved tensor reconstruction over controlled baselines and modest gains when the generated radar is used for downstream detection augmentation.
Critical strengths
The paper explores an interesting cross-modal generation problem and targets complete 4D radar tensors rather than simplified radar maps or point clouds. The downstream experiments with both radar-only and camera-radar detectors are also useful.
Critical weaknesses
1.The practical value of image-to-radar generation is not yet convincing. The model itself is trained on paired camera–radar data, while the claimed motivation is large-scale radar data expansion from inexpensive camera data. The paper does not show whether a model trained on K-Radar can generate useful radar for a new camera-only dataset or an unseen domain. Without such an experiment, the data-scarcity argument is somewhat circular.
2.The reliance on visual priors is problematic for the scenarios where radar is most useful. RaViP-Bridge depends heavily on monocular depth, segmentation, and optical flow. These cues can become unreliable in adverse weather or poor illumination, while radar is specifically valuable under such conditions. The paper does not provide weather-wise results on K-Radar, and the 9,008-sample subset only retains samples for which the visual prior can be constructed. It is therefore unclear how the method behaves on visually degraded K-Radar scenes.
Questions for authors
1.Can the authors evaluate the model on a truly camera-only dataset or an unseen domain to demonstrate actual radar dataset expansion?
2.How does performance vary across K-Radar weather conditions, especially scenes where the camera is severely degraded?
3.Are the train/validation/test splits sequence-disjoint? Since K-Radar contains temporally adjacent frames, this is important for assessing possible train-test overlap.
4.How should the generated tensors be interpreted when radar responses arise from effects not observable in RGB, such as multipath or material-dependent reflections?
2 comments
I appreciate the authors' efforts in providing detailed additional experiments. However, I remain concerned about the practical value of generating radar data from images, as its significance has not been sufficiently demonstrated. Furthermore, I have doubts about the generalization capability of a model trained solely on the Kradar dataset. Therefore, I will maintain my original rating.
Thank you for your careful review and your questions about dataset expansion and low visibility.
For the first question, paired camera and radar data are used for training. Once trained, the model needs only image pairs and calibration to generate radar. We have added generation examples from Nexar driving videos using the model trained on K-Radar (Figure 4, p. 10). These videos have no paired radar for computing generation error, so we provide qualitative results. A key advantage of generating radar from images is that the input images are highly editable. We can add, remove, or replace objects before generation to control the object configurations in the added training samples, as shown in Figure 5 (p. 10) and Appendix G.5 (p. 24). We further added a detection experiment with scarce Bus/Truck examples. With the same training sample count, edited generation outperforms class repetition; Table 5 (p. 10) reports mean ± std over three seeds.
For the second question, our model needs visible scene information. The dark tunnel case in Appendix H.2 (p. 26) shows how low visibility affects generation. Weather affects generation when it obscures the scene. When severe frost makes the camera image nearly white, the visual prior cannot provide useful scene information. Light rain and light snow cause little radar power attenuation over short automotive ranges; we discuss the supporting measurements in Appendix H.2 (p. 26). We can therefore use images with sufficient visibility to generate additional radar training samples.
We also evaluated RTNH in severe weather using models trained on normal weather data. The model trained with augmentation achieves higher AP for both classes across the 37 severe weather test scenes (Table 4, p. 9). We can also edit the input images to add examples of rare object configurations. The class scarcity experiment in Table 5 (p. 10) shows the resulting detection gains.
For the third question, we use a chronological split within each scene. Training, validation, and test frames occupy successive time blocks and do not overlap. The split is described in Section 4.1 (p. 6) and Appendix A.1 (p. 14), with the split files provided in the supplementary material.
For the fourth question, images do not uniquely determine multipath or material differences between individual objects. We assign representative permittivity priors by semantic category, while the model learns the remaining effects from paired data. We therefore interpret the generated tensor as an estimate of radar responses given the visible scene cues (Section 4.6, p. 10; Appendix B.2, pp. 14–15). We would like to study more detailed material and propagation models.