- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PhyRF, a neural radar field framework for novel view synthesis of spinning FMCW radar. For points sampled along each radar beam, the field predicts occupancy, reflectivity, and a radar-specific artifact coefficient. A differentiable spectral renderer combines these predictions following FMCW measurement formation, summing the windowed DFT responses of all sampled points to form the range profile, instead of rendering each measurement point-wise. A LiDAR branch shares the geometry field to help disentangle scene structure from radar artifacts. Experiments on Boreas scenes under sunny, rainy, night, and snowy conditions show improvements over RadarFields, RF4D, and RadarSplat in rendering fidelity and occupancy estimation.
Critical strengths
- The motivation is clear and well illustrated: modeling radar-specific artifacts and the spectral formation of radar measurements, rather than producing overly clean point-wise renderings, addresses a real limitation of existing methods.
- The spectral renderer is grounded in FMCW measurement formation, and the ablation shows that it is the main source of improvement.
- The method consistently outperforms strong baselines across four weather and lighting conditions, and the qualitative results clearly show the roles of the artifact field and LiDAR guidance.
- The paper is well written and easy to follow.
Critical weaknesses
- Unfair evaluation and unvalidated LiDAR design. PhyRF uses LiDAR during training, while occupancy is evaluated against LiDAR and all baselines use radar only, which favors the proposed method. The claim that joint optimization is better than direct LiDAR supervision is not validated, and snowy scenes are handled by manually reducing the LiDAR weight to 0.2 rather than automatically. Moreover, the occupancy evaluation excludes snowy scenes, where this design matters most.
- Main motivation is not validated. The paper argues that preserving radar-specific artifacts reduces the synthetic-to-real gap for downstream tasks, but no downstream experiment (e.g., detection or odometry) is provided. In addition, PSNR and SSIM may reward reproducing random noise, so they may not fully reflect fidelity.
Questions for authors
- Are the LiDAR frames used for occupancy evaluation excluded from training? Can the authors report occupancy results without LiDAR supervision for a fair comparison with radar-only baselines?
- How does joint optimization compare with direct LiDAR occupancy supervision, especially in snowy scenes, and why is a manually reduced LiDAR weight still needed?
- Can the authors provide evidence that the synthesized measurements reduce the synthetic-to-real gap in a downstream task?
4 comments
(W2&Q3) Downstream task
To further evaluate the fidelity of our synthesized radar measurements, we use RLPR[1] and RaLF[2], which focus on place recognition. We select these works because both provide publicly available pretrained models evaluated on the Boreas dataset, enabling direct evaluation without retraining or finetuning. We use test frames from all 13 scenes as radar measurement queries and boreas-2020-12-18-13-44 as the LiDAR map reference. Note that boreas-2020-12-18-13-44 covers the same locations as the 13 test scenes but was collected on a different date. We follow each method's official preprocessing and evaluation protocols and report recall@1, defined as the percentage of queries whose top-ranked LiDAR database match falls within the distance threshold (3m) of the GT query location. To meet the data requirements of each method, we extend the maximum rendering range from 50 m to 90 m and retrain all baselines and our method using this new range. Table 3 shows the NVS results and downstream place recognition performance on RLPR and RaLF. Our method achieves the best performance across all metrics, followed by our radar-only variant (w/o LGL). In particular, for downstream task evaluation, our method achieves performance much closer to that obtained using GT radar measurements.
Table 3. Radar synthesis quality and downstream place recognition performance on test frames from 13 Boreas scenes.
| Method | PSNR | SSIM | RLPR Recall@1 | RaLF Recall@1 |
|---|---|---|---|---|
| GT measurements | -- | -- | 76.92 | 58.65 |
| RadarFields | 23.10 | 0.3113 | 60.58 | 34.62 |
| RF4D | 24.30 | 0.1974 | 60.58 | 27.88 |
| RadarSplat | 26.15 | 0.4936 | 69.23 | 39.42 |
| Ours (w/c LGL) | 27.05 | 0.5051 | 73.08 | 49.04 |
| Ours (full) | 27.20 | 0.5152 | 74.04 | 54.81 |
We have further added this analysis as a subsection in Sec. 5.5.
Reference:
[1] Qi, Z., et al. "RLPR: Radar-to-LiDAR Place Recognition via Two-Stage Asymmetric Cross-Modal Alignment for Autonomous Driving," in IEEE Robotics and Automation Letters, vol. 11, no. 8, pp. 9676–9683, 2026.
[2] A. Nayak, D. Cattaneo, A. Valada, "RaLF: Flow-based global and metric radar localization in LiDAR maps," in 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024, pp. 5097–5103.
The author clearly addressed my concerns, so I have raised my score to Clear acceptance.
Thank you so much for recognizing our work and increasing your rating! We sincerely appreciate your insightful suggestions for strengthening our work. Thank you again for your time and effort in reviewing our paper.
We sincerely thank you for the thorough evaluation and constructive feedback. Below, we address each concern with technical clarifications, experimental analysis, and necessary acknowledgments.
(W1&Q2) Comparison with direct LiDAR supervision
To validate our joint radar-LiDAR optimization strategy, we compare it with direct LiDAR occupancy supervision, where LiDAR measurements are used to generate occupancy map as directly supervison to the occupancy prediction. As shown in Table 1, while direct supervision also outperforms the radar-only variant (w/o LGL), our joint optimization achieves better performance across all scenes, demonstrating the benefit of learning shared geometry through joint radar-LiDAR optimization. Figure 11 in Appendix further shows that direct LiDAR supervision produces reasonable occupancy predictions in sunny conditions but introduces substantial noise and erroneous occupancy in snowy scenes due to unreliable LiDAR measurements. In contrast, our method produces cleaner and more accurate occupancy predictions under both conditions.
Table 1. Comparison between direct LiDAR occupancy supervision and our joint optimization strategy.
We have further included this analysis in Appendix A.8.
(W1) Reason for excluding snowy scenes
Following RadarSplat's evaluation protocol, we exclude snowy scenes from quantitative occupancy evaluation because LiDAR measurements are heavily affected by snow, making the constructed reference point clouds unreliable for assessing scene geometry.
To provide additional evidence under snowy conditions, we include qualitative comparisons with LiDAR-only reconstruction in Appendix Figure 14. The results show that our joint radar-LiDAR optimization produces cleaner geometry, suppressing snow-induced noise while preserving the main scene structures, whereas LiDAR-only reconstruction retains substantial noise.
(W1&Q2) Manual reduction of LiDAR weight in snow scenes
We clarify that manually reducing the LiDAR reconstruction weight is not required for our method to benefit from LGL under snowy conditions.
As shown in Table 2, using the same weight as in other weather conditions (λlidar=1) already improves PSNR from 25.80 to 26.65 compared with the radar-only variant (w/o LGL). Reducing the weight to 0.2 further improves PSNR to 26.77, mitigating the influence of unreliable LiDAR measurements in snowy conditions.
Therefore, the reduced weight provides an additional performance improvement rather than being necessary for LGL to work under snowy conditions.
Table 2. Ablation study of LiDAR-guided geometry learning (LGL) on the snow scenes.
We have further included this analysis in Appendix A.10.
(Q1) Are the LiDAR frames used for occupancy evaluation excluded from training?
Yes, the LiDAR frames used for occupancy evaluation are excluded during training. We follow the baseline method (RadarSplat) to construct LiDAR point cloud reference for occupancy evaluation and provide more details in Appendix A.12.
(Q1) Occupancy results without LiDAR supervision
Without LGL, our radar-only variant suffers from a degenerate solution where the predicted occupancy collapses to zero, as the artifact branch absorbs most radar information, as illustrated in Figs. 6 and 12. Consequently, meaningful occupancy metrics cannot be obtained for this configuration.
We acknowledge that this radar-only variant cannot reliably recover scene geometry. This observation further motivates LGL, which provides additional geometric constraints to prevent such degenerate solutions and improve the disentanglement of occupancy, reflectivity, and artifacts.