- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents DyRAD, a method for generating radar measurements from new viewpoints in dynamic driving scenes. It models static and moving objects using point reflectors and renders range-azimuth-Doppler (RAD) measurements. The method also uses a fixed point-spread function (PSF) to separate the scene representation from the radar sensor response. Experiments are conducted on RADIal, Boreas, and synthetic driving scenes.
Critical strengths
- The paper addresses an interesting and challenging problem. Existing radar novel-view synthesis methods either do not model Doppler for moving objects or assume static scenes. DyRAD addresses this gap by modeling object motion and Doppler together. The use of a fixed sensor PSF is also a sensible design choice.
- The experimental results are strong. On RADIal, DyRAD achieves a foreground hit rate of 90.7%, compared with 26.9% for the strongest prior baseline. The improvements in object-region reconstruction are also substantial. The authors also evaluate the method on Boreas, which uses a different radar system.
- I appreciate the effort to evaluate the method beyond the original sensor trajectory. The authors introduce a render-and-refit test on real data and a synthetic benchmark with ground truth at new viewpoints. The ablation studies are useful and cover the main components of the method. The paper also reports training time, rendering speed, and memory usage.
Critical weaknesses
- My main concern is the evaluation at new viewpoints. This is the central goal of the paper, but the authors do not have real radar measurements from the displaced viewpoints. Instead, they use a render-and-refit procedure. This is a useful test, but it does not directly verify whether the synthesized measurements at the new viewpoint are accurate. The direct off-path evaluation uses synthetic data with an idealized radar model. It is therefore difficult to judge how well the method would work in real driving scenes.
- The method uses existing object bounding-box annotations to initialize moving objects and their tracks. This is a reasonable assumption for offline scene reconstruction. However, the paper does not evaluate the impact of inaccurate or missing annotations. Since object assignments remain fixed during optimization, annotation errors could affect the reconstructed scene.
Questions for authors
- Have the authors considered evaluating DyRAD using real radar measurements collected from different viewpoints of the same scene? This would provide stronger evidence for the accuracy of the synthesized measurements.
- How sensitive is the method to errors in the provided object bounding boxes? What happens when a moving object is not annotated?
- In Table 10, DyRAD improves foreground hit rate considerably, but the joint detection F1 is almost unchanged compared with DyRAD-static (0.227 versus 0.223). The number of false-positive boxes also increases. Could the authors explain this result? Does it affect the usefulness of the synthesized data for downstream perception tasks?
- The sensor-configuration experiment in Table 16 is interesting. However, both configurations come from the same radar recordings. Would the method also work with a physically different radar sensor?
2 comments
Response to Authors and Final Assessment
Thank you for the detailed responses and additional experiments. The annotation robustness results and other clarifications address most of my concerns.
My main remaining concern is the lack of direct validation using real radar measurements from displaced viewpoints. I understand the dataset limitations and appreciate the proposed evaluation protocols.
Overall, the rebuttal has strengthened the paper. I will maintain my current rating.
n8x6 Response
We sincerely thank the reviewer for their insightful feedback and comments. Please see General Response 1 for sensitivity to box errors and for unannotated moving objects. We address the remaining questions below.
1. Real off-path validation
Answer. We agree that real measurements from displaced viewpoints would provide stronger validation. However, to the best of our knowledge, no public dataset provides synchronized RAD radar measurements of the same dynamic driving scene from different viewpoints.
Within this constraint, we evaluate off-path performance in two complementary ways that go beyond the on-path evaluation of prior radar NVS work. A real-data cycle protocol (Sec. 4.2) keeps the evaluation anchored in real measurements, and a synthetic benchmark (Appendix C.4) provides exact ground truth at displaced viewpoints under an idealized sensor model. We will release the synthetic benchmark to support future work on this problem.
2. Hit rate, F1 and false positives
Answer. Joint F1 is computed over all detections in the scene, and most of the scene is static, so better vehicle reconstruction barely changes global F1. Hit rate measures the vehicles directly, and there DyRAD improves from 22% to 75%.
A false-positive box is a vehicle box that contains predicted detections but no reference detections. For DyRAD, these are real vehicles whose rendered returns are just above the detection threshold while their reference returns are just below it (median 2.41 vs. 1.82 dB, threshold 2.0 dB). DyRAD-static has few such boxes because it rarely renders the vehicles at all. As noted in Sec. 4.2, this is the cost of the higher vehicle coverage. Its effect on downstream perception models remains to be evaluated.
3. Physical-sensor transfer
Answer. In principle, yes. DyRAD separates the scene representation from the sensor response, so a fitted scene can be rendered with another sensor’s PSF and sampling grid, as in the sensor-configuration experiment (Table 18 in the revised manuscript). To demonstrate this, we rendered two held-out RADIal frames with the PSF and sampling grid of the RaDelft radar, without refitting the scene (Appendix E.1, Figs. 12–13 of the revised manuscript). Validating the accuracy of such transfer requires paired recordings of the same scene from different physical sensors, which we plan to explore in future work.