- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
MmWave human-sensing models require large amounts of annotated radar data, but real data are scarce and synthetic data often suffer from a substantial sim-to-real gap. This paper presents 4DPS, a differentiable radar inverse-rendering framework for dynamic human micro-Doppler. Unlike prior radar inverse renderers that mainly model static scenes, 4DPS introduces explicit velocity into a point-based scene representation, where oriented points carry material, surface normal, and motion parameters. The method initializes geometry from synchronized camera observations and optimizes the dynamic scene and radar-related parameters against real radar captures. To make dynamic fitting tractable, it derives a closed-form range–Doppler splatting formulation that avoids explicitly rendering every chirp. This enables corpus-scale reconstruction of moving humans while substantially improving radar rendering fidelity and downstream sim-to-real performance.
Critical strengths
- The experimental evaluation is comprehensive. The paper validates 4DPS on two radar datasets, multiple signal representations, downstream sim-to-real transfer, ablations, and runtime analysis, with a quite complete supplement.
- The technical novelty and motivation are clear. The paper extends differentiable radar inverse rendering from static scenes to moving humans by introducing explicit differentiable velocity into the point representation and deriving a closed-form range–Doppler splatting formulation. This directly addresses the key limitation of prior static inverse renderers and provides a convincing motivation for reducing the sim-to-real gap of synthetic human radar data.
Critical weaknesses
- The major concern is that the external comparison is too narrow. The quantitative evaluation relies essentially on RF-Genesis as the only baseline. Although Appendix C.2 explains why a fully matched inverse-rendering baseline is unavailable, this still weakens the empirical positioning.
- 4DPS optimizes materials, surface normals, gains, velocities, and a learned noise floor, while important real-world effects such as multipath reflections are not explicitly modeled. As a result, some fitted “physical” parameters may partly absorb unmodeled propagation or calibration effects rather than correspond to physically meaningful quantities. The paper does not clearly disentangle physically correct modeling from data-driven compensation for model mismatch.
- Although the paper models the average noise floor, it does not explicitly model complex multipath reflections that are common in real radar measurements. The rendered-trained models still underperform real-trained ones substantially, but the paper does not quantify which signal statistics or propagation effects dominate this remaining gap.
- 4DPS still requires a reconstructed human mesh, static scene geometry, synchronized sensing, and sequence-level calibration against real radar data. In realistic deployments with diverse subjects, clothing, body shapes, and environments, repeatedly obtaining these inputs and refitting the renderer may substantially reduce the claimed data-collection savings. The current experiments do not show how much of same- subject/scene calibration can be reused across new subjects or environments.
Questions for authors
- Could the authors broaden the forward-simulation comparison? In particular, adapted comparisons with mmSim (Cui et al., 2023), FMCW-MIMO-Radar-Simulation (Kurtoglu et al., 2022), Controllable Radar Simulation with Waveform Parameter Embedding (Xiao et al., 2025), and 4D Radar Simulator for Human Activity Recognition (Zhou and Le Kernec, 2024) would better isolate the benefit of real-capture fitting over conventional simulation.
- Have the authors considered explicitly parameterizing or modeling additional real-world radar effects, such as multipath reflections and other interference factors, rather than letting the existing fitted parameters implicitly absorb them?
- How well do fitted parameters transfer across different subjects and genuinely different environments? For example, can person-specific parameters calibrated on one subject or scene/radar parameters calibrated in one room be reused without full refitting?
3 comments
Thank you to the authors for their detailed responses and clarifications.
One of the main contributions of this paper is to improve the convenience and diversity of mmWave radar data generation. However, the limitation that fitted parameters cannot transfer across different subjects or environments inevitably restricts these advantages. Therefore, I still believe this is an important limitation that warrants further investigation and analysis.
Nevertheless, given the theoretical soundness and the distinctive contributions of the proposed method, I will maintain my original score.
We thank the reviewer for the follow-up and for maintaining the score. We agree that transferring fitted parameters across people and environments is important: until it is possible, 4DPS increases data diversity along the motion axis only, within each recorded person and scene. Even within that scope, one radar recording per person and scene is enough to render the remaining motions, which lowers RT-Pose error from 30.3 to 20.9 cm and raises HuPR AP from 36.3 to 43.7 (Sec. 4.4), and a new person or environment needs only one synchronized camera–radar recording.
In the revised PDF (link), Limitations and future work (Sec. 5) now states that transferring fitted parameters across people and environments is out of scope and left to future work, and App. I discusses this in greater detail.
Response to Reviewer hRH6
We thank the reviewer for the detailed review and the positive assessment of the evaluation. The general response (link) answers shared points as G1–G5.
W1: “The major concern is that the external comparison is too narrow. [...]”
Q1: “Could the authors broaden the forward-simulation comparison? [...]”
Answer: The four simulators you name cannot run here, but the benefit of fitting over conventional simulation is already isolated in the paper by our unfit render. RF-Genesis is the only released simulator that takes explicit recorded motion and arrays and outputs raw ADC (App. C.2). Thank you for the four references (G3): three synthesize every chirp in CPU loops, intractable at 584 million chirps, and Ctrl-RS outputs no ADC or elevation. We will add all four to Sec. 2 and App. C.2. In the unfit render (Sec. 4.1, Table 2), fitting raises micro-Doppler ρS from 0.754 to 0.988 (HuPR) and from 0.515 to 0.966 (RT-Pose). On scale, other radar inverse renderers fit far less data: 3DPS 9,216 chirps and mmIR 2,496, against 584 million for 4DPS over 335 sequences (Sec. 3.3).
W2: “fitted ‘physical’ parameters may partly absorb unmodeled propagation [...]”
W3: “[...] does not quantify which [...] effects dominate this remaining gap.”
Q2: “[...] explicitly parameterizing or modeling [...] multipath reflections [...]?”
Answer: We render single bounces by design, as 3DPS and RadarSplat do and as mmIR finds sufficient; fitted parameters can absorb what the model leaves out, and we will say so in App. I. Single-bounce transport is a deliberate choice that prior radar inverse renderers share: mmIR, which traces up to three bounces, finds on its seven outdoor scenes that a single bounce loses no accuracy (range–azimuth ρ 0.936 vs. 0.919 full); 3DPS renders single bounces only; RadarSplat also renders single bounces only, treating multipath as noise that it filters out before fitting and adds back to its single-bounce render for evaluation (removing it moves PSNR only from 26.06 to 25.95). One bounce is part of what makes fitting 584 million chirps tractable. The parameters are constrained to stay physical (ITU-R P.2040 materials, fixed positions, bounded velocities; Table 5) and explicit, and a scene fitted on one recording explains another of the same room at 90% and 92% of its own range–azimuth ρ with nothing refitted (App. G.1, Table 19).
The paper locates the remaining gap but does not separate propagation from motion error, and we will state that. The deficit sits in the arms, while hips, knees and the head keep 0.73–0.80 of real-trained AP (Fig. 4, Table 13), and rendered- and real-trained models compute the same features from the backbone onward (Sec. 4.3, Table 4).
W4: “[...] how much of same-subject/scene calibration can be reused across new subjects or environments.”
Q3: “How well do fitted parameters transfer across different subjects and genuinely different environments? [...]”
Answer: Fitted parameters do not transfer across people or environments; they transfer across motions of the same person in the same scene, which is where data is saved. Differentiable rendering is scene-specific. A fit is specific to its person and scene, as for mmIR, 3DPS, Radar Fields and RadarSplat (G5); we will state this in App. I. Per session, 4DPS needs one synchronized camera–radar recording; the mesh comes from the video, and calibration is the fit itself. These are per session, not per motion. With one radar recording per person and scene and the other motions rendered, RT-Pose error falls from 30.3 to 20.9 cm, within 4.6 cm of recording every sequence, and HuPR AP rises from 36.3 to 43.7 (G1). We will add this to Sec. 4.2.
Thank you again for the thorough review and the references.