acceptodds
Withdrawn from ICLR 2027

RadarDreamer: Generative Radar World Model from Instantaneous Doppler

Withdrawn from ICLR 2027, so left out of the paper lists and the map.

Abstract

Sensor-level world models anticipate future observations for predictive perception, planning, data synthesis, and closed-loop simulation, yet their development has largely centered on visual, occupancy, and geometric spaces. Unlike passive visual observations, a single radar measurement already encodes both spatial structure and instantaneous radial motion, making native radar particularly informative for future observation generation. The challenge is twofold: RA and DA retain spatial and Doppler evidence only as shared-azimuth marginals, obscuring their underlying structure–motion association. Meanwhile, future echoes entangle predictable motion evolution with stochastic variations in visibility, reflectivity, multipath, and measurement noise. Our key insight is to exploit instantaneous Doppler as structured dynamics evidence for stochastic future generation. We present RadarDreamer, a conditional rectified-flow model that maps Gaussian radar videos to five coherent future RA+DA pairs. Exact multiband states preserve measurement coefficients, azimuth-indexed coupling exchanges spatial and Doppler evidence while retaining their axis semantics, and radar-aware objectives constrain sparse innovation, temporal evolution, response structure, and projection consistency. On ColoRadar, spatial–Doppler coupling reduces CRPS by 2.16% and improves expected-sample innovation F1 by 10.98% over an architecture-matched generator, while a single RA+DA observation reduces joint log-MAE by 5.86% relative to five-frame RA history. Together with four-domain rollouts, these results demonstrate improved motion fidelity and measurement realism, establishing conditional native-radar generation as a predictive sensing primitive for radar-centric world models.

Primary area:
applications to computer vision, audio, language, and other modalities
Keywords:
Radar Generation

Reviews

Among:
Shape:
1234this paper, Bottom 2%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.33 over 3 reviews, above 2% of the others.
Reviewer_ZhBnOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes RadarDreamer, a generative model for predicting future native radar observations from a single current RA+DA measurement. The method uses a conditional rectified-flow model with azimuth-indexed spatial–Doppler coupling and radar-specific objectives to jointly generate five future RA/DA pairs. Experiments on several radar datasets show that instantaneous Doppler improves future radar prediction and that the proposed coupling improves distributional and innovation-related metrics.

Critical strengths

The paper provides a technically careful formulation of stochastic native-radar prediction. In particular, the spatial–Doppler coupling is well motivated by the shared azimuth structure of RA and DA, and the controlled experiments provide evidence that instantaneous Doppler contains useful information for short-term radar forecasting.

The evaluation is also reasonably thorough at the radar-generation level, including distributional metrics, Doppler interventions, horizon-wise analysis, and experiments across multiple radar domains.

Critical weaknesses

1.The downstream value is unclear. The paper shows that RadarDreamer can generate more realistic future radar observations, but does not demonstrate benefits for detection, tracking, occupancy prediction, planning, or data augmentation. It is therefore unclear whether the improved radar-generation metrics translate into practical gains.

2.The “world model” claim is somewhat overstated. The model predicts future RA+DA only from the current observation, without conditioning on ego actions or future motion. This limits its use for counterfactual planning or closed-loop simulation.

Questions for authors

1.Can the authors show a concrete downstream benefit of the generated radar futures, e.g., for perception or planning?

2.How can the model support planning or closed-loop simulation without action or ego-motion conditioning?

3.What is the practical value of forecasting only about 0.5–1 s into the future compared with simpler motion or occupancy prediction?

Reviewer_5km6OpenReview ↗
Rating
1
Confidence
4
Informativeness
2
Presentation
1
Soundness
2
Read review
Paper summary

A flow model for radar signal generation of future 5 frames, conditioned on a single frame. The radar representation is an RA+DA pair. The model processes both predcition channels (RA,DA) while structuring communication between the two to shared azimuths. Frames are embedded using wavelet bases. Ablations show benefits of this design compared to an uncoupled predcition.

Critical strengths

(+) the work tackles an important capability: generating RA+DA radar forecast which is an important ingredient towards building a simulation environment. (+) the motivation to use a generative model is well justified and the authors exemplify it in figure 5 with real cases collected from the validation set.
(+) The paper uses an interesting design of the network that couples the generated channels through their shared azimuth entries. The coupling ablation improves both distributional scores and expected-sample innovation F1, supporting the usefulness of the proposed design.

Critical weaknesses

(-) My biggest concern is the most naive baseline of simply freezing the input for 5 frames -- what the authors refer to as "persistance". I searched for a proper comparison with it. It appears once in table 2 but that table compares only deterministic regressors which aren't the main proposed method. More broadly, Table 2 contains learned forecasting baselines but excludes RadarDreamer itself. Thus, it does not establish how the proposed generator performs against these predictors under a common evaluation protocol. And then again in table 12 in the appendix where the naive persistence model actually wins over the proposed method in most settings on MAE. RadarDreamer improves CRPS across all four domains, however, average sample MAE worsens in both evaluated modalities for three domains. RaDelft improves on cropped support, while its full-grid RA error worsens. In particular I did not appreciate that Figure 3 shows only gains of the method in MAE. This seeming contradiction between the table and figure pointed to the phrasing in the appendix about the selection of the "displayed anchor" which to my understanding is another way to say Figure 3 shows the validation examples with the overall best result. I ask that the authors replace this visualization with a general case result, or clearly state that this is cherry picked. I also stress the importance of adding persistence as proper baseline in the full evaluation protocol rather than the reduced 32 samples of table 12. Without it, there's too little evidence the generator is doing real work beyond a mere frame duplication baseline.

(-) Those methods referred to as baselines aren't described sufficiently and it is very difficult to understand what exactly they do. Sections 4.1 and 4.2 interpret results before adequately introducing the compared models and experimental controls. The preceding paragraph lists model names without explaining their construction, conditioning inputs, or training objectives. Specifically for "independent" my understanding is there is no communication between the RA and DA, but does the model see both inputs from the input frame? Also, I would consider this ablation rather than a baseline. Table 1 indeed is referred from both 4.1 and 4.2.

(-) The authors never really demonstrate any of the applications mentioned in the intro (perception, planning, etc). The chosen setup of predicting future 5 frames from a single frame is also puzzling. In reality, if one assumes an initial radar measurement to condition the generation this rules out "from-scratch" creation of novel scenes (e.g. through text to radar). So the implicit assumption is that there' s access to recorded radar, which brings up the question -- why a single frame rather than a longer past trajectory? Table 2 shows (in a deterministic setting) that if the past frames contain only RA, then a single RA+DA frame works better. but i see no reason why past frames that have both DA and RA won't work even better and why not use them? Without it I doubt the model is useful as a world model. Specifically, world models are expected to produce longer rollouts than 5 future frames so a single frame conditioning would prohibit utilizing past knowledge that could be instrumental to handling targets under temporary occlusions for example.

(-) The ego motion isn't used in the condition however it governs significant parts of the scene doppler. I would like to see a version of the method that uses ego velocity as a condition. This should be readily available in the data.

(-) flow models have a prescribed loss term. However, the one proposed by the authors in 16+17 modifies it which could (and the authors say so themselves) steer it away from the desired target distribution. The paper should discuss and show this trade-off by measuring the flow model performance with and without it.

(-) Prior radar neural fields work are missing including Neuradar, RadarSplat, RadarFields. in the diffusion/flow literature, the recent work RadarGen is missing. Beyond adding these citations, the paper should explain more carefully how forecasting future observations differs from reconstructing scenes and rendering measurements at new viewpoints, identifying the relevant differences in inputs, outputs, and temporal modeling.

(-) The choice of RA+DA is insufficiently justified. Equation 1 derives these projections from the available full RAD tensor, discarding range-Doppler associations. The paper then makes this induced ambiguity central to its motivation (proposition 1), without demonstrating the benefits of that trade-off. A comparison of RA+DA, RA+RD, and full-RAD conditioning, including prediction accuracy and computational cost, is needed. Full-RAD conditioning could also be used while retaining projected outputs, so generating complete future cubes is not the only alternative.

Minor: (-) the key insight is somewhat underwhelming. "Doppler exposes motion tendency before displacement becomes visible" and that it is a condition for future motion. This is not an insight as much as a statement about what doppler is.

(-) Another concern is data size. looking at the Data section of this work, this is still small scale. The authors report generation on held out sequences but I would want to see held out scenes, not just sequences.

Writing: (-) the authors seem to utilize some jargon which I as a computer vision researcher was unfamiliar with, like calling deterministic prediction, a point baseline. Similarly, “Gaussian radar video” is confusing wording. The authors appear to mean Gaussian noise shaped like the encoded future sequence. I'm pretty sure this will throw off other readers.
(-) key definitions are lacking. For example, innovation-balanced is barely explained in the main paper but is still used in captions and tables. This makes the paper very hard to follow. (-) multiple parts of the paper, especially the intro and abstract are quite hard to follow. For example, the whole paper around Corollary 1 is cryptic. Destd isn't explained. (-) describing a world model without the agent's action is untraditional (-) The method is tightly coupled to the specific choice of RA+DA and doesn't discuss how particular vs general this choice is. I think this doesn’t belong under writing – moved it to the major weakness (-) Proposition 1 formalizes the information loss introduced by the RA+DA projections, but its presentation feels unnecessarily elaborate for a straightforward observation. A simple example would communicate the intuition more clearly in the main text, with the formal statement and proof moved to the appendix.

Questions for authors

see weaknesses

Reviewer_2aaiOpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

This work proposes a radar world model to predict future range-azimuth maps and azimuth-doppler maps.

Critical strengths

N/A

Critical weaknesses

I believe that this work is AI-generated with very poor quality, for the following reasons:

  1. The main figure (Figure1 part d) include random things like radar safeguards which were not never explained in the main paper.
  2. The overall research problem is very weird. In radar sensing, range-azimuth-doppler tensors are usually used, but this work separates the tensor to range-azimuth and propose to recover the coupling between range and doppler. Why not just generate range-doppler maps instead? It doesn't make any sense to me at all.
  3. The method and experiments are difficult to follow by human.
  4. Hallucination: The baseline methods come from nowhere, and there is no reference at all. 
    
  5. Besides, no ablation study is provided.
    
Questions for authors

Please see weaknesses.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Discussion (0)

Sign in to comment.