- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors present VML, a framework that generates long street-level videos from a semantic map, a route, and an appearance description, using a frozen pretrained video DiT. The method relies on two mechanisms:
(i) A map compiler compiles the route into camera motions, and the surrounding map structure into segment-level text descriptions, a map-compatible initial image, and optional visual anchors, which are given as conditioning to the generator.
(ii) A map-guided velocity correction at inference time. The map is projected into the current camera view to obtain a road/building/vegetation occupancy target, a small pretrained structural predictor estimates occupancy from the predicted clean latent, and the gradient of the mismatch is used to correct the DiT's predicted velocity at each denoising step.
Long videos are generated autoregressively by chaining 5-second segments while refreshing the map-derived conditions. The method is evaluated on route following, map-specified scene content, and structural alignment.
Critical strengths
- Using maps as a persistent structural reference for long-horizon street generation is an interesting and practical idea, since maps are widely available and remain valid however far the viewpoint travels.
- The guidance is lightweight and simple: it only requires a relatively small structural predictor.
Critical weaknesses
- There are no external baselines: all results compare VML to its own variants without guidance or anchors, although map- and layout-conditioned street generation methods exist.
- The evaluation is small-scale: structural alignment uses four procedural layouts with three seeds, scene realization is reported as success counts on a few seeds, and route following is measured by mean pixel displacement.
- It's unclear which model computes the occupancy used for evaluation. If it is the same structural predictor used for guidance, the guidance directly optimizes the evaluation metric.
- Visual quality is not evaluated (e.g. no FVD/FID).
Questions for authors
- Could the authors compare against existing map- or layout-conditioned street generation methods?
- Could the authors measure route following with a camera-pose estimator, e.g., the trajectory error between the intended and recovered camera paths?
- Which model do the authors use to compute the occupancy for evaluation, and is it the same structural predictor used for guidance?
- Could the authors report structural alignment measured with an independent segmentation model?
- Could the authors report FVD/FID comparing guided and unguided generations?
- Figure 6 is an empty placeholder. Could the authors provide the Figure?