- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes OneFixer for refining 3DGS renderings in driving simulation with one-step autoregressive video diffusion. It builds on the pretrained causal OmniDreams model and uses a single task-specific training stage. Self-rollout flow matching uses the model’s own predictions as history. Perceptual supervision improves image details on the same rollout. Lane and actor conditions help preserve scene geometry. Experiments on Waymo and a private Seoul dataset report better one-step video quality and competitive temporal consistency. Closed-loop tests also report fewer collisions.
Critical strengths
S1. Shared-rollout training connects image quality with temporal consistency. It trains on the model’s own predictions and directly supervises their visual quality. This addresses both poor one-step outputs and error accumulation without an extra distillation stage.
S2. The paper includes same-backbone comparisons and component ablations. These provide useful evidence for the training design. Evaluation on 900-frame videos also supports its ability to handle sequences much longer than the training clips.
Critical weaknesses
W1. The methodological contribution appears incremental.
- The causal backbone and geometry conditioning come from OmniDreams, while opacity mixing follows ArtiFixer. The main new element is combining self-generated history and perceptual supervision in one training stage.
- The paper does not compare against Self-Forcing with the same perceptual supervision. It would clarify whether the advantage comes from the shared-rollout design or mainly from the additional loss.
W2. The experiments do not fully support the claim of faithful novel-view simulation. The main tests use a fixed 1 m cycle-render setup on Waymo and logged views on Seoul. Reliability under larger viewpoint shifts remains unclear. Table 1 also lacks a raw 3DGS baseline, making it difficult to verify improvements in vehicle and lane accuracy over the input.
Questions for authors
I noticed significant background jitter even in static scenes in the supplementary video. Is this caused by poor temporal consistency?
3 comments
Thanks for the response. Most of my concerns have been addressed. However, the novelty still seems limited, so I will maintain my rating of 3.
Thank you for your follow-up and for acknowledging that most of your concerns have been addressed.
While the individual components build on prior work, we believe the key contribution lies in their integration into a deployment-matched, single-stage training formulation that jointly improves perceptual fidelity and temporal consistency without distillation. Importantly, despite its simpler training procedure, OneFixer achieves stronger empirical results than multi-stage distillation-based methods, demonstrating that improved performance does not necessarily require increased training complexity. Beyond perceptual metrics, the improvements also translate into more reliable closed-loop driving simulation, as evidenced by reduced collision and off-road rates. We believe these findings highlight both the methodological and practical significance of our approach.
We hope the additional controlled experiments, particularly the shared-vs.-independent rollout ablation (V7-J vs. V9) and the DMD+LPIPS comparison, help clarify the distinct contribution and practical significance of our approach.
Thank you again for your constructive feedback, which has helped us strengthen both the evaluation and positioning of the paper.
Response to Reviewer jhYx
W1.1: Methodological novelty
We agree that the backbone/geometry conditioning come from OmniDreams, opacity mixing from ArtiFixer, and the individual training components are established.
We rewrote the abstract and added Sec. 2.4 to clarify our contribution: the informative 3DGS flow source enables deployment-matched one-step self-rollout, allowing joint FM + LPIPS on the same generated history, with perceptual gradients through k=4 positions, without multi-stage distillation. This provides simpler, low-latency training for both perceptual fidelity and temporal stability.
W1.2: Attribution of improvements
We revised Sec. 4.3 to disentangle flow-source feasibility, objective effects, and rollout optimization. We also added Self-Forcing + LPIPS, V7-J, and training diagnostics (Apps. B.1–B.2).
LPIPS alone is insufficient: the full DMD+LPIPS schedule yields modest gains, and Fig. 6(c) shows that it remains behind OneFixer on both validation FVD and LPIPS despite higher cumulative GPU-hours.
More directly, V7-J → OneFixer isolates rollout sharing, improving LPIPS 0.127 → 0.117 and FVMD 178 → 158. The combined formulation achieves the best FVD and FVMD simultaneously among controlled variants, without trading perceptual fidelity for temporal stability.
W2: Larger novel views and geometric accuracy
We strengthen the experiments in two ways:
Raw 3DGS baseline (Table 1). We add unrefined inputs and annotation-referenced geometry evaluation. On Waymo, OneFixer improves 3D AP$_{50}$ from 2.46 to 6.37 and Lane F1 from 0.554 to 0.738; on Seoul, from 19.25 to 29.71 and 0.218 to 0.371, respectively.
Larger viewpoint shifts (new Fig. 7). We extend Waymo cycle rendering to 1, 2, and 4 m, using the same reference-view evaluation protocol. OneFixer achieves the best FVD, LPIPS, 3D AP$_{50}$, and Lane F1 at every tested displacement, including 4 m, although performance degrades with larger shifts for all methods.
These results strengthen evidence of robustness beyond 1 m; cycle rendering does not exhaustively evaluate arbitrary unseen viewpoints.
Q1: Background jitter in static scenes
We acknowledge residual appearance flickering, particularly when the input 3DGS is severely corrupted or incomplete. Importantly, this issue is not unique to OneFixer: competing fixers also exhibit temporal instability under these challenging conditions. To make this limitation and the differences between methods transparent, we add static_scenes.mp4 to the supplementary material, showing the input, ground truth, DiFix, One-Forcing, and OneFixer side by side for direct temporal inspection.
LPIPS: AlexNet vs. GT (stride 10). Flicker proxy: mean grayscale temporal second difference, ∣It−21(It−1+It+1)∣, on a 0–255 scale (lower is better). It also responds to camera/object motion.
OneFixer achieves the lowest LPIPS in both examples and substantially reduces DiFix's temporal variation. One-Forcing has slightly lower flicker in scene 190778, so we claim improved temporal consistency, not complete flicker elimination.
We have explicitly added this limitation and future-work direction to Sec. 5 (Conclusion and Limitations). In particular, reference-view anchoring, as explored in DiFix, ArtiFixer, and Seoul World Model, could further stabilize appearance when the input 3DGS is severely degraded.