- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents SwiftWM, an event-guided latent world model framework for fast motion planning in autonomous driving that combines RGB-LiDAR data with Dynamic Vision Sensors (DVS). The proposed architecture comprises a BEV Encoder, a SAG Encoder, a Context Encoder, a Predictor, and a Diffusion Planner, which collectively perform multi-modal fusion to collaboratively predict the vehicle's trajectory and target speed. The authors evaluate their method on the closed-loop Bench2Drive benchmark and provide a breakdown of computational costs across each stage.
Critical strengths
- The paper addresses a meaningful and practical problem by exploring the fusion of RGB-LiDAR and event camera (DVS) data. Leveraging the complementary properties of standard frame-based cameras and event sensors is a well-motivated direction for autonomous driving.
- The authors provide insightful qualitative visualizations across driving scenarios, displaying telemetry plots (speed, acceleration, and braking) side-by-side against baseline methods.
- The ablation studies are thorough, examining computational overhead and planning latency, the number of solver steps for the diffusion path planner, the impact of event data inputs, and the encoder design.
Critical weaknesses
- Limited benchmark diversity: Evaluation is confined to a single synthetic closed-loop benchmark (Bench2Drive). The paper does not assess the model on standard real-world driving benchmarks such as NAVSIM (likely constrained by the absence of event camera data in current real-world datasets).
- Fairness of comparison and source of performance gain: Comparing against prior baselines raises fairness concerns, as none of them have access to DVS inputs. More critically, the ablation shows that SwiftWM without DVS (SwiftWM w/o DVS) underperforms existing baselines under identical sensor settings. This strongly suggests that the reported gains stem primarily from the addition of extra sensor hardware rather than core architectural contributions.
- Lack of sensor modality breakdown in benchmarks: Because the proposed framework leverages an additional modality, Table 2 should explicitly list the input modalities/sensor configurations utilized by each baseline to ensure a fair and transparent comparison.
- Unclear formulation and mathematical notation: Section 3 and Algorithm 1 are quite difficult to follow due to several undefined variables and mathematical operators. Furthermore, there is conflicting (e.g., vs. ) and overloaded notation, where identical symbols denote different entities between the equations and the pseudocode.
- Missing recent baselines: The empirical comparison lacks key recent baselines, such as HiP-AD [1], DiffRefiner [2], Bridgedrive [3] (in Table 4.).
Questions for authors
- Since SwiftWM underperforms existing baselines on an identical sensor footprint (without DVS), is the performance gain driven solely by the additional sensor hardware? Furthermore, while the abstract highlights a reduction in computation within isolated state-maintenance, Table 3 reveals that actual policy runtime only improves by (). How does this 144 ms end-to-end latency compare against the competing baselines in Table 2, and is 144 ms fast enough to claim "fast motion planning" for closed-loop reactive driving?
- Can you add comparisons against some missing baselines (such as HiP-AD [1], DiffRefiner [2], Bridgedrive [3]) on Bench2Drive in Table 4., and also add extra column to explicitly specify the sensor modalities used by each baseline?
- Can you thoroughly revise and streamline the mathematical notation and Algorithm 1 across Section 3, ensuring all variables and operators are clearly defined and consistently used, to make the method significantly easier for readers to follow?
- Given that the evaluation is currently restricted to the synthetic Bench2Drive benchmark, is it possible to provide validation on a real-world driving dataset to demonstrate how well your approach handles the sim-to-real gap same as previous baselines?
[1] Y. Tang, Z. Xu, Z. Meng and E. Cheng, "HiP-AD: Hierarchical and Multi-Granularity Planning with Deformable Attention for Autonomous Driving in a Single Decoder," 2025 IEEE/CVF International Conference on Computer Vision (ICCV)
[2] Yin, Liuhan, et al. "Diffrefiner: Coarse to fine trajectory planning via diffusion refinement with semantic interaction for end to end autonomous driving." Proceedings of the AAAI Conference on Artificial Intelligence.
[3] Liu, Shu, et al. "Bridgedrive: Diffusion bridge policy for closed-loop trajectory planning in autonomous driving." International Conference on Learning Representations. Vol. 2026. 2026.