- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper presents an effective action representation and local residual refinement. However, the paper does not sufficiently explain why the decomposition of the visual motion scaffold and the residual improves performance. Moreover, the limited testing on the nuplan (navsim) dataset cannot fully support the claimed benefits of the action generation.
Critical strengths
-
The paper focuses a key problem in current WAM models: the gap between the action and video modalities. It proposes a residual-based design to improve action generation.
-
The experiments discuss most issues in detail and present clear results. The experimental analysis is fairly complete.
-
The paper has clear figures. The animations on the anonymous website make the main design easy to understand. The 3D architecture diagram in Figure 3 is memorable.
Critical weaknesses
-
The title is too broad. First, the experiments only cover autonomous driving. The paper does not discuss action generation in other domains, such as robot navigation and manipulation, so the title should narrow its scope. Second, the paper addresses the gap between action and video only by improving action generation. It does not improve video generation or the WAM architecture itself. This makes “visual motion” somewhat unclear, and a more specific title would help.
-
The main idea is to add a residual module that corrects a trajectory scaffold derived from visual information while preserving the original scaffold. The key question is why this extra module is needed. Its inputs are largely the same as those of the action expert, and it does not introduce additional prior information. The paper should therefore compare this design with directly improving the original WAM action expert or trajectory tokenization. It should explain the limits of these alternatives and provide corresponding baselines. The need for the extra residual module has not yet been clearly demonstrated. Moreover, the contribution of the residual design is not new. We have seen a very similar design in ResAD and PLD (Probe, Learn, Distill), and the VITAL paper seems like an implementation under WAM.
-
The paper focuses on action refinement. This should be especially useful on navhard, where precise trajectories matter and small deviations can cause collisions. However, RL does not improve performance on navhard. Increasing the number of training steps after RL even reduces performance.
-
The paper does not change the WAM architecture itself. Its main improvements are in action generation and refinement, so testing generalization across different datasets is especially important. The evaluation should include datasets such as WOD-E2E or closed-loop benchmarks such as Bench2Drive, rather than only nuPlan.
-
The paper also notes that the residual module cannot fully correct a scaffold when its error is too large. Does this suggest that correcting only the action modality is insufficient for WAM? Improving both video generation and action generation during training may be necessary to achieve better action outputs, instead of focusing only on action refinement.
Questions for authors
Please refer to the weaknesses section. I am willing to raise the score if the authors can address my concerns.
4 comments
Follow-Up to Your Review (Second Reminder)
Dear Reviewer TjAQ,
Thank you again for the time and care you put into reviewing our work!
We know this is a busy period, so we wanted to follow up briefly on our point-by-point responses and the revised manuscript, where we highlighted the changes for easy reference.
If you have a chance to look over our responses, we would appreciate hearing whether they address your main concerns. If anything remains unclear, we would be happy to clarify it here.
Thanks again for your support!
Sincerely yours,
The Authors of Submission 15
Follow-Up to Your Review (Third Reminder)
Dear Reviewer TjAQ,
We are following up on our point-by-point responses and the revised manuscript, which we posted several days ago. We believe these materials further address your concerns and highlight the changes we made in response to your feedback.
As the end of the Author-Reviewer Discussion phase is fast approaching, please let us know whether our responses address your main concerns or if any points still need clarification. We are available to discuss them here.
Thank you again for your time and effort devoted in this review!
Best,
The Authors of Submission 15
Thank you for your response and the additional experimental results. However, my main concern remains unresolved.
My first two questions were about the motivation for this paper and why the authors chose this method. SimWAM itself can achieve similar performance with multiple steps, so the proposed method is mainly about speeding up inference. This complex approach to training and speeding up inference is not itself new, which makes it especially important to show how well it performs, how well it generalizes, and why it is needed.
-
If the paper’s main contribution is in action generation, then it needs to show that applying the proposed action generation method to different backbones improves performance on each of them. This kind of generalization needs to be demonstrated.
-
Since the paper focuses on improving action generation, it needs to show that the proposed method outperforms the original backbone across different datasets. With the current results, it is hard to tell whether the strong performance simply comes from the backbone itself.
-
The newly added experiments still focus on open-loop evaluation. If the paper emphasizes improvements in action generation, then validation in a closed-loop setting is even more important.
Follow-Up to Your Review
Dear Reviewer
TjAQ,Thank you again for the time and effort you put into reviewing our work!
We understand that this might be a super busy period for you. We wanted to briefly let you know that we have posted point-by-point responses to your questions and concerns and uploaded a revised manuscript with the changes highlighted.
Whenever you have a chance, we would be grateful for your feedback on whether the responses address your concerns. We would be happy to clarify anything that remains open.
Thank you!
Best,
The Authors of Submission
15