- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies a failure mode in interleaved vision-language-action (VLA) training for gaming and embodied tasks, where highly correlated historical actions can dominate prediction and reduce reliance on visual input. The authors characterize this issue as visual modality collapse under supervised fine-tuning, and introduce two diagnostics—Modality Information Gain and KL Divergence Shift—to probe modality dependence. To mitigate the problem, they propose Historical Action Noise Injection (HANI), which corrupts historical action tokens during training to weaken the shortcut and encourage stronger visual grounding. Experiments on MiniWorld and three additional 3D environments show consistent improvements over standard SFT and several regularization baselines.
Critical strengths
- The paper addresses a practically important and underexplored training pathology in interleaved VLA models. The paper identifies a plausible failure mode in supervised fine-tuning of gaming and embodied VLA models: when historical actions are highly temporally correlated, the model may over-rely on the low-entropy action-history pathway and under-utilize visual input. It targets a real weakness of current interleaved VLA training pipelines, rather than simply improving benchmark metrics.
- The proposed intervention is simple, lightweight, and practically appealing. HANI is easy to implement, requires no architectural changes or additional parameters, and adds no inference-time overhead.
Critical weaknesses
- The methodological novelty appears somewhat targeted and incremental. HANI is well motivated and practically useful, but methodologically it remains close to the broader family of input-corruption or modality-perturbation techniques. The paper makes a reasonable case that discrete, semantically mismatched history corruption is better aligned with the proposed failure mode than generic continuous noise or dropout. Still, the overall contribution feels more like a targeted refinement than a fundamentally new training principle.
- The empirical support is somewhat narrow relative to the paper’s broader framing. The paper appropriately acknowledges many of its limitations, but the main evidence is still concentrated on a single VLA backbone and a relatively narrow family of discrete-action gaming and embodied settings characterized by strong action inertia. As a result, the current results more convincingly support the claim that HANI is effective in this regime than the broader claim that the diagnosed shortcut is a general failure mode of interleaved VLA SFT.
- The results on richer environments are informative but comparatively coarse-grained. The MiniWorld experiments include task success, modality-level diagnostics, and ablations, whereas the ViZDoom, Minecraft, and RoboTHOR results are reported only as aggregate SFT-versus-HANI reward comparisons. These additional experiments therefore broaden the empirical scope of the paper, but they do not provide the same level of statistical or mechanistic support as the main benchmark.
- The current experiments do not fully isolate which components of HANI are necessary for its gains. The paper includes a useful ablation over the perturbation probability p, but it remains unclear how much of the improvement depends specifically on HANI’s full design—namely, replacing the entire action history with discrete semantically incorrect tokens—rather than on more modest ways of weakening the historical pathway.
Questions for authors
- Clarification on mechanism isolation. Beyond the Modality Dropout comparison and the ablation over p, do the authors have additional evidence that distinguishes HANI’s proposed mechanism from a more generic regularization effect induced by corrupting historical actions during training? For example, have the authors evaluated simpler variants such as perturbing only part of the history, shortening the history window, or partially masking action tokens?
- Clarification on cross-backbone generality. Do the authors have any preliminary evidence that the same historical-action shortcut, and the benefit of HANI, also appear in VLA backbones other than Qwen3-VL-8B-Instruct?
- Clarification on the richer 3D environments. For ViZDoom, Minecraft, and RoboTHOR, can the authors report variance estimates and, if available, at least one modality-level diagnostic analogous to the MiniWorld analysis? This would help clarify whether the observed gains in those environments arise from the same proposed mechanism.