- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The proposed framework DISCERN (Language-Guided Behavioural Search with World Models) is presented in submission 51116; it is a test-time policy-steering approach that improves the instruction-following reliability of previously trained Vision-Language-Action (VLA) robot policies without updating policy weights or running trial rollouts in the real environment.
The main conceptual contribution of DISCERN is to show that rephrasing language expands the behavioural search space much more effectively than sampling from action space. However, in practice, misclassifications during VLM verification, predictive drift in the world model over longer time horizons, and high inference latency currently limit its effectiveness.
Critical strengths
-
Conceptual Formulation of Language as a Search Interface for Frozen Policies: The authors identify a fundamental bottleneck in existing world-model policy steering: sampling actions under a fixed prompt restricts search to a narrow, potentially failing region of the policy's behavioral distribution6. By formalizing language rephrasing as a deployment-time control variable u_t, DISCERN provides a principled mechanism to unlock latent behavioural modes in frozen VLAs without parameter updates or reward model fine-tuning. The spatial density analysis in Figure 3 and Table 3 provides clear empirical proof that language proposals shift action distributions globally toward desired targets (37.4% mode reachability) where action-space sampling remains trapped in fixated modes.
-
Rigorous Analysis of Predictive Limits and Temporal Intervention Windows: The paper delivers a high-quality empirical dissection of when world-model previews are effective in Section 5.4; see Figure 4.
-
Training-Free, Modular System Execution with Strong Baseline Standardization: Unlike baseline approaches that require retraining latent verifiers (CoVer), latent world models with text-alignment narrators (FOREWARN), or Q-value models (RL2-VLA) on task demonstrations30more_horiz, DISCERN operates completely training-free using off-the-shelf components3334. Furthermore, the authors standardize all baselines on the same frozen checkpoint, initial states, and candidate instructions (Tables 5–6).
Critical weaknesses
In Section 5.1, the authors added: "Since A2World was trained on demonstrations from the LIBERO scenes used to derive LIBERO-PRO tasks, we do not claim to test for world-model generalization." In my view, this is a limitation since a) the action-conditioned world model (A2World) was evaluated on the exact same tabletop environments and visual assets it was trained on, and b) in a true zero-shot deployment (e.g., novel room lighting, unseen objects, busy scenes), world-model rollouts inevitably suffer from visual hallucinations and physical artifacts. Because A2World was in-distribution, the paper does not quantify how rapidly DISCERN's performance collapses when preview images degrade under domain shift.
Unless I misunderstood, there is high fragility across open-weight and smaller VLMs. It appears that DISCERN's performance drops significantly when moving away from top-tier commercial frontier models:
- Gemini Robotics ER 2 / Gemini Flash: 19.9% success
- Qwen-35B: 16.3% success
- Qwen-27B: 16.6% success
For ICLR participants, this point matters. The results suggest that the verification step depends substantially on the fine-grained visuospatial reasoning capabilities of proprietary frontier models, such as interpreting wrist-camera depth cues, gripper orientations, and multi-column visual grids. Open-weight models currently lack the visual accuracy needed to reliably rank candidate futures, complicating local or edge deployment.
Questions for authors
Latency & Computational Overhead: What is the average time required to complete a single decision step (generating 8 candidate rollouts for 30 steps with A2World and querying the Gemini ER 2 verifier API)?
VLM Verifier Error Attribution: In cases where DISCERN failed on a lock-in task but "Best fixed instruction" succeeded, what proportion of failures was caused by the VLM verifier selecting the wrong column despite an accurate world-model rollout, versus the world model generating an inaccurate visual rollout?
Out-of-Distribution World Model Behaviour: Please comment on the method’s performance when synthetic noise or visual blur is introduced into A2World predictions to simulate world-model errors on previously unseen scenes? Of particular interest could be “motion blur,” or out-of-focus blur. Does the verifier's default-stay rule effectively prevent erratic instruction switching under degraded preview conditions?
Generalization Across VLA Architectures: Have the authors evaluated DISCERN on alternative open-source VLA backbones, such as OpenVLA, to determine whether instruction rephrasing consistently resolves lock-in failures across various policy architectures?
2 comments
Q4. Generalization Across VLA Architectures: Have the authors evaluated DISCERN on alternative open-source VLA backbones, such as OpenVLA, to determine whether instruction rephrasing consistently resolves lock-in failures across various policy architectures?
Thank you for this question. We ran new experiments to test language-steerability of OpenVLA and found that averaged across the 80 simulation tasks, grid search over a set of rephrased instructions validated at the best one improved task success rates from 7.75% to 14.25%.
Q2. VLM Verifier Error Attribution: In cases where DISCERN failed on a lock-in task but "Best fixed instruction" succeeded, what proportion of failures was caused by the VLM verifier selecting the wrong column despite an accurate world-model rollout, versus the world model generating an inaccurate visual rollout?
We did not calculate per-decision accuracy labels for world-model previews, but our ablations provide some insight into the limiting components of our method. On lock-in tasks, a perfect world model recovers only 16% of the gap to the best fixed instruction. This gap persists even with accurate previews, suggesting that verifier selection leads to most of the failures. World-model and ground-truth candidate rankings are also well-correlated (Spearman ρ = 0.64, Fig. 4a), consistent with the verifier being the main bottleneck.
Q1. Latency & Computational Overhead: What is the average time required to complete a single decision step (generating 8 candidate rollouts for 30 steps with A2World and querying the Gemini ER 2 verifier API)?
On our real robot, a full decision (eight previews plus the Gemini ER2 query) takes a median of 87 s (Appendix D): 75 s for previews and 12 s for the verifier. In simulation, A2World's unoptimized 16-step video diffusion takes about 6 min per decision. DISCERN is agnostic to the world model, and recent few-step and single-pass world models report significantly faster rollouts. Swapping in such a model, running all eight previews in one batch, or distilling the sampler would reduce this cost substantially without changing the method. We acknowledge this latency in our limitations section, but we expect this to be less of an issue over time considering the growing effort of the community to implement faster world models.
We thank the reviewer for acknowledging our method’s strong motivation and analysis and for raising insightful questions. We address these questions below:
W1 / Q3. In Section 5.1, the authors added: "Since A2World was trained on demonstrations from the LIBERO scenes used to derive LIBERO-PRO tasks, we do not claim to test for world-model generalization." In my view, this is a limitation since a) the action-conditioned world model (A2World) was evaluated on the exact same tabletop environments and visual assets it was trained on, and b) in a true zero-shot deployment (e.g., novel room lighting, unseen objects, busy scenes), world-model rollouts inevitably suffer from visual hallucinations and physical artifacts. Because A2World was in-distribution, the paper does not quantify how rapidly DISCERN's performance collapses when preview images degrade under domain shift.
Thank you for raising this. We ran new real-world experiments and successfully deployed a world model trained on cross-embodiment data zero-shot to unseen objects and scenes. Our evaluation results show improved real-world task success over the original pi0.5 policy and VLS baseline, addressing the reviewer’s concern about the performance degradation under domain shift:
W2. Unless I misunderstood, there is high fragility across open-weight and smaller VLMs. It appears that DISCERN's performance drops significantly when moving away from top-tier commercial frontier models: For ICLR participants, this point matters. The results suggest that the verification step depends substantially on the fine-grained visuospatial reasoning capabilities of proprietary frontier models, such as interpreting wrist-camera depth cues, gripper orientations, and multi-column visual grids. Open-weight models currently lack the visual accuracy needed to reliably rank candidate futures, complicating local or edge deployment.
We agree that verifier quality matters, and our results show that open-weight verifiers already retain much of the performance. With the same prompt and previews, Qwen (16.3–16.6%) and UnifoLM-ER-1 (17.0%; new result) all improve over the canonical instruction (13.2%). Because the verifier is a modular, training-free component, DISCERN improves with embodied VLMs, and such models are increasingly deployable on-device (e.g., Gemini Robotics On-Device).