- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
VSEL combines physical consistency checks, event-triggered VLM reasoning, and cross-episode hypothesis verification for embodied social agents. The framework is well motivated and achieves strong navigation results, but the reliability and distinct contribution of its verification mechanisms require further evidence.
Critical strengths
Navigation success improves from 0.43 to 0.73 while collisions decrease substantially. Component ablations and additional VLM backbones support the approach’s utility. The distinction between uncertain observations and behavioral hypotheses is conceptually valuable.
Critical weaknesses
-
The unique contribution of the proposed method relative to existing feedback mechanisms needs to be more clearly established. Further comparisons and discussions are needed to clarify its relationship to relevant studies, including feedback-driven planning in Inner Monologue, execution monitoring in DoReMi, and experience-guided adaptation in AeroWeaver.
-
The robustness and statistical uncertainty of the adaptation mechanism are insufficiently addressed. Figure 4 presents a continuous evaluation of 1,200 episodes involving only a single collaborator, whereas the main rearrangement experiments involve four collaborators, resulting in differences in experimental settings. Furthermore, in the rearrangement task, the proposed method achieves only a marginal improvement in success rate, from 72.13% for the strongest reported reinforcement learning baseline to 72.67%.
-
Runtime and reproducibility details remain incomplete. Appendix G reports an average VLM inference time of approximately 0.406 seconds per executed step, but it remains unclear whether the collaborator continues moving during model inference.
Questions for authors
1.Do the gains persist against conventional filtering and matched reflection-memory baselines?
2.How reliably does HV identify false hypotheses and prevent contradicted beliefs from influencing subsequent strategies?
3.Are adaptation gains consistent across collaborators and randomized episode orders?