- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies robot leading along a given route while adapting to a language-designated follower. LeadVLA preserves the nominal route as an explicit Path reference, learns a Pace variable to regulate progress along it, and predicts a Residual for local spatial adaptation. The policy uses temporal front/rear RGB observations, language instructions, and route context, with auxiliary semantic supervision and referent-aware training. The authors also introduce LeadInfra, instantiated with approximately four million training samples, and LeadBench, comprising 108 held-out closed-loop episodes. Evaluation includes comparisons with adapted baselines, controlled ablations, and 80 real-robot trials without real-world policy fine-tuning. The reported results support improved task completion through structured route execution, with a macro-averaged leading success rate of 39.6%, while also revealing limitations in local obstacle handling and difficult multi-person interactions.
Critical strengths
- A clear and useful structural inductive bias, supported by informative ablations.
The separation of route geometry, progress along the route, and local spatial correction is well aligned with the task. Table 2 shows that replacing direct trajectory prediction with Path + Pace increases LSR from 0.174 to 0.354, while adding Residual further increases it to 0.396 and improves SCS. The difficulty breakdown in Table 18 is particularly informative: Residual helps under stronger route interference while slightly reducing success under Core conditions. This trade-off is consistent with its intended role and gives the design more explanatory value than an aggregate performance improvement alone.
- A coherent framework connecting interaction supervision, closed-loop evaluation, and physical deployment.
LeadInfra and LeadBench make follower-aware route execution trainable and measurable, including language-conditioned target attribution through counterfactual referent pairs and target reassignment. The real-robot experiments provide evidence that some of the learned behavior transfers beyond simulation without policy fine-tuning. Appendix E.1 also states that the downstream controller does not perform obstacle replanning, which helps establish that successful local adaptation originates from the predicted trajectories. Together, these elements constitute a meaningful contribution beyond the policy architecture itself.
Critical weaknesses
The physical experiments establish that transfer is possible, but success falls to 10/20 in Easy-S and 4/20 in Easy-M, and Appendix E.3 identifies contact with introduced obstacles among the observed failure modes. These results limit the strength of the practical claim when the nominal route becomes obstructed. The contribution remains meaningful as a study of follower-aware route execution, but its demonstrated capability should be distinguished from reliable obstacle handling. In particular, the behavior when a blockage cannot be resolved through local deviation remains unclear.
Questions for authors
I understand that the Residual branch is intended to support local deviations while the nominal route remains fixed. Could the authors distinguish the system’s behavior in two situations: (i) an obstacle that can be bypassed locally before rejoining the nominal route, and (ii) a blockage that makes the passage impassable and requires a different global route?
In particular, are the route-interference cases in LeadBench constructed to remain locally bypassable? When a local bypass is not possible, what is the current system’s behavior—for example, stopping or waiting, reporting that it cannot proceed, or requiring intervention from a higher-level planner or a human operator? A description of the benchmark assumptions and current implementation would help clarify the method’s operating scope and failure handling.
Revised Manuscript Follow-up
Dear Reviewer,
Thank you again for your thoughtful feedback. We have uploaded our revised manuscript, with further clarifications on locally bypassable interference, the scope of Residual-based adaptation, failure modes, and future recovery mechanisms.
Revisions addressing your comments are highlighted in green, with shared revisions marked in orange for easy reference.
As the discussion period approaches its end, we would greatly appreciate it if you could revisit our rebuttal and updated manuscript. We would be happy to clarify any remaining concerns.
Thank you for your time and consideration!