- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies numerical instruction following for UAV vision-language-action models, where policies can execute semantic tasks but often fail to regulate physical quantities specified in instructions. The authors introduce METRICFLY, a two-stage framework that first provides explicit target-state-residual numerical conditioning to a π0-based policy and then applies an external action-conditioned geometric calibrator to refine generated action chunks. Experiments on controlled Orbit-R and Orbit-H tasks show that numerical conditioning improves metric accuracy and action-conditioned calibration substantially improves full-orbit completion under closed-loop evaluation.
Critical strengths
-
The formulation of numerical instruction following is a meaningful contribution.
-
The target–state–residual interface is supported by carefully controlled ablations.
-
The action-conditioned calibration analysis is one of the strongest parts of the paper.
Critical weaknesses
-
The contribution of the learned calibrator versus the underlying geometric controller remains difficult to separate. Since the calibrator is supervised by an analytic geometric teacher and applies bounded geometric corrections, a stronger comparison against simpler analytical correction rules or lightweight non-learning controllers would help clarify what is learned by METRICFLY.
-
The current evaluation focuses on Orbit-R and Orbit-H, where the desired behavior can be described using relatively simple geometric constraints. It would be valuable to evaluate whether the target-state-residual interface extends to other numerical instructions, such as distance-to-object, approach angle, or multi-constraint manipulation tasks.
-
The paper argues that observing the sampled action chunk is important for calibration, but the ablation suggests that some compressed representations (e.g., first action or shuffled chunk) already capture much of the benefit. A deeper analysis of which information in the action sequence is actually necessary would make the action-conditioned design more convincing.
-
Minor issue:
- Some terminology, such as "calibration" and "correction", overlaps with classical control terminology; a clearer discussion of the relationship to residual control or model-based correction would improve positioning.
Questions for authors
See weakness