- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Thermo-VTLA separates pre-contact thermal target grounding from vision–tactile control. A frozen VLM selects a task-specific spatial command from RGB–thermal observations, and a SmolVLA-based controller executes it using RGB, robot state, and tactile feedback.
Critical strengths
-
Well-motivated modular design. Thermal sensing supports pre-contact target selection, while tactile sensing supports contact-rich execution through an inspectable command interface. This separation provides a practical way to distinguish grounding failures from execution failures and avoids requiring the low-level policy to learn thermal–action alignment from robot demonstrations (Sections 3.1–3.4).
-
Meaningful real-robot evidence and a useful ablation design. The reported improvement over joint thermal–tactile token injection is substantial in the evaluated settings: 93.3% versus 45.0% average success (Table 2). The tactile ablations use ground-truth executable prompts, appropriately isolating execution from grounding errors; removing tactile feedback reduces success from 93.3% to 73.3% (Section 4.4, Table 3).
Critical weaknesses
-
The contact-gating definition requires reconciliation. Equation (7) measures consecutive-frame marker motion, whereas Appendix D.1 describes displacement from reference positions. A stable grasp can maintain deformation with little consecutive-frame motion, so the stated criterion need not indicate sustained contact. The actual reference, thresholding, and any state-retention mechanism must be clarified before this central contribution can be assessed. This may be a reporting error rather than an implementation failure (pp. 5–6 and 17).
-
The comparisons do not sufficiently isolate the hierarchical design's contribution. The proposed system uses a frozen GPT-5.6-sol reasoner to supply resolved target commands, whereas direct-injection baselines learn thermal representations and grounding from limited action supervision (Section 4.3; Appendix A.2 and B). Table 2 establishes the effectiveness of the complete system, but leaves its gains confounded with additional pretrained reasoning capability and an easier control interface. Matched controls are particularly important for the fixed-position, two-candidate tasks.
Questions for authors
-
Implementation clarification: Does CAG use consecutive-frame displacement or displacement from a no-contact reference? Please reconcile Equation (7), Appendix D.1, and the supplementary video's initial/current marker visualization at 00:28. Can you provide the implemented rule and gate traces during stable holding and release? This would distinguish a reporting issue from a limitation of the implemented contact criterion.
-
Evidence needed for the current contribution claim: How does performance compare with a simple thermal-region selector connected to the same controller, and with baselines supplied equivalent target information or auxiliary grounding supervision? These controls would materially affect the assessment of whether the advantage comes from the proposed decomposition. This request concerns the present attribution claim, rather than a general suggestion for future task expansion.