- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Think-to-Act trains a navigation model to predict an action followed by a structured explanation covering observations, instruction progress, the decision, and stopping. Reasoning dropout and a latent-consistency objective connect this training format to deployment without reasoning text. The paper contributes a large annotation resource and a training recipe that improves unseen navigation while retaining a short action output at inference.
Critical strengths
-
The action-first layout addresses a specific training problem (Section 3.3, Eq. (3); Figure 7). Causal attention prevents the action from depending on a gold explanation that will be absent at deployment. Combining this ordering with reasoning dropout in Section 3.4 makes the training and deployment paths fit together naturally.
-
The matched results support the practical value of the method (Table 2). R2R-CE unseen SR improves from 53.3 to 59.0 with the same initialization, mixture, and training steps. Observation and progress supervision each recover part of the gain, while shuffled rationales hurt performance. These comparisons give a useful account of why the content of the auxiliary supervision matters.
-
The RxR result extends the value of the annotations (Section 4.3; Table 3). SR improves from 50.8 to 55.6 even though the reasoning annotations come from R2R. RxR action supervision remains in the training mixture, but the result still shows that the benefit of R2R reasoning targets carries beyond the annotated dataset.
-
T2A-GR is a useful contribution in its own right (Section 3.2; Appendix D). The 166,997 annotated decision points turn trajectories into supervision about intermediate navigation judgments. The prompt, examples, and human audit explain what the fields are intended to capture and should help others build on the resource.
Critical weaknesses
-
The semantic-retention explanation is stronger than the result establishes (Section 1; Section 4.3). The smaller seen/unseen gap is consistent with retaining useful pretrained knowledge, but T2A could also teach new navigation-specific relationships between observations, progress, and actions. Table 2 demonstrates the value of richer supervision without distinguishing these explanations. I would present semantic retention as an interpretation and center the claim on the demonstrated improvement in generalization.
-
The decision targets explain demonstrated actions (Section 3.2; Appendix D.1). The annotator receives the ground-truth next action and explains why it is appropriate. This is sensible supervision, but it has a different role from the observation and progress fields, which describe the scene and task state. The paper would benefit from making this distinction explicit: what is the decision field intended to teach beyond a richer description of the action label?
-
The results favor a stronger emphasis on supervision design (Section 4.6; Table 2). Four-field supervision without path consistency already reaches 58.2 unseen SR, compared with 53.3 for action-only training and 59.0 for full T2A. Most of the gain therefore comes before adding Eq. (5). Path consistency is a reasonable refinement, but the statement that every component is necessary gives it more weight than these results suggest. The annotation design and action-first/dropout training format appear to be the main contribution.
Questions for authors
- Does “semantic retention” in Sections 1 and 4.3 mean preserving abilities from pretraining, or learning navigation semantics that action-only supervision does not encourage? The distinction would help clarify the proposed mechanism.
- In the four-field design of Section 3.2, how do the authors distinguish the intended contribution of the action-conditioned decision explanation from that of observation and progress supervision?