- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
TAGER augments a π₀.₅ vision-language-action policy with two components. Sparse Spatial Query Distillation uses independently parameterized query transformers to reconstruct features from frozen SAM3 and VGGT teachers, providing compact semantic and geometric context to the action expert. Action Response Residual Flow encodes recent executed actions, proprioceptive changes, and SAM3-query differences to condition a gated residual correction to the action-generating flow.
The paper evaluates TAGER on LIBERO and VLABench, with zero-shot transfer to LIBERO-Plus and LIBERO-PRO. The results suggest useful improvements under distribution shifts, particularly robot-initial-state perturbations. However, the current experiments do not sufficiently isolate the proposed mechanisms from additional capacity, temporal information, and differences in state conditioning.
Critical strengths
-
The robustness improvements are practically relevant and extend across multiple benchmarks. On LIBERO-Plus, TAGER achieves 87.6% success, compared with 84.6% for the official π₀.₅ baseline and 82.2% for the retrained baseline. The improvement under robot-initial-state perturbations is particularly substantial: 75.5% to 86.6% relative to the official baseline. Improvements also appear on LIBERO-PRO and VLABench, providing evidence beyond a single evaluation setting.
-
The architecture introduces spatial supervision with a modest reported inference overhead. Teacher networks and reconstruction decoders are removed at inference. Appendix I reports approximately 6.4% additional parameters and 7% additional post-initialization latency. The cumulative ablation in Figure 3 also supports the practical usefulness of both query distillation and the temporal component, although further controls are needed to establish their specific contributions.
Critical weaknesses
W1. The ablations do not sufficiently isolate the mechanisms behind the improvements.
Spatial branches. Figure 3 adds query capacity and teacher supervision together. Without the same architecture trained without distillation, the benefit of teacher knowledge remains confounded with approximately 214M additional parameters.
Preservation of pretrained priors. Appendices A and D.1 acknowledge that reconstruction gradients reach the VLM. This does not invalidate the design, but language-perturbation results and spatial probes do not directly demonstrate preservation of pretrained semantic capabilities.
Temporal component. Figure 3 shows that the module helps, but does not distinguish among:
-
Generic temporal context.
-
Actions or proprioceptive changes alone.
-
Correctly paired actions and visual responses.
-
Additional capacity or residual-head parameterization.
Table 6 partially addresses history length. Further controls should remove actions or query differences, disrupt their pairing, and compare against a conventional history encoder. Since proprioception enters through the history encoder, its availability across variants also needs clarification.
W2. Smaller gains are difficult to assess, and the temporal configuration is inconsistent.
Result reliability. TAGER improves over the strongest listed LIBERO method by 0.3 percentage points and retrained π₀.₅ on LIBERO-PRO by 1.9 points. Without reported variability and clearer baseline comparability, their stability is uncertain. The 2.4-point gap between official and retrained π₀.₅ on LIBERO-Plus also warrants explanation.
Configuration inconsistencies: History length: Table 5 specifies three transitions, requiring four observations; Table 6 reports the main 87.6% result with three observations. One-frame variant: This setting has no historical transitions but achieves 86.1%. Its inputs and difference from the 85.8% query-only model are unclear. Camera views: Appendix E reports wrist-only performance as 85.6%, versus 86.5% in Table 6. Its claim that combining views provides no gain also contradicts the table’s 87.6% versus 86.5%.
The first two inconsistencies affect the definition and configuration of the core temporal module.
Questions for authors
-
Which history configuration produces the main results? Please reconcile the three transitions in Table 5 with the three observations in Table 6, and explain how historical inputs are constructed for the one-frame variant and at the beginning of a rollout.
-
Do the proposed mechanisms remain beneficial under matched capacity and input information? Particularly informative controls would include the same query branches without teacher supervision, temporal variants without actions or query differences, disrupted action–response pairing, and a conventional history encoder receiving the same inputs. Please also clarify the proprioceptive information available to each variant.
-
What explains the gap between official and retrained π₀.₅ on LIBERO-Plus? Are the reported comparisons based on comparable training and evaluation settings?
-
Is there direct evidence of reduced interference with pretrained visual-semantic capabilities? A controlled comparison with direct feature alignment would strengthen this interpretation. If such evidence is unavailable, the claim should be qualified as an explanation consistent with the behavioral results.