- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
FLTA adapts human-video-pretrained visual encoders using task-level paired human and robot demonstrations without frame-level correspondence annotations. It combines visual similarity, a normalized temporal-position prior, and a local ordering regularizer to learn soft cross-domain correspondences, supported by frame discrimination. Only normalization-layer affine parameters are updated. Evaluation covers multiple encoder initializations, unseen simulation tasks, real-robot manipulation, and task-progress retrieval. Presentation
Critical strengths
1.The problem is clearly defined and supported by dataset statistics. The paper quantifies differences in execution speed and pre-action redundancy between human and robot videos, providing an empirical basis for frame-level alignment.
2.The adaptation procedure is simple and parameter-efficient. It requires no frame-level annotations and updates only normalization-layer affine parameters. Its modest parameter and computational requirements increase its practical value.
3.The evaluation provides complementary evidence. Multiple encoder initializations, real-robot experiments, task-progress retrieval, and alignment-loss ablations support effectiveness. The matched-adapter comparison with HRAlign also provides evidence for the contribution of the alignment objective.
Critical weaknesses
1.The matching mechanism remains in tension with the redundancy problem. The global prior favors similar normalized temporal positions, while Sinkhorn normalization approximately enforces balanced matching. Substantially different proportions of irrelevant frames may therefore force unrelated frames into correspondence. Their matching quality is not directly analyzed.
2.Cross-task gains are concentrated. In Table 9, lid opening contributes substantially to Level-2 improvements, while several tasks remain near zero success. Large relative improvements in average success do not alone establish broad cross-task generalization.
3.Uncertainty estimates do not capture training randomness. The appendix states that standard deviations come from three evaluations of the same checkpoint rather than independent training runs. These estimates therefore do not establish robustness to adaptation and policy-training randomness.
4.The contribution of parameter selection is not fully isolated. The paper compares HRAlign and FLTA with matched adapters, and compares adapter versus normalization-affine adaptation within FLTA. However, HRAlign with the same normalization-affine adaptation is missing, leaving the effects of the objective, parameter selection, and their interaction partially unresolved.
Questions for authors
-
Method clarification: How does balanced Sinkhorn matching avoid incorrect correspondences when redundant-frame proportions differ substantially? Have the assigned weights for these frames been examined?
-
Validation: What are the Level-2 and overall improvements after excluding lid opening? This would clarify the breadth of the gains.
-
Robustness clarification: Are independent training seeds or more extensive downstream training results available? Does the advantage over HRAlign persist?