- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ForgeVLA, a federated framework for training VLA models from client-side vision–action trajectories without language annotations, while keeping raw data local. An instruction classifier trained on a small labeled public dataset assigns predefined task instructions to these trajectories. The framework combines a task-level contrastive loss with adaptive server aggregation to reduce training degradation caused by differences in client task distributions. Experiments on four LIBERO suites and two real-world tasks show improvements over federated baselines.
Critical strengths
The paper studies a meaningful research problem. Existing robot logs may lack language annotations and cannot always be shared across organizations. Studying how to use these distributed data for VLA training could help expand the available training data while keeping raw trajectories local.
Critical weaknesses
1.The experimental evaluation is limited in scope. Although the paper evaluates four LIBERO suites, all simulation experiments use the same benchmark, and the real-world evaluation includes only two tasks. This limits the evidence for the method’s effectiveness across a broader range of tasks and environments.
2.Important experimental details are missing or unclear. The paper does not clearly explain how the public labeled subset and client datasets are separated or how demonstrations are distributed across clients. For the real-world experiments, the number of training demonstrations and the instruction classifier’s training data and evaluation setup are not sufficiently described. These details are needed to assess and reproduce the results.
3.The methodological novelty is limited. The paper studies a meaningful problem, but its main contribution lies in combining instruction classification, task-level contrastive learning, and adaptive aggregation for federated VLA training. Overall, the method focuses on system integration, with relatively limited novelty in the individual components.
Questions for authors
Could the authors respond to the concerns raised in the weaknesses section?