- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper introduces RoboFL, a method for collaboratively training VLA and WAM models on distributed robotic data using Federated Learning. To this end, clients locally train LoRA adapters for a pretrained model and transmit these adaptations to a server. On the server, the received adapters are assembled into experts of a Mixture-of-Experts model using MoSAIC and further trained together with the routers on additional server data. With FARD, action routing is additionally trained based on the routing distributions of the understanding and generation paths. Subsequently, the server-refined experts are combined into a global LoRA adapter using PCEA, which is then combined with the respective expert of each client and sent back for the next FL round. Evaluations on RoboTwin 2.0, RLBench, and a real-world Franka robot show overall better results than the evaluated FL baselines, although RoboFL performs worse than centralized approaches on RLBench.
Critical strengths
- Separating local LoRA training from server-side expert combination is a reasonable approach for highly heterogeneous task distributions. In particular, I find it convincing that local specializations are not immediately lost through parameter averaging.
- The evaluation on six different tasks using a real-world Franka robot is a positive aspect. This extends the investigation beyond simulation and shows that the method can also work under realistic conditions.
- The authors show that RoboFL is comparable to FedAvg in terms of client-side communication and memory requirements while achieving better results on RoboTwin (Table 3).
Critical weaknesses
-
The authors assume that the server has its own training data. How does this training data influence the selection of MoE experts? A quantitative investigation in this context should be performed.
-
The relationship between tasks on the server that are very similar to client tasks, and vice versa, should be investigated. Currently, it is not entirely clear how the server's training data influence the selection or decision-making within the MoE.
-
Some design decisions of the method, particularly the weighting of experts within PCEA and the equally weighted combination of global and local adapters, are not sufficiently justified through experimental investigations. Therefore, it remains unclear what additional advantages these decisions offer compared to simpler alternatives.
-
The experiments were conducted using only one seed each for training and evaluation. Multiple seeds would be necessary to assess the robustness of the results.
-
The authors extensively investigate client-side communication overhead and memory requirements (Table 3). However, RoboFL requires additional computations and a larger MoE model on the server. A corresponding investigation of server-side computational costs and the overall training effort is missing.
Minor Weaknesses:
-
Stronger, controlled comparisons with simpler LoRA aggregation or personalization approaches are missing.
-
Although the methods are generally very promising and the results are also very convincing, the overall method is sometimes very difficult to follow, and the connections between individual steps or methods are difficult to understand. Parts of the method section are described too implicitly. MoSAIC could be explained in more detail, particularly how its individual methods are connected and executed.
Questions for authors
-
The method assumes that the routing distributions across the three model paths can be meaningfully compared. What justifies this assumption?
-
Where does the server's training data come from in a real-world setting?
-
Why was no mixing ratio other than 50/50 between the local expert and the global adapter investigated?
-
How is the reliability of the constructed teacher distribution validated, and to what extent does agreement in routing across different paths correspond to the selection of experts that improve action prediction?
Thanks to authors’ detailed rebuttal, especially the clear analysis of failure cases. I keep my original score to support this paper.