- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes AdaMoE-VLA, a mixture-of-experts architecture for vision-language-action models. It introduces a Scale Adapter to adjust the contributions of selected action experts, aiming to reduce interference between load-balancing regularization and task-dependent expert weighting. Experiments on LIBERO, RoboTwin 2.0, and real-world manipulation tasks show improvements over dense VLA baselines and vallina MoE.
Critical strengths
- Simple and practical architectural design. The proposed Scale Adapter provides additional flexibility in expert weighting while retaining standard sparse expert selection. The method can be integrated into existing VLA architectures with relatively limited modifications.
- Detailed experimental results. The method achieves improvements across simulation and real-world manipulation tasks. Comparisons with Vanilla MoE, architectural ablations, and supplementary analyses provide useful empirical support for its effectiveness.
Critical weaknesses
-
Insufficient validation of the proposed expert-weighting design. AdaMoE-VLA only marginally outperforms CSMoE on LIBERO (96.0% vs. 95.5%), and CSMoE is not evaluated on RoboTwin 2.0. Since RoboTwin involves more diverse action patterns and frequent mode transitions, this missing comparison makes it difficult to establish whether additive residual weighting provides a meaningful advantage over alternative expert-weighting designs.
-
Room for more comprehensive architectural evaluation. While the paper demonstrates improvements with both π0 and π0.5, the key comparisons among Vanilla MoE, CSMoE, and AdaMoE-VLA are primarily conducted with π0. Extending these comparisons to π0.5, along with including a Vanilla MoE baseline in the real-world experiments, would provide stronger evidence for the generalizability of the proposed design and help further isolate the contribution of the Scale Adapter.
Questions for authors
-
Could the authors evaluate CSMoE on RoboTwin 2.0 under the same configuration as AdaMoE-VLA? Given the small performance gap on LIBERO, this comparison would help establish whether additive residual weighting provides a meaningful advantage on more complex manipulation tasks.
-
Could the authors provide the key architectural comparison among Vanilla MoE, CSMoE, and AdaMoE-VLA using π0.5? Additionally, a Vanilla MoE baseline in the real-world experiments would help isolate the specific contribution of the Scale Adapter.
-
Could the authors clarify how the combined router–Scale Adapter gradient alignment is computed, particularly how gradients from different parameter groups are aggregated and normalized? Since adding task-only adapter gradients can reduce the angle in the joint parameter space without necessarily reducing interference in the router itself, what evidence supports attributing the performance gains specifically to gradient-interference mitigation rather than increased expert-weighting flexibility?
Thank you for the responses and additional experiments. The updated results address my first two concerns, particularly regarding the comparison with CSMoE and the validation across different backbones and evaluation settings. Regarding the third concern, the additional gradient analysis provides useful insights, although further validation could strengthen the evidence for the proposed gradient interference mitigation mechanism. Overall, I lean towards weak accept.