- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CoFac-FM (Coordinated Factorized Flow-Matching) to address coordination failures in multi-agent imitation learning from multi-modal demonstrations. The core idea is to let a shared latent variable capture the information that agents need to agree on, so that each agent can follow a consistent joint strategy using only its local observations. The main innovation is to explicitly train this latent representation to make the joint behavior factorizable into decentralized policies, using the discrepancy between joint and local flow vector fields as the learning signal. The authors validate the method through a toy experiment and cooperative control tasks in Multi-Agent MuJoCo and MQE, comparing task performance and the recovery of different expert behavior modes against Gaussian, latent-conditioned, and flow-based baselines.
Critical strengths
-
The paper gives the shared latent representation a clear objective: capturing the dependencies needed for agents to follow a consistent joint strategy using only local observations. The factorization gap formalizes this requirement, and joint-to-local vector field alignment provides a practical way to train the representation and decentralized policies.
-
Figure 1 clearly shows that the method separates the two coordinated behavior modes under different latent values and avoids incompatible action combinations. This supports the intended effect of the proposed representation learning. Tables 1 and 2 provide further evidence of effectiveness, including consistently lower overall MMD across the eight Multi-Agent MuJoCo configurations and substantial success-rate improvements on some partially observable MQE tasks.
Critical weaknesses
-
The experiments do not fully isolate the contribution of training the latent representation with the factorization objective. The LatentMF baselines train local policies solely through distillation, whereas the proposed method also uses direct imitation training. An ablation that blocks only the factorization-loss gradient to the encoder, while keeping the remaining setup unchanged, would more clearly establish how much of the improvement comes from the proposed latent learning mechanism.
-
In Table 2, Door-P and Cargo Door-P have identical success rates, MMD values, and standard deviations for every method. These results should be checked and clarified, since the two environments involve different coordination tasks.The overall assessment remains positive, although these issues require clarification to strengthen confidence in the experimental conclusions.
Questions for authors
-
Could the authors provide a controlled ablation that blocks only the factorization-loss gradient to the encoder while keeping all other training components unchanged, including direct imitation training of the local policies? This would help clarify how much of the improvement comes from learning the coordination representation through the proposed objective.
-
Could the authors clarify why Door-P and Cargo Door-P have identical success rates, MMD values, and standard deviations for every method in Table 2? If this is a reporting error, please provide the corrected results.
2 comments
As the discussion period is drawing to a close, please let us know if you have any remaining concerns.
(W1, Q1 An ablation that blocks only the factorization-loss gradient to the encoder) We perform the ablation studies, by applying the stop-gradient operator in the encoder indicated by ϕˉ.
Although the MSS (5x4) task shows a slight performance increase, these differences remain within the std (Ours std=0.106 in MSS 5x4 ). It exhibits the significant performance drop, demonstrating that training the encoder via ΔFMfac is a critical factor for successful decentralized execution.
(W2, Q2 Duplicated results) Thank you for pointing that out. We fixed Door-P and the resulting is the following: