- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes DiMAC, a diffusion-based MARL framework that improves multi-agent coordination through process-level supervision. The motivation is interesting and well justified, and the proposed method offers a meaningful perspective beyond simply improving the diffusion backbone. The overall framework is reasonably designed, and the experimental results and ablation studies generally support the effectiveness of the main components. However, I still have some concerns about the reliability of the method, scalability, experimental consistency, and overall presentation. Overall, I find the work promising, but I think some aspects could be better justified and improved.
Critical strengths
- The paper tackles an interesting problem. Most existing diffusion-based MARL methods mainly focus on the final joint action, while DiMAC explicitly supervises the intermediate denoising process. I think this is a meaningful direction beyond simply improving the diffusion backbone.
- The overall method is well designed, and the ablation results generally support the main idea. In particular, removing DPC or using final-Q guidance leads to clear performance drops, suggesting that process-level supervision is indeed important.
Critical weaknesses
-
I'm concerned about the OOD issue in coalition counterfactuals. The mixed denoising prefixes may not follow the actual policy distribution, so it's unclear how reliable the DPC predictions are on these inputs. The lower reliability weights reported for mixed prefixes also suggest this could be an issue.
-
Pairwise coalition decomposition has roughly quadratic complexity in the number of agents, and DPC requires additional evaluations. It's unclear how well the method would scale to larger multi-agent settings.
-
While the results on MPE are strong, DoF still performs better on several SMAC settings, including all 8m splits. This makes the general claim about improved coordination somewhat less convincing.
-
Figure 2 uses different fonts and font sizes, which makes it look a bit inconsistent. Also, the method introduces quite a lot of notation throughout the derivation, making it harder to follow than necessary. A clearer and more consistent presentation would improve readability.
Questions for authors
-
How accurate is DPC on coalition-mixed prefixes compared to normal policy-generated prefixes? It would be helpful to report prediction errors or calibration results for both cases.
-
How does DiMAC scale with more agents? Could the authors provide runtime, memory usage, and DPC evaluation costs, ideally compared with DoF and MADiff?
-
Do all baselines use the same checkpoint selection protocol and environment rollout budget? Results using the final checkpoint or offline validation for selection would help clarify this concern.
-
Why is the current mask-variance-based reliability weighting necessary? Could the authors compare it with simpler timestep-based or fixed weighting schemes? Also, why does B=5 perform noticeably worse than B=3?
Dear Reviewers,
As the discussion period is nearing its end, we would appreciate your feedback on whether our responses and the new evidence address your main concerns.
Thank you again for your time and constructive feedback!
Best,
Authors