- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies when training-only privileged observations should be withdrawn from cooperative MARL policies. The results show that a shared schedule can help or hurt depending on the task. This paper introduces Observation-Control Irreducibility (O1), a probe-conditioned predictive gap between joint and additive models of agents' local observations, to select a withdrawal schedule. Experiments are conducted on MAPPO on SMAC and MPE, schedule-mismatch and dose-matched controls, prospective held-out tasks, and a replication with QMIX, validating the effectiveness of the proposed method.
Critical strengths
-
This paper studies a practically important but underexplored problem.
-
The authors report paired statistical tests and include negative findings for discussion.
Critical weaknesses
-
Limited generalization to unseen tasks. The prospective evaluation includes only two informative held-out tasks, while the third remains unsolved under all schedules. OCI-guided scheduling achieves the best mean on one task but ranks second on the other, with one seed collapsing to 0.049. More held-out tasks are needed to establish its generalization ability.
-
The diagnostic depends on the probe distribution, target selection, and predictor capacity. Although the paper acknowledges the importance of probe quality, it lacks systematic sensitivity analyses and uncertainty estimates. It is therefore unclear whether O_1 provides a stable and cost-effective basis for schedule selection.
-
Limited transfer across learners. The MAPPO-calibrated OCI-guided schedule performs poorly on QMIX, with some seeds collapsing. This suggests that O_1 alone is insufficient to determine an effective schedule and that learner-specific calibration is necessary. The evidence is also limited to one additional learner and three seeds per condition.
-
Although OCI-guided scheduling achieves a higher observed worst-seed SMAC score than exponential decay, the difference is statistically unresolved, and exponential decay has a slightly higher mean SMAC performance. Given the heterogeneous results across tasks and the small number of seeds in several conditions, the claimed robustness advantage remains inconclusive.
Questions for authors
Please see weakness.