- Rating
- 1
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 2(−1)
- Soundness
- 1(−1)
Read review
Paper summary
This paper examines whether high team performance implies that a multi-agent policy relies on peer information. In a flocking task, native IPPO achieves polarization of 0.977 but drops to 0.339 when a shared reference is removed. The authors formalize this shortcut through policy classes that omit or admit observation channels and derive an () performance bound for peer-omitting policies under independent references and idealized dynamics. They introduce SCIA, which audits frozen policies using channel decorrelation, zero ablation, and action influence. They also propose SI-PO, which randomizes reference directions during training without modifying the reward or PPO update. Experiments with scripted controls, NEAT, IPPO, and several task variants evaluate the resulting information dependence.
Critical strengths
-
Proposition 2 formalizes why return maximization need not select peer interactions, while Proposition 3 identifies conditions under which peer-omitting policies cannot achieve high polarization.
-
SCIA provides a systematic intervention-based diagnostic that distinguishes channel availability, correspondence, and action influence. Seven hand-specified controls clarify why zero ablation alone can be misleading.
Critical weaknesses
-
Peer shuffling preserves empirical input marginals but may disrupt the conditional relationship between peer observations, local states, and physically feasible trajectories. Performance degradation may therefore reflect observation inconsistency as well as dependence on genuine peer information.
-
Proposition 3 relies on independent local frames, decoupled rotation-equivariant dynamics, and a polarization-only objective. The practical simulator includes coupled dynamics and additional reward terms. The direct experiment supports the random-heading prediction but does not establish the full optimization-gap result for the original training objective.
-
Both SI-PO and zero-reference training induce peer dependence in the main alignment task. However, zero-reference training achieves higher peer correspondence and reference-loss polarization. The paper does not establish a consistent advantage from preserving the reference channel.
-
In the speed-cue task, SI-PO's speed-matching advantage over zero-reference training is not established. The retained speed code is also barely used.
-
In goal reaching, the SI-PO analogue fails its predefined performance criterion, whereas the zero-reference analogue succeeds. The successful pathway-switching results therefore do not establish that port preservation is beneficial across tasks.
Questions for authors
-
What is the precise causal quantity identified by SCIA? How can the authors distinguish dependence on genuine peer information from sensitivity to physically inconsistent observations introduced by cross-world shuffling? Could physically consistent or state-matched interventions provide a useful control?
-
Under what conditions does SI-PO offer an advantage over zero-reference training? The speed-cue experiment does not establish the intended information-preservation benefit.
-
The matched mixture encounters shortcut-incompatible conditions in only one third of training worlds, whereas SI-PO and zero-reference training encounter them throughout training. Could the mixture's failure reflect reduced exposure rather than an intrinsic limitation of the mixed objective?
-
How reliable is SI-PO across independent training runs? The initial five-seed reference-loss criterion failed and passed only after adding five seeds. Could the authors report the per-seed success rate and perform an independently specified replication?
-
How broadly do the theoretical and diagnostic conclusions extend beyond the controlled flocking setting? How would the analysis change with shared environmental dynamics, alternative coordination signals, or observation channels that cannot be cleanly separated into reference and peer statistics?