- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Waggle, a shared anonymous local policy that enables coordination without explicit roles or global topology. The authors develop Swarm-Consistent Distillation (SCD), combining decision imitation, anonymous-orbit consistency, and local coordination-field prediction. Experiments on spatial and distributed-language coordination benchmarks evaluate performance across varying population sizes and interaction budgets, cross-substrate transfer, and reorganization after counterevidence.
Critical strengths
1. Meaningful problem formulation. The paper presents an interesting framework for learning a shared anonymous local policy that enables adaptive coordination without explicitly defining global organizational structures.
2. Extensive empirical evaluation. The authors conduct experiments across multiple benchmarks, population sizes, and interaction budgets, including cross-substrate transfer and reorganization after counterevidence. The ablation studies and statistical analyses provide useful evidence of the effectiveness of the proposed framework.
The authors make a commendable effort to provide comprehensive experimental details and clearly articulate the research problem, both of which are appreciated.
Critical weaknesses
1. Limited conceptual and methodological novelty. The idea of learning shared local policies for emergent swarm coordination has been explored in prior work. Moreover, SCD mainly combines existing techniques, including consistency regularization and auxiliary state prediction. Although the ablation studies demonstrate improvements, they do not clearly distinguish whether the gains from the Orbit loss arise from anonymous-view data augmentation or the additional consistency regularization. Without an augmentation-only baseline, the independent contribution of the proposed consistency objective remains unclear.
2. Concerns about experimental validity and fairness. Although anonymity and locality are central assumptions, it is unclear whether all adapter-provided inputs strictly prevent access to non-local information. Furthermore, several baselines are reimplemented or substantially adapted, and key components of Agent Distillation are disabled. These issues raise concerns about whether the comparisons faithfully reflect the capabilities of the original methods.
Given these limitations, I appreciate the extensive empirical effort but remain unconvinced that the overall contribution is sufficiently substantial to warrant acceptance.
Questions for authors
1. Conceptual and Methodological Novelty. The proposed framework appears to be largely an incremental combination of existing ideas, including shared local policies, anonymous coordination, consistency regularization, and auxiliary state prediction, rather than a fundamentally new approach. Similar concepts have already been explored in prior work, such as Deep Reinforcement Learning for Swarm Systems and ForMIC. What is the essential methodological novelty of Waggle beyond integrating these established techniques? Furthermore, the current experiments do not clearly distinguish whether the improvements from the Orbit loss come from anonymous-view data augmentation or the additional consistency regularization. Without an augmentation-only baseline, it is difficult to assess the necessity and independent contribution of SCD.
2. Anonymity and Locality. Since anonymity and locality are central assumptions, how do the authors ensure that adapter-provided inputs, particularly private proposals and semantic traces, do not implicitly contain non-local or global information? Could the authors clarify the information provenance and provide evidence that these constraints are strictly maintained?
3. Fairness of Baseline Comparisons. Several baselines are reimplemented or substantially adapted to the benchmark settings. In particular, Agent Distillation disables FTP and SAG, which are components of the original method. How do the authors ensure that these modifications do not disadvantage the baselines? Could the authors provide comparisons with the complete methods or additional evidence of implementation fidelity?
4. Attribution of Reorganization Performance. The fixed runtime explicitly implements conflict handling, commitment reversibility, and message expiration. Moreover, the recovery metric requires conflict-triggered reopening, making some runtime ablations difficult to interpret. Could the authors clarify how much of the observed improvement comes from the learned local policy rather than these predefined mechanisms, and provide an outcome-based evaluation independent of the internal reopening procedure?
3 comments
Response to Reviewer tyto (2/3)
Response to W2, Q2, and Q3. Experimental Validity and Baseline Fairness
We thank the reviewer for these thoughtful questions about experimental validity and baseline fairness. We address them through (1) adapter-level locality and provenance audits and (2) complementary baseline evaluations covering restored FTP+SAG and interface-matched learned routing.
-
Anonymity and locality (W2, Q2). Private proposals derive from focal-agent observations, while semantic traces enter through validated local incident channels. Global rosters, persistent identities, and non-neighbor states are excluded from the canonical view.
To verify these constraints beyond the interface specification, we perturbed inaccessible remote-agent states before adapter execution, holding focal observations, incident traces, commitments, local topology, and randomness fixed. We then compared the reconstructed views and admitted decisions (Table T2).
Table T2. New locality-enforcement audit
Locality verification Observed result Non-local field injection rejection 256/256 Unauthorized global/identity field rejection 192/192 Pre-adapter non-neighbor counterfactual consistency 2,000/2,000 Forged or expired incident-trace rejection 320/320 The reconstructed views and decisions remained unchanged across all tested non-neighbor perturbations, while validators rejected unauthorized fields and traces. These results provide direct evidence of locality enforcement at the adapter level.
-
Baseline fidelity and fairness (W2, Q3). The original Agent Distillation comparison was intentionally designed as a budget-matched, one-call distilled-policy evaluation. We used the authors' official implementation and retained its trajectory-SFT objective and observation masking. FTP was excluded to evaluate the trajectory-SFT policy without additional first-thought supervision, while SAG was disabled to maintain one student call per active-agent update rather than multiple candidate generations. These choices were explicitly documented in Appendix H.3 and provide a controlled comparison at comparable inference budgets.
To additionally assess Agent Distillation with its FTP and SAG components enabled, we regenerated FTP teacher trajectories, retrained the model using the same Qwen3-4B backbone and LoRA setup, and restored SAG inference (Table T3).
Table T3. Evaluation of Agent Distillation with FTP and SAG restored
Configuration SILO-Bench SR (%) [95% CI] Calls/episode Input tokens (relative) Agent Distillation, one-call 43.7 [36.1, 50.9] 576 1.00× Agent Distillation, FTP+SAG restored 46.7 [39.3, 54.4] ~4,868 ~7.2× Waggle 58.2 [50.8, 65.2] 577 1.13× Restoring FTP+SAG improves Agent Distillation, while Waggle retains an 11.5 pp success advantage (paired 95% CI [+5.4, +17.2]) despite substantially lower inference cost. Thus, the original one-call comparison isolates performance under comparable inference budgets, while the new evaluation shows that Waggle's advantage persists when the baseline receives additional training supervision and test-time computation.
We will document adapter-level information provenance, clarify the distinct purposes of budget-matched and complete-method comparisons, and incorporate the new locality and baseline-fidelity evaluations into the revised paper.
Response to Q4. Reorganization Attribution
-
Learned policy versus runtime. The law chooses semantic actions, messages, and commitment updates; the runtime supplies conflict handling, expiry, and reversibility. To separate their effects without relying on procedural reopening, we added independent task-outcome metrics (Table T4).
Table T4. New outcome-based reorganization and runtime ablation
Method / runtime Post-conflict task success (%) Mean satisfied end-state checks (%) Decision Only + full runtime 85.0 88.6 Waggle + full runtime 92.5 94.4 Waggle without conflict handling 77.5 79.2 Waggle without reversible commitment 75.0 78.1 Under the identical runtime, Waggle improves post-conflict task success by 7.5 pp and terminal-check satisfaction by 5.8 pp over Decision Only. Removing conflict handling or reversibility also reduces task outcomes. Neither metric requires a Challenge or Reopen event.
The results support complementary contributions from learned semantic decisions and fixed runtime affordances, independently of the procedural recovery definition.
Response to Reviewer tyto (3/3)
Summary and Planned Revisions
The new experiments isolate Orbit supervision beyond augmentation, verify the tested locality boundary, evaluate the complete Agent Distillation baseline, and measure reorganization through native outcomes. We will sharpen the methodological distinction from prior local-policy work and incorporate these controls, statistical results, and attribution boundaries into the revised paper.
We appreciate the reviewer's thoughtful feedback, which has helped us further strengthen our empirical analysis and clarify the broader implications of our approach.
References
[1] Hüttenrauch et al. (2019). Deep Reinforcement Learning for Swarm Systems. JMLR.
[2] Shaw et al. (2022). ForMIC: Foraging via Multiagent RL with Implicit Communication. IEEE RA-L.
[3] Kang et al. (2025). Distilling LLM Agent into Small Models with Retrieval and Code Tools. NeurIPS 2025.
Response to Reviewer tyto (1/3)
We thank the reviewer for the detailed questions about methodological novelty, SCD's independent contribution, and experimental validity. We address these through new controlled ablations, locality audits, complete-baseline evaluation, and outcome-based attribution.
Response to W1 and Q1. Conceptual and Methodological Novelty
Thanks for the valuable questions about Waggle's methodological novelty and the independent contribution of SCD. We address both through (1) Waggle's distinct learning target and empirical capabilities, and (2) controlled ablations isolating the contributions of SCD.
Distinct learning target. Hüttenrauch et al. [1] advance decentralized swarm policy learning, while Shaw et al. [2] study coordination through implicit environmental communication. Shared policies, consistency regularization, and auxiliary prediction also have established precedents.
Waggle introduces a distinct learnable object for LLM-agent organization: a reusable anonymous local law that jointly selects task actions, semantic messages, and revisable commitments. Repeated local decisions form and revise coordination as evidence changes, without learning an explicit global organization. Appendix I demonstrates frozen transfer across five new task contracts, while the outcome-based evaluation in Q4 provides evidence of the law's contribution to post-conflict task performance.
Contribution of SCD. Beyond parameter sharing, SCD trains this law for anonymous consistency and responsiveness to evolving coordination evidence. To isolate the contributions of augmentation, semantic supervision, and Orbit consistency, we evaluated their incremental effects with Field disabled under matched conditions (Table T1).
Table T1. New augmentation-only and incremental Orbit ablation
Beyond augmentation alone, semantic supervision and Orbit consistency further improve agreement and exact equivariance, with Full Orbit achieving an additional 8.3 pp in deployed agreement (paired 95% CI [+5.1, +12.0]). The corresponding recovery gains with Field disabled are smaller. In the original paired factorial, complete SCD improves late-conflict recovery from 80.0% to 88.5% (paired 95% CI [+2.0, +15.0]), supporting the complementary contribution of Field supervision.
We will strengthen the related-work discussion, clarify Waggle's distinct learning target, and present the separate contributions of augmentation, semantic supervision, and Orbit consistency more explicitly in the revision.