- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies decentralized multi-agent pure exploration: agents collect observations using local histories, while a centralized inference network identifies a latent hypothesis from their combined trajectories. The method converts identification confidence into a terminal reward, introduces a sampling cost and stopping actions, and trains decentralized actors with centralized MATD3 critics. Experiments cover capacity identification, source localization, and GP-derived nitrate-monitoring environments.
Critical strengths
- The problem is well motivated and separates information acquisition from environmental reward maximization.
- Jointly learning inference, sampling, and stopping is a useful practical design. In A3P5, the full method reports 0.91 accuracy and 13.5 stopping steps, whereas removing sampling cost increases the stopping time to 50 at similar accuracy (Table 1).
- The paper includes three training seeds, extensive evaluation instances, coordination diagnostics, and an explicit calibration analysis. The held-out-year evaluation is also useful within the GP-derived setting.
Critical weaknesses
My main concern lies with the experimental evaluation, which, in my view, lacks sufficient rigor to fully support the paper's claims. Moreover, the reported performance gains are relatively modest and do not seem particularly compelling. Specifically,
- The variance of the stopping step results in Fig. 1(a) seems too high compared to baselines, which limits the statistical significance of the results.
- The baselines choice should more consistent across the three benchmarks. If using the same baselines across all benchmarks is not feasible, a clear explanation for the differences and justify the selection of baselines for each benchmark may be required.
- In Fig. 1, the proposed ICMAPE uses VDN and TD3 as its backbone algorithms, whereas the baseline methods use DQN. This difference in backbone algorithms makes it difficult to determine whether the observed performance improvements come from the proposed modules or from the choice of RL algorithms themselves.
- The performance gain of ICMAPE over baselines in Fig. 3 is not clear, limiting its practical contribution.
I would encourage the authors to strengthen the experimental evaluation and provide more convincing evidence of the method's effectiveness and its advantages over existing approaches.
Questions for authors
- Can the authors explain why I-VDN and I-INDEP show much higher variance? Can increasing the number of seeds resolve this? If so, experiments with more seeds may be required.
- Why choosing different baselines for bandit capacity identification, signal source localization and Maryland nitrate monitoring, while the proposed ICMAPE uses the same backbones across the three benchmarks?