- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes CoSpAC, a compartmentalized spiking actor-critic framework for asynchronous multi-agent reinforcement learning with macro-actions. Local observations and teammate messages are processed through separate dendritic compartments with independently learned decay factors, before being combined through somatic dynamics. Messages are generated at individual decision events and trained using a receiver-oriented policy objective. Experiments on BoxPushing and Overcooked variants report improvements over several MARL baselines, together with component ablations and estimated inference compute energy.
Critical strengths
- The proposed separation of local observations and teammate messages is a reasonable architectural choice for asynchronous cooperation.
- The reported evaluation covers multiple layouts, randomized initial configurations, and heterogeneous macro-action durations. CoSpAC shows substantial improvements on BoxPushing and favorable results under heterogeneous durations in Overcooked, making the overall framework promising.
Critical weaknesses
- Implementation and evaluation details are missing. Message aggregation, timestamp encoding, historical-message gradients, and SNN critic training are insufficiently specified. The return evaluation protocol and final-performance statistics are also unclear, limiting reproducibility.
- The contribution of SNNs is not isolated. Main comparisons change both communication and network architecture. HC supports independent decay factors, but does not establish the benefit of spiking dynamics. A communication-matched non-spiking counterpart is needed.
- The membrane updates (Eqs. 7–8) run a fixed number of internal steps per decision event and never use macro-action duration or message age (A.4), so temporal integration is event-scaled rather than time-scaled. The source of the reported Macro+ advantage (Fig. 4) is therefore unexplained.
- Although the experiments include ACAC (2025), they omit ToMacVF (2025), which evaluates on overlapping benchmarks. The paper should also clarify its differences from AsynCoMARL (2025) and provide an appropriately adapted or communication-matched comparison.
- Figure 1 doesn't show the core contribution: the separate dendritic compartments, independent decay factors, or somatic integration described in its caption.
Questions for authors
- Please specify the message generator, aggregation operator, timestamp encoding, and asynchronous critic implementation.
- Please also address the omission of ToMacVF.
- Equations (7)–(8) apply a fixed number of internal updates per decision. How does the model use elapsed environment time or message age, including the timestamp in Eq. (11)? Can a controlled message-age or timing experiment distinguish general memory benefits from improved handling of stale information?