- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ELV extracts concept embeddings from agents’ local histories, aggregates them into a global context, and uses two attention branches to construct individual action values. Observation reconstruction and concept-dynamics prediction provide auxiliary learning objectives, while prediction errors supply an intrinsic exploration reward. Experiments on the LBF, SMAC, and SMACv2 benchmarks demonstrate that ELV achieves higher win rates compared to other baselines (such as QMIX and VDN) while also exhibiting a degree of behavioral interpretability.
Critical strengths
- The research problem addressed in this paper carries practical significance, and the conceptual interface proposed by ELV holds potential value. To tackle the challenges of "partial observability" and the "lack of interpretability" inherent in the "black-box" nature of neural networks, ELV introduces semantically structured latent concepts that serve as decision bottlenecks. This approach is well-motivated and highly valuable for research. The paper is logically coherent throughout and offers significant reference value.
- The experimental coverage is quite comprehensive. The paper includes three benchmarks, nine baseline methods, and learning curves based on five random seeds. Furthermore, the appendix explores the integration of ELV with VDN, demonstrating that the effectiveness of ELV is not limited to the QMIX algorithm alone. Significant improvements are reported across several challenging scenarios, highlighting the method's efficacy and its research value.
Critical weaknesses
- Overstated claims regarding "interpretability." ELV discovers "latent variables" in an unsupervised manner. To assign semantic meaning to these latent slots (as shown in Table 6), the authors rely on a post-hoc, gradient-based attribution method. Consequently, the framework remains largely a "black box" that requires post-hoc analysis to be understood. This stands in some contradiction to the paper’s stated contributions—namely, "improving interpretability" and "enabling concept–feature attribution and semantic analysis." In my view, the paper fails to actually enhance interpretability, which I consider to be its most significant flaw.
- There are inconsistencies between the discussion in the experimental section and the results presented in the figures. In the empirical analysis, the distinction between "final performance" and "sample efficiency" is not sufficiently addressed. The experiments on LBF (Figure 2) demonstrate that EVL offers a clear improvement over QMIX, but they do not substantiate the claim that "EVL achieves better test returns with competitive sample efficiency and stable learning dynamics." In the ablation study conducted in the "Corridor" environment (Figure 4), both "ELV-w/o-ir" and "ELV-w/o-dec" exhibit faster learning rates than the full model during the early-to-mid stages of training—even though the full model ultimately achieves a higher win rate. This contradicts the statement in Section 4.3 that removing the intrinsic reward "slows learning." While the overall effectiveness of ELV is evident, and further results are provided in the appendix, the lack of analysis or explanation for scenarios where performance is weaker diminishes the persuasiveness of the experimental conclusions and leads me to harbor some doubts regarding the rigor of the paper.
Questions for authors
- Many claims are overly strong, such as interpretability and intrinsic reward, which lack experimental evidence and verification. Many details are also lacking, such as how and external concepts $ \tilde{c} $ are specifically acquired.
- In the ablation experiments (Figure 5 and Figure 6), the 3s5z map was used. In the 3s5z experiment, the QMIX baseline performed better than the complete ELV. Why was a map not used in the main experiment chosen for ablation, and why was the actual ELV result worse? The authors need to explain this point. Is there anything special about 3s5z?