- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes LITO for open ad hoc teamwork, where unfamiliar agents can enter or leave the environment. It combines LSTM-based agent type inference with a Transformer to produce contextual representations and symmetric interaction weights for coordination-graph value decomposition. A separate behavior model predicts other agents' actions, allowing the learner to marginalize the joint value function when selecting its own actions. Experiments on cooperative Wolfpack and mixed cooperative-competitive FortAttack report competitive performance and improved robustness to unseen agent policies and changing team sizes.
Critical strengths
The paper is generally well presented, with a clear description of the problem setting and overall architecture.
Critical weaknesses
The work offers limited methodological novelty and reads more like an engineering solution than a clearly differentiated research contribution.
Questions for authors
-
Attention-based interaction selection and weighting have been widely studied in MARL communication. How does LITO differ from these earlier approaches beyond applying them to the OAHT setting?
-
The ablations indicate that contextualized embeddings account for most of the performance gains. What substantive methodological contribution comes from the proposed coordination-graph weights beyond standard attention-based representation learning? At present, the approach reads more like an engineering adaptation to a particular setting than a clearly differentiated research contribution.
-
The overall conclusion currently appears within Section 5.3, “Ablation Studies.” Please place it in a separate section and review the manuscript's organization.
2 comments
Thank you for the response, and I have decided to maintain my original score.
Response - 1
We thank reviewer KRUK for the valuable feedback:
Q1. How does LITO differ from these earlier...?
LITO differs in the following ways:
(i) Unlike prior MARL attention methods that attend over observations or timesteps to select information for a fixed policy, LITO's attention outputs a symmetric, time-varying edge weight wij=1+αijαij that re-weights the value decomposition, making the interaction graph an interpretable part of the credit-assignment objective.
(ii) It is permutation-invariant (no positional encoding) and entmax-sparse, so it is the only attention-based coordination graph that natively handles variable, stochastically entering/exiting teammates, a requirement no closed-environment MARL attention method addresses.
(iii) In MARL communication, attention weights select messages between agents: a directional quantity. In LITO, the same attention must also parameterize a credit-assignment structure (the value decomposition of Eq. 8), which is inherently symmetric. Converting directional attention into a valid symmetric coordination graph is a methodological problem that communication-topology work does not face, and LITO addresses it with $w_{ij} = 1 + \sqrt{α_{ij} * α_{ji}}, the geometric mean of reciprocal attention plus a complete-graph residual.
Q2. What substantive methodological contribution...?
The coordination graph weights make credit assignment interpretable. The only-embeddings variant's post-hoc weights are often uninterpretable and sometimes random (Fig. 5e–h), while LITO's weights track kills, spawns, and prey captures (Fig. 4). As stated in the paper's conclusion, contextual embeddings are key to performance improvement, while learned edge weights provide valuable clarity on the coordination structure, which is the paper's stated contribution 3.
Q3. Conclusion section.
The "Conclusion" paragraph will be moved out of Section 5.3 into a standalone Section 6: Conclusion in the revised version.
We hope these responses address the reviewer’s concerns and are happy to discuss any remaining questions.