- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses an interesting and important problem. The argument that AI agents need to consider both the user’s cognitive state and their own capabilities and limitations when deciding how to interact is useful. The distinction between producing the correct answer and providing the right kind of assistance is also important. Another strength is that the framework treats this as a dynamic process, where the agent updates its understanding of the user and its own capabilities as the interaction progresses, rather than relying on static estimates.
Critical strengths
Overall, the paper does a good job of bringing together two important research areas and highlighting why both matter for human-AI interaction. The emphasis on recursively updating the human and AI models based on interaction feedback is also a useful aspect of the proposed framework.
Critical weaknesses
That said, there are a few concerns:
-
Considerable work already exists on shared mental models, common ground, adaptive automation, interactive POMDPs and understanding teammates' capabilities and limitations in human-agent teaming. The authors need to do a better job of positioning this work against that literature and explaining what is fundamentally new here.
-
Although the authors provide a mathematical formulation, they provide little detail on how the framework could be implemented. For example, how would the joint distribution over human and AI states be estimated? How is the Joint Epistemic State (JES) constructed, and what information does it contain? The mapping, loss function, and update mechanism are all left fairly abstract.
-
The application examples illustrate the motivation, but they remain largely hypothetical. Even a relatively simple implementation comparing human modelling alone, metacognition alone, and the proposed coupled approach would help demonstrate the value of the framework.
Questions for authors
Please see some indicative ones in the weaknesses section.
We thank the reviewer for pointing out these connections and asking for a clearer account of JES and its evaluation.
Q1: What does CCA contribute beyond shared mental models, common ground, adaptive automation, and interactive POMDPs?
A1: Thank you. CCA focuses on how human modeling and AI metacognition jointly constrain the next interaction act. We build on the frameworks you identify and discuss these connections in Section 1 of the General Response. As clarified in Section 3, JES is the agent’s decision-relevant summary of the coupled posterior. It does not, by itself, establish common ground between the human and the agent.
Q2: How are the joint distribution, JES, mapping, loss function, and update mechanism specified?
A2: Thank you for requesting these details. DCSM maintains beliefs about the human cognitive state, while MSM maintains beliefs about the agent’s metacognitive state. JES summarizes their coupled posterior for policy selection. The two marginal beliefs alone do not determine the joint posterior, so a concrete implementation must supply the joint model and inference assumptions.
Table 2 in Section 3 of the General Response explains the roles of Φ, the update operator U, and the mismatch loss LCCA. The tutoring implementation in Section 2 uses fitted estimates to select actions. Its results support this use of the estimates, while recovery of the full coupled posterior remains open.
Q3: Could a simple implementation compare human modeling alone, metacognition alone, and the coupled approach?
A3: Thank you for suggesting this comparison. Our controlled tutoring experiment includes all three conditions: human modeling alone, AI metacognition alone, and coupled modeling under CCA. Table 1 in Section 2 of the General Response reports the results. The coupled condition performs better on both held-out problem solving and online misconception resolution.