- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors produce a ToM benchmark of 700 questions from 568 AI generated conversations containing four task categories. The benchmark is checked by four human annotators. They evaluate a range of models on the benchmark and find that the best model (GPT-6 Astra) gets an accuracy of 56.7%. This rises significantly when the number of correct answer choices is revealed.
Critical strengths
- The four part taxonomy used to motivate the tasks included in the dataset is nice.
- The error analysis presented is helpful and an admirable addition to the work.
Critical weaknesses
My main concerns regard the human validation and meaningfulness of the dataset.
- My largest concern regards the construction of the dataset, and in particular the verification. As I mention in my reading notes, the details regarding human verification discussed in both Appendix A.3 and 4.2 are insufficient.
- I am generally unconvinced and concerned that the dataset itself is not very meaningful. No IAA numbers were reported, no annotation guidelines were given, no data collected from the four humans that “checked” things is provided, and no human baseline was done.
- The examples provided seem pretty ambiguous and I suspect that IAA might not be that good. The dataset and code were not provided in the supplementary materials, which limits how much I can audit.
- Some of the tasks presented (e.g., D.1) read more like reading comprehension questions rather than something that would require ToM. How do we know these questions really require ToM?
- How does this control for shortcutting or running on a script?
- Some sections of the paper do not seem elucidating. In particular, section 3. The related work section does not cite any of the relevant psychological and cognitive science work, which is strange.
Below are additional comments from my reading of the paper. They are supplementary and need not be considered critical weaknesses.
- After a first read of the abstract I have no idea what you guys actually did. This is not a useful abstract. What is “Mind Shaping”, or “Mind Reading” for that matter?
- You say in the abstract that other benchmarks leave “complementary judgements and their evidential boundaries insufficiently characterized” but how? And what does that even mean?
- Should cite Premack & Woodruff for your definition of ToM in the first sentence. It’s almost word for word.
- “ToM concerns what happens between minds” - I mean, a lot of existing benchmarks deal with this. MindCraft for example, anything related to common ground, a significant number of psychological datasets related to conceptual pacts and their formation. If this is meant to be a justification for the dataset it is a weak one.
- “We introduce InterMind around the changing demands on ToM [...]”
- This reads strangely to me. Based around?
- I am not sure I love the name “Mind Reading” for the first part of your taxonomy, but I do like the taxonomy as an idea.
- Both in the abstract and in the introduction you need to say how you construct the 700 questions and where the 568 conversations come from. Like are they generated by AI? Are they collected? Did the authors write them? Where are these questions and conversations coming from?
- So these are multiple choice questions and you allow for multiple correct answers? How many choices are there? This is great and the justification is good but this should not be emphasized too much for novelty. FanToM does this as well for example.
- Again, simple summary details of what the dataset actually is need to be up front and clear. This is very frustrating as a reader.
- Section 3 seems like needless mathematization and is not very elucidating. The notation developed is not even used again? This should be revised.
- “We assemble human–AI conversations with records of the user’s reasons for speaking and reactions to assistant replies.” but then only a few sentences later it is said “As the exchange unfolds, the simulated user’s perspective [...]”.
- So these are not human-AI conversations. They are AI generated conversations. As I mentioned earlier, this should be immediately clear far earlier.
- “From each conversation and its associated records, we identify judgments [...]”
- Again, this is being done by a model. That should be more clear. “We” refers to the authors so if a model is used to do something in the construction of the dataset that should be said.
- The examples in Appendix D seem strange to me.
- In D.1, an example is presented that feels more like a reading comprehension question than something about ToM. Additionally, I think the example model response seems perfectly reasonable.
- D.3 doesn’t feel well formulated. I don’t know if a human could do this.
- D.4 is a nice example. I think this captures something really useful.
- The details regarding human verification discussed in both Appendix A.3 and 4.2 are insufficient.
- Who were the annotators? What were the instructions provided to them and what were the annotation guidelines? Were any IAA metrics (e.g., pairwise Cohen’s kappa) computed both between the human annotators and also the AI annotator(s)?
- What is specifically meant by the various “checking” that was done? Ideally annotators would have actually answered the questions and performance/agreement could then be compared. This might identify questions that are just not reasonable. Checking an answer is not exactly the same thing as being asked to find it. Even doing so for a smaller sample of the dataset would have been more useful.
- Section 5.5 seems to me that it could be evidence that the ambiguities in the questions (e.g., D.1) are driving most of the performance.
- It is strange that there doesn’t seem to be a clear pattern of performance across the tasks (looking at Table 2). I would have liked to see more analysis of this.
Additional Related Work (authors might find interesting)
These are some typical citations from psychology and cognitive science related to ToM.
- Premack, D., & Woodruff, G. (1978). Does the chimpanzee have a theory of mind? Behavioral and Brain Sciences, 1(4), 515–526. https://doi.org/10.1017/S0140525X00076512
- Wimmer, H., & Perner, J. (1983). Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children’s understanding of deception. Cognition, 13(1), 103–128. https://doi.org/10.1016/0010-0277(83)90004-5
- Baron-Cohen, S., Leslie, A. M., & Frith, U. (1985). Does the autistic child have a “theory of mind”? Cognition, 21(1), 37–46. https://doi.org/10.1016/0010-0277(85)90022-8
These are not necessary citations but the authors may find them interesting when thinking about what situations really require ToM.
- Schank, R. C., & Abelson, R. P. (1977). Scripts, plans, goals, and understanding: An inquiry into human knowledge structures. Lawrence Erlbaum Associates.
- Taylor, D., Gönül, G., Alexander, C., Züberbühler, K., Clément, F., & Glock, H.-J. (2023). Reading minds or reading scripts? De-intellectualising theory of mind. Biological Reviews, 98(6), 2028–2048. https://doi.org/10.1111/brv.12994
- Meng, H. (2008). Social script theory and cross-cultural communication. Intercultural Communication Studies, 17(1), 132–138.
Questions for authors
- Please provide additional details regarding the human verification procedure. For the checking that was already done, can any agreement measure be computed?
- Realistically, an annotation guideline and human annotation of at least some subset with IAA between two humans and to gold annotations, is sort of a minimum here. Refer to my questions on this above.
- What makes these questions as they are constructed, necessarily require ToM in a way that any other MC question wouldn’t. For example, how is D.1 different from multi-hop question answering?