- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Spatial–Social Code, a representation framework connecting physical events and perceptual evidence with participant-specific observations, beliefs, goals, and intentions. Spatial and social records share entity, temporal, and evidence references. In interactive settings, the framework maintains private agent states through observations, action feedback, and delivered messages. The paper evaluates SSC on video question answering, collaborative grounding, and embodied interaction. Its central contribution is an explicit interface for distinguishing changes in the physical world from changes in what individual participants know.
Critical strengths
Well-motivated problem formulation. Distinguishing world state from individual information histories is essential for social reasoning. The separation between observations, beliefs, and received reports is conceptually sound.
Useful representation design. Agent attribution, timestamps, evidence references, and update semantics make intermediate states inspectable. The manuscript appropriately acknowledges that structural validation does not establish the semantic correctness of inferred mental states.
Evaluation across multiple tasks. SSC improves MA-EgoQA overall accuracy from 48.71% to 51.92% and ToM accuracy from 41.28% to 47.66%. MMToM-QA accuracy increases from 73.33% to 78.33%.
Promising evidence for persistent state maintenance. Dynamic SSC succeeds in 24/36 Habitat runs, compared with 8/36 for Direct and 10/36 for Static SSC. Task-level bootstrap analysis appropriately accounts for repeated seeds within tasks.
Transparent reporting of limitations and regressions. The manuscript includes negative grounding results and task-level failures rather than reporting only favorable examples.
Critical weaknesses
The contribution of code representation is not sufficiently isolated. The strongest evidence supports explicit information organization and persistent updating. Information-equivalent prose achieves 92.5% paired correctness versus 95.0% for SSC, while the online comparison is 7/12 versus 8/12 successes. Removing attribution or evidence links removes relevant information, so those ablations do not establish an advantage specific to code.
Main comparisons contain inference-pipeline confounds. The MMToM-QA pipeline includes candidate-conditioned evidence, rule-based bridging, Bayesian scoring, and conditional frame refinement. MA-EgoQA includes an additional raw-video audit. Sharing a backbone and video clips does not ensure matched inference compute or reasoning procedures.
Component ablations are not aligned with the main evaluation. The 70-question diagnostic uses a different backbone and different readout procedures across conditions. Consequently, improvements cannot be cleanly attributed to individual representation components. Generalization evidence remains limited. Habitat evaluation uses only 12 development tasks, while CoMind uses inspected train-development examples. Independent, frozen test sets are needed. Moreover, the strongest interaction results rely on private text inputs and deterministic updates, which provide narrower evidence than end-to-end visual social reasoning.
Semantic grounding is insufficiently evaluated. An evidence identifier establishes traceability, not whether the cited observation supports a belief. The paper should measure attribution errors, unsupported social inferences, and error propagation.
Novelty requires stronger positioning against recent structured reasoning methods. AutoToM (2025), PDDL-Mind (2026), and Thinking with Spatial Code (2026) already establish substantial precedent for explicit agent modeling, state tracking, and code-based visual reasoning. The distinctive contribution should be demonstrated through matched comparisons.
Presentation could better reflect the evidence hierarchy. Some figures use small text, and results from substantially different protocols are placed together. The narrative should emphasize that evidence for state updating is stronger than evidence for code-specific superiority.
Questions for authors
NA