acceptodds
Withdrawn from ICLR 2027

MedSpaceAgent: Training-Free Tool-Grounded Spatial Reasoning for Medical Visual Question Answering

Withdrawn from ICLR 2027, so left out of the paper lists and the map.

Abstract

Medical visual question answering (VQA) models often produce answers through implicit cross-modal reasoning, making it difficult to determine whether their predictions are supported by relevant image regions and valid anatomical relationships. Moreover, adapting these models to spatial reasoning typically requires task-specific fine-tuning and additional annotations. We introduce MedSpaceAgent, a training-free, tool-grounded agent for explicit and verifiable spatial reasoning in Medical VQA. Instead of directly generating an answer, MedSpaceAgent translates each question into an executable spatial program and dynamically invokes frozen medical perception tools for anatomical segmentation, abnormality localization, and region-level inspection. The resulting observations are organized into a spatial evidence graph, on which a deterministic executor computes anatomical, directional, topological, and distance-based relations. An evidence-aware verifier further assesses evidence completeness, geometric consistency, and agreement across tools, enabling the agent to replan its perception strategy or abstain when reliable evidence is unavailable. This design separates linguistic planning from spatial computation and provides an auditable reasoning trajectory without updating any foundation-model parameters. We evaluate MedSpaceAgent on spatially focused Medical VQA tasks, including compositional, counterfactual, and out-of-distribution settings. The proposed framework establishes a transparent alternative to end-to-end adaptation and provides a general foundation for reliable spatial reasoning in medical multimodal systems.

Primary area:
interpretability and explainable AI
Keywords:
Training-Free, Visual Question Answering

Reviews

Among:
Shape:
1234this paper, Bottom 1%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.00 over 2 reviews, above 0% of the others.
Reviewer_A77HOpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

The paper proposes MedSpaceAgent, a training-free agent for spatial reasoning in medical VQA. A frozen LLM converts the question into an executable spatial program and calls frozen perception tools; the outputs are stored in a spatial evidence graph, a deterministic executor computes geometric relations, and a verifier decides whether to answer, replan or abstain.

The validation cannot be assessed. The caption of Table 1 states: "All numerical results are hypothetical and must be replaced with actual experimental results." The text of Sections 4.2–4.3 and Appendix D describes outcomes as "expected" or "projected" (e.g., "MedSpaceAgent is expected to achieve the best overall performance"; Tables 8 and 9 are titled "Projected ..."). Tables 2–7 report numbers in the same style without such a label. As far as I can tell, the submission contains no measured results, and the abstract's claim of evaluation on compositional, counterfactual and out-of-distribution settings is not supported by any experiment in the PDF.

Critical strengths

The design principle of separating linguistic planning from deterministic geometric computation, with an explicit option to abstain, is reasonable. However, the submission provides no measured evidence that the system works, so there is no strength that can support acceptance.

Critical weaknesses
  1. The paper contains no actual experimental results. The caption of Table 1 states that "All numerical results are hypothetical and must be replaced with actual experimental results." Sections 4.2–4.3 and Appendix D describe results as "expected" or "projected", and Tables 8 and 9 are titled "Projected". Tables 2–7 report specific numbers in the same style without any such label. None of the claims about accuracy, evidence consistency, robustness or efficiency is therefore supported, and the abstract's statement that the method is evaluated on compositional, counterfactual and out-of-distribution settings has no corresponding experiment.

  2. The system is not specified at a level that could be implemented or checked. The perception tools are never named. The thresholds and weights in Eqs. 5, 11–15, 18, 20 and 21 are not given, nor is the procedure for choosing them without target data. The "manually verified spatial subsets" are not described (size, construction, annotators), the appendix promised for complete spatial results is absent, and no code is provided. It is also unclear how a geometry-based pipeline applies to PathVQA and PMC-VQA, where most questions are not spatial.

Questions for authors

Clarification requests:

  1. Has any number in Tables 1–9 been measured? If so, which ones, and under what setup (tools, backbone, test sets, number of runs)?
  2. Which perception tools, thresholds and confidence weights were used, and how were they selected?
  3. How were the spatial subsets constructed, and how many questions does each contain?

I have no suggestions for future work at this stage, since the current version cannot be evaluated empirically.

Reviewer_Vib4OpenReview ↗
Rating
1
Confidence
4
Informativeness
1
Presentation
1
Soundness
1
Read review
Paper summary

After reviewing the paper, I agree with Reviewer A77H, this paper seems to be a fully AI-generated paper and should be desk rejected.

Critical strengths

N.A.

Critical weaknesses

N.A.

Questions for authors

N.A.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Discussion (0)

Sign in to comment.