- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
- The paper presents NEXUS: an agentic framework for specific types of MRI and fMRI analysis.
- NEXUS uses pre-defined primitives that wrap preprocessing and analysis tools, and assigns different parts of the task to specialized agent roles.
- One of these roles does quality control using a VLM, prompted with written criteria for how images should look and a few examples of good and bad cases.
- Evaluation covers two datasets, with 5 runs each.
- Baselines are standard tool pipelines, with cross-validation used for hyperparameter tuning and pipeline/model selection.
- Ablations show each component contributes.
- The QC agent’s agreement with human raters approaches the agreement between the raters themselves.
Critical strengths
- Improves upon software used by neuroscientists for image analysis by helping with parameter setting
- Evaluates how well a pre-trained VLM with prompts and zooming tools can help an agentic framework for automatic pipeline construction
Critical weaknesses
- The paper does not compare NEXUS to any other agent-based system. This is its most critical weakness.
- Missing comparisons include both the neuroimaging agents discussed in Related Work and general-purpose coding agents such as Claude Code or Codex, which would be easy to run as baselines.
- The authors acknowledge the closest works: “During the writing of this work, we noticed several recent works, including NeuroClaw (Wang et al., 2026), NEURA (Xie et al., 2026), Agentic LLMs (Erdur et al., 2026), NeuroAgent (Zhong et al., 2026), NeuroPilot (Chen et al., 2026), and BrainPilot (Li et al., 2026), which share a similar spirit with us in exploring agentic AI for neuroimaging research.” They distinguish NEXUS as follows: “They primarily focus on task completion through tool orchestration, reproducible execution, and traceable workflows, typically instantiating predefined or skill-encapsulated pipelines. In contrast, NEXUS targets fully autonomous, end-to-end neuroimaging analysis, emphasizing adaptive workflow construction, dynamic refinement, objective-aware optimization, and closed-loop agentic QC.” These descriptions sound quite similar to me. The paper should include a quantitative comparison with these systems, or explain why such a comparison is not possible.
- A comparison with general-purpose agents is especially important. BrainPilot, which the authors cite, compares its custom multi-agent system against Claude Code and Codex. It reports that BrainPilot “attains performance comparable to state-of-the-art agent framework with less costs.” Simply giving the task to Claude Code or Codex is therefore a straightforward baseline, and it is missing here.
- Some neuroimaging tools discussed in Related Work (e.g., FreeSurfer, BrainSuite, Nipype) are not used in either the baselines or the primitives.
- To me, the most interesting part of the paper was the VLM-based QC agent. It is not compared to prior automated QC methods, either VLM-based (e.g., MMRQA) or established non-VLM tools (e.g., MRIQC’s classifier), and Related Work does not discuss them.
Questions for authors
Can you provide comparisons to other agentic frameworks?