- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Motivated by the view that CMR interpretation is a multi-step reasoning process that gathers and integrates evidence across views and sequences, this paper proposes Cardiomni, an agentic workflow, as opposed to one-hop prediction models. Through a Planner–Executor–Verifier loop, Cardiomni iteratively calls the visual attention highlighter and the quantitative measurement estimator, records their outputs in an evidence ledger, and generates answers based on it. The authors also build DeepCMRVQA, a benchmark with 21 abnormality labels and 14 quantitative metrics, and report higher balanced accuracy than general and medical VLM baselines on binary VQA and quantitative MCQ.
Critical strengths
Strength: A CMR-specific agentic workflow that explicitly records its evidence
The paper presents an agentic workflow that addresses both disease assessment and quantitative measurement for multi-view, multi-sequence CMR of individual patients. Integrating abnormality classification and segmentation-based measurement as tools, and recording their outputs (classifier probabilities, attribution maps, measurements) in an evidence ledger so that the final answer is traceable, is a meaningful design.
Critical weaknesses
Weakness 1: The evidence selection mechanism lacks evaluation, implementation details, and explanation.
The paper emphasizes learning the evidence selection process (lines 69–70) and states that each question should be matched with evidence that can support it (lines 160–161). However, the reward for evidence selection is left as future work (lines 84–85, 303–306), and no quantitative evaluation of this process is provided. Since it is part of the core claims, deferring it to future work does not seem appropriate; observations and evaluation of the evidence-gathering process and its results for each task would be needed. It is also unclear how “predict relevant slices,” “retrieve additional slices,” and “refine segmentation” in Figure 3 actually work. Is “predict relevant slices” in the visual attention highlighter a separate task performed by the classification tool? Moreover, per Appendix B.2, ED/ES phases are first selected from segmentation results (the LV area curve of the mid slice), and then the full stack at those phases is segmented. This is not segmentation of selected slices, and the order appears reversed relative to Figure 3 (selection → segmentation). Do the slices chosen by “predict relevant slices” come from these ED/ES phases? Please also explain how views or sequences are selected.
Weakness 2: The experiments do not isolate the contribution of the agentic workflow.
That Cardiomni outperforms zero-shot models not specialized for cardiac MRI is expected, and the gain may come from the modality-specific tools themselves. To show the effect of the agentic workflow, comparisons with baselines that use the tool outputs directly are needed: for VQA, classifier probabilities with various thresholds (0.1, 0.2, …, 0.9), and for MCQ, measurements mapped directly to reference ranges. The fixed schedule in App. E.1 still goes through the LLM and cannot replace this. In addition, according to App. C, only the visual attention highlighter is active in VQA evaluation. The reported VQA results thus reflect repeated use of the same tool within the agent loop, not evidence pathway selection. The paper presents choosing one or both pathways within L_vol as a key decision (§3.1, lines 224–230), and Figures 1 and 3 show examples using both tools. However, this decision can only occur for L_vol (5 items), presumably MCQ items, and the reported experiments do not evaluate whether pathway selection is effective. Further experiments, such as reporting performance with only one tool enabled while keeping the Cardiomni loop (requiring separate training) versus both tools enabled, are needed to assess its contribution.
Questions for authors
Please see the Weaknesses section.