- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents TRACE, a training-free agent framework for cine CMR diagnosis. It combines segmentation-derived measurements, clinical guidance, evidence verification, and structured reporting. The agent acquires evidence and revises diagnostic proposals after verification feedback. Accepted decisions are locked with their supporting evidence. The evaluation uses 50 balanced ACDC cases. TRACE achieves 87.3% accuracy and 96.3% diagnosis coverage across eight runs. Additional experiments examine acquisition policies, recovery after rejection, and report conformance.
Critical strengths
1.The framework achieves diagnostic performance comparable to a specialist classifier on the evaluated cohort without additional model training. These results support the feasibility of building effective diagnostic workflows from existing models, measurement tools, and clinical knowledge.
2.The audit follows initial proposals to final outcomes. Among 84 trajectories with rejected proposals, 76 end in correct diagnoses and eight end in deferral. The paper separately reports incorrect proposals accepted without rejection. This distinction makes the recovery results easier to interpret.
3.The paper includes single-pass reasoning, rule-based classification, and complete-evidence controls. These comparisons share the measurement backend. The statistical analysis accounts for repeated runs within patients and corrects for multiple comparisons. It helps the agent produce acceptable proposals with fewer revisions and model calls than static guidance. These results demonstrate a useful role for clinical grounding in guiding the reasoning process.
Critical weaknesses
1.The same 50 ACDC cases were used for development and evaluation. Their outcomes informed method refinement. No independent test cohort is reported. Repeated runs on these cases cannot establish generalization to new patients. The reported performance therefore remains limited to the development cohort.
2.TRACE achieves comparable diagnostic accuracy to the deterministic rule-based baseline (87.3% vs. 88.0%). Moreover, selective evidence acquisition performs worse than complete evidence exposure (86.7% vs. 92.0%). These results do not sufficiently demonstrate the additional benefits of the complex agentic workflow over a simpler rule-based system.
3.Section 4.2 reports that some MINF cases are misdiagnosed due to premature termination of evidence acquisition. Moreover, Section 4.3 reports that 12 incorrect initial diagnoses are directly accepted by the verifier. These results suggest that the current verification mechanism cannot consistently prevent unsupported or incorrect diagnoses, weakening the paper's central claim of improving diagnostic reliability.
Questions for authors
1.Which Evidence Contract thresholds or workflow rules were adjusted based on the 50 ACDC cases? Can the authors provide results on an independent test set with fixed rules to demonstrate generalization?
2.Can the authors provide a more comprehensive comparison of diagnostic accuracy, coverage, and computational cost to justify the additional complexity of the agentic workflow?
3.Why does the verifier accept some incorrect diagnoses without identifying missing evidence?
Response to author
Thank you for the detailed responses and new experiments. The ACDC-100 evaluation and hospital study provide stronger evidence for generalization. The motion-required experiment also helps explain the verifier’s limitations.
The results still do not show a clear benefit of the agent over a rule-based pipeline. On ACDC-100, TRACE achieves similar accuracy but requires about 13 model calls per case. Fewer measurements do not necessarily mean lower overall cost. The LGE results are encouraging. However, the hospital study lacks a rule-based baseline with the same tools, triage rules, verification contracts, and report compiler. This comparison is needed to assess the agent’s contribution. For this reason, I maintain my Weak Reject recommendation.