- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies study-level chest X-ray classification across 12 findings. A fine-tuned RAD-DINO classifier produces the initial predictions. For predictions near label-specific thresholds, the system retrieves reports from similar training studies and applies deterministic rules to revise the labels. An LLM reviews proposed changes, and a second invocation produces read-only evidence assessments. Experiments use a selected CheXpert Plus cohort and an additional five-condition expert-labeled CheXpert cohort. The reported classification improvement mainly comes from deterministic retrieval fusion.
Critical strengths
1、Restricting label changes to predefined cases and separating prediction from read-only verification are sensible design choices. The stored intervention traces make the pipeline easier to inspect.
2、Deterministic retrieval fusion improves macro-F1 over the same vision-only model on both evaluation cohorts. The patient-disjoint split and training-only retrieval index are also appropriate safeguards.
Critical weaknesses
1、The methodological novelty is not convincingly established. The framework combines an existing visual encoder, similarity retrieval, hand-designed fusion rules, and constrained LLM calls. The claimed novelty mainly lies in separating prediction, intervention, and auditing. However, the paper does not position this design against relevant medical-agent frameworks such as MedRAX and MedAgent-Pro, which already integrate medical tools or retrieval into structured reasoning workflows. I therefore find it difficult to identify the substantive methodological advance beyond this particular combination of components.
2、The experiments do not establish the added value of the proposed framework. Table 3 shows that deterministic retrieval fusion accounts for most of the classification improvement, but there is no comparison with simpler retrieval-based alternatives. The only external baseline is zero-shot GLoRIA, which is not evaluated under comparable supervision. Meanwhile, the paper does not assess whether the LLM reviewer catches incorrect label changes or whether the verifier’s evidence judgments are accurate. The results therefore support adding retrieval to the classifier, but do not sufficiently establish the benefit of the proposed agentic design.
Questions for authors
1、What specific methodological contribution distinguishes MEDAGENT-X from existing medical-agent and retrieval-augmented approaches?
2、Why is zero-shot GLoRIA the only external baseline, rather than classifiers evaluated under comparable supervision?
3、What evidence shows that the proposed fusion rules outperform simpler ways of combining predictions from retrieved cases?
4、How are the accuracy and usefulness of the LLM review and verification outputs evaluated?