- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
RAR combines three components:
- Anatomy-aware visual encoding: FreeSurfer-derived regional masks supervise a ViT’s attention during training.
- Retrieval augmentation: the current MRI retrieves four embeddings of training-case rationales, which are appended to its visual tokens.
- Anatomy-grounded generation: anatomical text segments receive ROI labels, and the generator’s cross-attention is encouraged to match the corresponding image regions.
The rationale targets are synthetic, generated using Qwen from FreeSurfer-derived regional measurements and known diagnostic labels.
Critical strengths
The motivation identifies a relevant limitation in the existing models: anatomical statements in generated rationales may not be grounded in the corresponding brain regions. The proposed combination of anatomical supervision, retrieval, and rationale generation is interesting.
Critical weaknesses
-
Literature review:
- AD-Reasoning is a withdrawn submission in ICLR 2026 and accepted to CVPR 2026 as EMAD. The paper should discuss and distinguish itself from EMAD, a closely related approach to sentence–evidence–anatomy grounding. EMAD’s contributions include the AD-MultiSense dataset, which generates rationales similar to RAR but with expert validation. It also performs region grounding by explicitly segmenting regions, such as the hippocampus, in voxel space.
Regarding the novelty, there are works like:
- REMEMBER (ACM MM 2025): combines brain-MRI/text alignment, similar-case retrieval, evidence integration, and diagnostic explanations.
- Region-guided radiology report generation (Interactive and Explainable Region-Guided Radiology Report Generation, CVPR 2023) explicitly connects regional features with generated descriptions
- Reg2RG (TMI 2025): applies region-guided referring and grounding to volumetric CT report generation.
So currently, the idea of RAR looks more like a combination of these adapted to brain MRI for Alzheimer’s classification. What is included beyond existing retrieval-guided diagnosis and region-grounded report generation is unclear.
- AD-Reasoning is a withdrawn submission in ICLR 2026 and accepted to CVPR 2026 as EMAD. The paper should discuss and distinguish itself from EMAD, a closely related approach to sentence–evidence–anatomy grounding. EMAD’s contributions include the AD-MultiSense dataset, which generates rationales similar to RAR but with expert validation. It also performs region grounding by explicitly segmenting regions, such as the hippocampus, in voxel space.
Regarding the novelty, there are works like:
-
Insufficient validation of patient-specific diagnostic faithfulness:
- The targets utilized is not convincing. ADNI, AIBL, NACC, and OASIS are all well-known datasets, but without any regional abnormality ground truth. The authors use Qwen to generate this rationale without doctors in the loop for validation. This is not truly reliable because agreement with these references may not reflect clinically correct, patient-specific reasoning about abnormalities. Additionally, Dice against anatomical masks establishes correspondence with the named structure, but does not establish that the structure is abnormal or that the generated finding is correct. Therefore, these results cannot be interpreted as validation of abnormality localization. The paper only evaluates region-text grounding rather than diagnostic faithfulness, given that the target is AD diagnosis. Importantly, Torok et al. (2018)’s analysis using the scores for identifying the regions of atrophy was done on a controlled setup with age-matched groups, but that is not the case with RAR, since it pools multiple datasets with cohort differences. Consequently, its deviations and derived severity descriptions may reflect differences in the reference population rather than disease-specific abnormalities.
- The interpretability analysis is only limited to if the regions match the regions queried, but, it is still unsure if the right atropied regions are discovered, in other words, matching a region’s name to its anatomical location does not necessarily mean the generated statement correctly describes that patient’s abnormality, or that the highlighted region drives the diagnosis. Example: Consider: “The hippocampus shows severe bilateral atrophy.” and “The hippocampus is relatively preserved.” Both can receive high dice scores, but they do not establish whether the atrophy is truly present and if the diagnosis follows it. This does not convince me that RAR can be used for patient-specific diagnostic reasoning. Also, how does anatomical grounding change with and without the retrieved text augmentation? Its unclear if the grounding is enforced by the image or anatomical and diagnostic associations from the retrieved rationale embeddings.
- The evaluation metrics for the report generation BLEU/ROUGE, are insufficient for clinical factuality. Rather, I would be more interested to see if the right regions are identified, along with the right volumes or descriptions. Since, the model has been trained to focus on very specific regions, I wouldn’t be surprised if the model identifies the hippocampus; rather, I would be interested if the model says that “The hippocampus (HC) also shows marked bilateral atrophy(left: 34%, right: 33%)”, etc. These distinctions and analysis of the right location, severity, abnormality direction, and numerical accuracy are crucial since the paper is motivated to do so.
-
Experiments: Since the datasets considered are imbalanced, metrics like the balanced accuracy should also be reported because ACC could be misleading. Table 2 and Table 3 reports performance on the internal test set and not on the external AIBL. Also, variability across training seeds is not reported. The experiments are limited to only 3-way classification. The details of the architecture, preprocessing pipeline, hyperparameter details, etc., are missing for reproducibility.
Questions for authors
Please address the weakness.
Other questions:
- Are the target and non-target regions defined per subject for Anatomy-Guided Attention Regularization or chosen in general based on the class label? Rel-SA (CVPRW 2025) also uses regional bias through the attention mechanism. Can this be adapted and compared with Anatomy-Guided Attention Regularization?
- Missing details: How exactly are attention maps converted into masks for Dice? How are diagnostic probabilities and accuracy computed?