- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates dimensional concentration in contrastive 3D CT embeddings and proposes AdaRAG-CT for radiology report generation. The framework combines organ-indexed sentence retrieval with a learned retrieval token that selectively triggers context injection and sentence regeneration. Training mixes oracle and realistic retrieval contexts. On CT-RATE, the 8B model improves Clinical F1 from 0.455 to 0.480 over its retrieval-free baseline.
Critical strengths
The paper examines multiple CT encoders through complementary analyses of embedding geometry, abnormality classification, and retrieval quality. The framework is clearly described and improves both Clinical F1 and several textual metrics over its baseline. Comparisons across retrieval pipelines and injection strategies provide useful insights into how retrieved context affects report generation.
Critical weaknesses
The central bottleneck hypothesis is more strongly stated than the evidence supports, and the experiments do not clearly establish that retrieval recovers missing patient-specific information. The methodological advance over existing adaptive RAG approaches and the benefit of adaptive triggering remain insufficiently demonstrated. These limitations weaken both the conceptual contribution and the interpretation of the reported gains.
Questions for authors
-
The lower-variance directions retain useful abnormality classification signals, suggesting that information may be present but inadequately exploited by the similarity metric or decoder. Moreover, the generation model uses max-pooled CT-CLIP features, whereas the headline dimensional-collapse result concerns average pooling. Whitening, principal-component removal, or learned similarity metrics would help distinguish representational anisotropy from information loss. The weaker performance of the 70B model alone also does not rule out optimization or adaptation issues.
-
Learning a retrieval token closely follows Self-RAG, while generating a tentative sentence and regenerating it after retrieval resembles FLARE. Direct comparisons under the same settings are needed to establish the methodological contribution. In Table 5, fixed-interval retrieval achieves a higher Clinical F1 than adaptive retrieval (0.494 versus 0.480). Although adaptive retrieval improves textual metrics, its advantage should be evaluated under matched retrieval frequency and computational budgets.
-
It remains unclear whether retrieved text provides reliable patient-specific information. Since the query sentence is generated from the same limited visual representation, retrieval may reinforce an initially incorrect prediction rather than correct it. Reports from other patients do not establish that an abnormality is present in the current case. Random retrieval, organ-matched but abnormality-mismatched retrieval, and analyses of error correction versus amplification would clarify this issue. The 70% oracle-context training ratio also requires ablation.
-
Clinical F1 measures the presence of 18 abnormalities but does not assess location, laterality, size, or severity. Improvements in this metric therefore do not substantiate the claim that retrieval recovers fine-grained details missing from the visual representation. Attribute-level factual evaluation or expert assessment, together with examples showing changes in omissions and hallucinations before and after retrieval, would better support this claim.
-
The main comparison uses results from original publications, while the proposed method is evaluated on a filtered validation subset. The unified evaluation mentioned in the manuscript is not included in the provided PDF. Furthermore, the retrieval-free baseline already achieves 0.455 Clinical F1, exceeding CT-Agent’s reported 0.420. Comparisons on identical samples with the same evaluation pipeline, alongside separate controls for baseline design, retrieval training, and inference-time retrieval, are needed to attribute the gains accurately.