- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper targets error accumulation in autoregressive radiology report generation and proposes LCC. Image and report representations are condensed into compact vectors and refined through a few steps of interaction in a shared space. During decoding, a consistency evaluator checks the generated prefix against the image at fixed intervals, and when the score falls below a threshold, a corrective vector is added to the embedding of the latest token. Generation, contrastive alignment, consistency discrimination, and correction losses are trained jointly. On IU X-Ray and MIMIC-CXR, the method achieves the best scores on most text metrics and clinical scores comparable to the strongest methods.
Critical strengths
1 Radiology report generation is highly sensitive to hallucinated findings because generated reports may contain clinically incorrect statements. The paper addresses a meaningful limitation of current autoregressive medical vision-language models.
2 The paper introduces a complete framework combining cross-modal semantic representations with generation-time consistency control.
Critical weaknesses
1 The central claim of detecting and correcting errors during decoding is not supported. Disabling only the corrective injection at inference lowers BLEU-4 on IU X-Ray by about one point, while removing the whole module lowers it by almost four, so most of the gain appears to come from the extra training losses rather than from decoding-time correction.
2 The experimental comparison is neither fair nor sufficient. Most baseline numbers are copied from the original papers, which use different backbones and settings. R2GenGPT, which has nearly the same architecture, is missing, and decoding-time hallucination mitigation and controlled decoding methods are neither compared nor discussed, which makes the novelty hard to judge. Clinical gains over the strongest methods are about half a point with no variance reported, and IU X-Ray has no clinical metrics.
Questions for authors
1 is "w/o MDCC" a retrained model or the same model with control disabled at inference, and how much do MIMIC-CXR clinical metrics change when only the injection is turned off?
2 Under the same backbone, how does LCC compare with R2GenGPT and with decoding-time hallucination mitigation methods such as VCD or OPERA, and can you add clinical metrics on IU X-Ray?
3 Most baseline numbers are taken from the original papers. Do all methods share the same data split, report section (findings only or findings plus impression), preprocessing, and label extractor? If not, can you rerun the strongest baselines (DART, MLRG, SAT-RRG) under your setting, given that LCC uses a 7B language model while many baselines use much smaller decoders?
4 Since the clinical gains over DART and MLRG are around half a point, can you report significance tests and confidence intervals for the main metrics?
5 comments
Response to Reviewer RjUb (Part 2 of 3)
We continue by addressing the experimental protocols and baseline comparisons.
3. Clarification of Experimental Protocols and Baseline Comparisons (W2, Q3)
We appreciate the reviewer's emphasis on transparent and reproducible comparisons across different RRG methods. To clarify the experimental settings and architectural differences, we have detailed the evaluation protocols in Appendix A.3 and expanded the backbone configurations and performance comparisons in Appendix B.1 (Table S2).
Specifically, LCC follows the conventional 7:1:2 split for IU X-Ray and the official MIMIC-CXR split, using the Findings section as the generation target. Clinical evaluation employs micro-averaged precision, recall, and F1 across 14 CheXpert observations, together with the official RadGraph F1 implementation. These settings are consistent with the clinical evaluation protocol reported by MLRG.
Regarding baseline reproduction, R2GenCMN and DCL are reproduced using their official implementations, while the remaining results are obtained from their original publications, as indicated in Table 1. For DART and SAT-RRG, publicly available official implementations suitable for direct reproduction could not be identified. Although MLRG provides an official implementation, it incorporates longitudinal information from historical examinations, whereas LCC uses current-study images. We therefore retain their published results and explicitly distinguish their backbone architectures and input configurations.
To provide a clearer comparison of model capacity, input settings, and performance, we have expanded Appendix B.1 (Table S2). Representative results on MIMIC-CXR are reproduced below.
As shown in Table S2, LCC (7B) and R2GenGPT share the same visual encoder and decoder backbone families, while LCC (3B) and SAT-RRG both employ Swin and LLaMA-3.2 3B. Compared with R2GenGPT, LCC (7B) improves BLEU-4 from 0.121 to 0.171 and clinical F1 from 0.445 to 0.539. Moreover, LCC (3B) achieves BLEU-4 of 0.168, clinical F1 of 0.539, and RadGraph F1 of 0.289, demonstrating competitive performance with a smaller decoder.
Importantly, these comparisons make the differences in model architectures and input settings explicit rather than assuming identical preprocessing or training configurations across published methods. The additional controlled experiment in Section 4.3 (Table 5) further evaluates the contribution of consistency-guided correction using identical trained model weights and decoding settings, thereby separating the effectiveness of the proposed mechanism from cross-model architectural differences.
Table S2 (Excerpt): Backbone configurations and performance comparisons on MIMIC-CXR. Long. indicates whether the model incorporates longitudinal information from prior examinations (Yes) or uses only current-study images (No).
| Models | Encoder | Decoder | Long. | B-1 | B-4 | MTR | RG-L | P | R | F1 | RG-F1 |
|---|---|---|---|---|---|---|---|---|---|---|---|
| R2GenGPT | Swin | LLaMA-2 7B | No | 0.392 | 0.121 | 0.133 | 0.275 | 0.485 | 0.412 | 0.445 | — |
| MLRG | RAD-DINO | DistilGPT2 | Yes | 0.411 | 0.158 | 0.176 | 0.320 | 0.549 | 0.468 | 0.505 | 0.291 |
| DART | ResNet-50 | Transformer | No | 0.437 | 0.137 | 0.175 | 0.310 | 0.520 | 0.546 | 0.533 | — |
| SAT-RRG | Swin | LLaMA-3.2 3B | No | 0.428 | 0.143 | 0.167 | 0.303 | — | — | — | 0.205 |
| LCC (3B) | Swin | LLaMA-3.2 3B | No | 0.425 | 0.168 | 0.191 | 0.329 | 0.551 | 0.528 | 0.539 | 0.289 |
| LCC (7B) | Swin | LLaMA-2 7B | No | 0.432 | 0.171 | 0.188 | 0.337 | 0.545 | 0.533 | 0.539 | 0.295 |
Response to Reviewer RjUb — Part 3 of 3
4. Statistical Reliability of Clinical Improvements (W2, Q4)
We appreciate the reviewer's concern regarding the statistical reliability of the improvements over strong baselines, particularly DART and MLRG. We would like to clarify that all reported LCC results are averaged over three independent runs, rather than obtained from a single experiment. Due to space constraints, the main paper presents the mean performance without separately listing standard deviations. To provide additional transparency, we summarize the performance variability across three independent runs below.
As reported in Table 1, LCC achieves clinical F1 of 0.539, compared with 0.533 for DART, and RadGraph F1 of 0.295, compared with 0.291 for MLRG, representing absolute improvements of 0.006 and 0.004, respectively. The three-run evaluation is intended to characterize the reproducibility of our reported performance.
Regarding statistical significance and confidence intervals, DART and MLRG are compared using their published results, without access to the corresponding per-study predictions or comparable run-level statistics. Consequently, we report these differences as numerical improvements rather than making unsupported claims of statistical significance. We hope the additional three-run summary clarifies the experimental stability and interpretation of the reported improvements.
Table R1: Performance across three independent runs on MIMIC-CXR.
| Models | B-4 ↑ | MTR ↑ | RG-L ↑ | P ↑ | R ↑ | F1 ↑ | RG-F1 ↑ |
|---|---|---|---|---|---|---|---|
| R2GenCMN | 0.101 ± 0.003 | 0.131 ± 0.004 | 0.268 ± 0.003 | 0.321 ± 0.004 | 0.262 ± 0.003 | 0.289 ± 0.004 | — |
| DCL | 0.101 ± 0.002 | 0.137 ± 0.003 | 0.274 ± 0.002 | 0.469 ± 0.003 | 0.341 ± 0.004 | 0.395 ± 0.003 | — |
| LCC (Ours) | 0.171 ± 0.003 | 0.188 ± 0.002 | 0.337 ± 0.002 | 0.545 ± 0.004 | 0.533 ± 0.003 | 0.539 ± 0.002 | 0.295 ± 0.002 |
Response to Reviewer RjUb — Part 1 of 3
We thank the reviewer for the constructive feedback and recognition of the clinical importance of our work. In response, we have strengthened the experimental analysis and clarified the evaluation protocols.
Our responses address four concerns: (1) inference-time corrective control (W1, Q1), (2) backbone and decoding comparisons (W2, Q2), (3) baseline fairness (W2, Q3), and (4) statistical reliability (W2, Q4). The first two are addressed below.
1. Concerns Regarding the Contribution of Inference-Time Correction (W1, Q1)
We appreciate the reviewer's concern that the effects of MDCC training and inference-time correction should be distinguished. To clarify their respective contributions, we have distinguished the retrained ablation from inference-only intervention and added a same-model comparison in Section 4.3 (Table 5).
Specifically, w/o MDCC in Table 2 is separately retrained after removing the MDCC module and its associated training objectives. In contrast, No Injection in Table 5 retains the fully trained LCC model and disables corrective injection only during inference. Thus, the two experiments evaluate different contributions rather than an additive decomposition of performance gains.
To isolate inference-time correction, we compare No Injection, matched-rate Random Injection, and LCC Guided Injection under identical trained model weights and decoding settings within each dataset. As shown in Table 5, enabling consistency-guided injection improves clinical F1 from 0.505 to 0.539 and RadGraph F1 from 0.263 to 0.295. On IU X-Ray, BLEU-4 increases from 0.202 to 0.213. Moreover, LCC outperforms random injection at matched rates of 26.4% on MIMIC-CXR and 24.8% on IU X-Ray, demonstrating that consistency-guided intervention timing provides additional benefits beyond corrective injection alone. These results establish the independent contribution of inference-time corrective control, complementing the overall MDCC ablation in Table 2.
Table 5: Comparison of inference-time intervention strategies on MIMIC-CXR.
2. Concerns Regarding Backbone and Decoding Comparisons (W2, Q2)
We appreciate the reviewer's request for comparisons with R2GenGPT, smaller language models, and decoding-time hallucination mitigation methods. To clarify these comparisons, we have expanded the backbone configurations and additional LCC evaluations in Appendix B.1 (Table S2).
First, R2GenGPT is included in Table 1 and Table S2. On MIMIC-CXR, LCC achieves BLEU-4 of 0.171 versus 0.121 and clinical F1 of 0.539 versus 0.445 for R2GenGPT. On IU X-Ray, BLEU-4 improves from 0.162 to 0.213. These results establish a comparison with an existing LLM-based RRG approach, while Table S2 makes the backbone configurations explicit.
Second, we additionally evaluate LCC with a 3B decoder. On MIMIC-CXR, LCC-3B achieves BLEU-4 of 0.168, clinical F1 of 0.539, and RadGraph F1 of 0.289, compared with 0.171, 0.539, and 0.295 for LCC-7B. These results demonstrate that the proposed framework remains effective with a smaller language model.
Regarding VCD and OPERA, we recognize the value of comparisons with general-purpose hallucination mitigation methods. VCD uses contrastive decoding based on visual perturbations, while OPERA regulates decoding through attention-based penalties and retrospection. In contrast, LCC periodically evaluates intermediate image–report consistency and conditionally injects learned corrective representations. The same-model comparison in Section 4.3 (Table 5) directly evaluates this mechanism, showing improvements over matched-rate random injection in clinical F1 (0.519 to 0.539) and RadGraph F1 (0.274 to 0.295). We consider systematic comparisons with VCD, OPERA, and related methods under unified medical generation settings an important direction for future work.
Regarding clinical evaluation on IU X-Ray, we appreciate the reviewer's suggestion to include clinical correctness metrics. IU X-Ray has a relatively small test set, making clinical metrics derived from automatically extracted findings more sensitive to individual cases and labeling variations. Moreover, the compared baselines in Table 1 do not report clinical metrics on IU X-Ray, but primarily adopt BLEU, METEOR, and ROUGE-L, which also motivates our use of these established metrics for consistent comparison. We therefore conduct comprehensive clinical evaluation on the substantially larger MIMIC-CXR dataset using CheXpert-based precision, recall, F1-score, and RadGraph F1. Furthermore, our additional controlled experiments in Section 4.3 (Tables 5 and 7) provide complementary evidence of improved clinical correctness and reduced error propagation during generation.