- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces CEF-OPD for corrective training in radiology report generation. A frozen RadGraph-XL extractor and deterministic rules identify the earliest generated claim that explicitly contradicts reference facts and construct a minimal correction preserving other extracted facts. Paired continuations from the erroneous and corrected claims estimate the downstream reference-relative cost difference.
Critical strengths
Sections 3.1–3.3 place supervision before the contradictory claim, targeting the decision that introduces the error. Excluding the edited claim from scoring and sharing the remaining reference targets prevent a positive propagation benefit from arising merely because the original error was edited away. Retaining omission penalties also discourages empty continuations when reference targets remain.
On MIMIC-CXR, the full method improves GREEN from 0.606 to 0.651, RG-ER from 0.397 to 0.326, and CE-F1 from 0.461 to 0.485 over Continued-SFT. These results support the practical potential of the training procedure.
Critical weaknesses
Equation (9) normalizes by batch size rather than the sum of weights. Replacing w_i=[ΔC_i]+ with uniform weights therefore changes both the allocation of supervision and its overall strength relative to SFT. Appendix B usefully matches episodes and optimization budgets and includes a lambda sensitivity analysis, but does not establish that the uniform baseline receives independent lambda tuning or matched mean weight. Consequently, the gains do not yet isolate the information supplied by ΔC. A constant-weight baseline matched to the mean weight, and a shuffled-weight baseline preserving the weight distribution, zero-weight fraction, and overall scale, would directly test this claim. Theorem 1 holds for arbitrary fixed nonnegative weights and bounds deviation from the mixed target's local risk; it does not establish that ΔC weights outperform other weights or that an update reduces free-running generation risk.
Section 3.1 relies on custom normalization, anatomical compatibility, claim segmentation, and editing rules, excluding several ambiguous cases. Validation of the underlying RadGraph-XL extractor does not by itself validate these additional decisions. Equation (2) checks edits using the same extractor, so shared extraction blind spots can survive this check.
Questions for authors
-
What exact weight is used in the uniform baseline? Was its lambda selected independently, or was its mean auxiliary weight matched to CEF-OPD?
-
How many examples remain at each stage: generated reports, detected contradictions, accepted edits, and positive-weight episodes? Which error types do they cover?
-
Can you quantify teacher–student support mismatch when conditioning the teacher on reference facts, and test anchored/partial-privilege targets to mitigate hindsight?