- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes PHAM-CECA to make prior images and reports more useful for longitudinal radiology report generation. PHAM uses separate patient-adapted fast-weight memories for historical visual and textual evidence, queried by the current image. CECA compares the same target report under full-history, text-history, image-history, and current-only contexts, and combines likelihood-advantage constraints with multi-context generation supervision. The paper also analyzes the induced retrieval mechanism and the context-advantage objective. On Longitudinal-MIMIC, PHAM-CECA achieves clinical F1 of 0.483 and ROUGE-L of 0.296. While the approach is well motivated, the evaluation does not directly establish better temporal-change reasoning, and the improvement over the full-history baseline is modest (F1: 0.477 → 0.483).
Critical strengths
-
Task-relevant memory design. PHAM adapts separate image and report memories to each patient and uses the current image to retrieve historical evidence, rather than relying on static history fusion.
-
Well-motivated optimization. CECA compares the same target across four contexts and retains reduced-context supervision to avoid directly rewarding degraded ablated-context predictions. The theoretical analysis makes the objective's assumptions and limitations clearer.
-
Useful ablations. PHAM improves clinical F1 over Static (0.465 vs. 0.429, Table 2); combining reduced-context supervision and advantage constraints achieves F1 0.483, compared with 0.474 and 0.469 when either component is used alone (Table 4).
Critical weaknesses
-
Temporal reasoning is not directly evaluated. CheXbert F1 measures clinical findings but does not verify whether a finding is new, persistent, improved, or resolved. The t-SNE plots and selected report examples are informative, but do not establish temporal-change accuracy over the test set. This leaves the paper's central longitudinal claim insufficiently tested.
-
Small gains without sufficient robustness evidence. Clinical F1 improves only from 0.477 (full-history baseline) to 0.483. The paper reports confidence intervals for context-advantage analyses, but not paired intervals or multi-seed variability for the main clinical gains. PHAM's benefit over a parameter-matched static, current-conditioned retriever is also unclear, limiting attribution to gradient-based adaptation.
Questions for authors
-
Report quantitative results for new, persistent, improved, and resolved findings; can the model distinguish cases with identical current labels but different historical states?
-
Provide paired confidence intervals or significance tests for the main F1 gains, accounting for multiple studies per patient where appropriate; report variability across training seeds.
-
Clarify the key/query and memory input/output dimensions relative to the stated 768→2048→4096 MLP, and specify how CECA's lower confidence bounds and calibration split are defined.