- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes EvoRG framework for longitudinal radiology report generation. Unlike prior work relying solely on static comparisons, EvoRG explicitly models disease evolution. It first aligns cross-visit visual features via shared prototypes and Sinkhorn optimal transport. Then, it captures disease transitions as geodesic trajectories on a product-sphere manifold, extracting tangents, midpoints, and distances as evolution descriptors. These then are fused to condition an LLM for report generation.
Critical strengths
- The paper focuses a clinically relevant problem in longitudinal radiology report generation: accurately describing the interval changes of persistent abnormalities, rather than solely identifying differences between two static exams. The change from detecting what has changed to characterizing the direction and magnitude of that change provides a strong and clear motivation for this framework.
- The proposed framework EvoRG has a coherent three-stage pipeline: disease-wise alignment, geometric modeling, and guided generation. The extraction of geodesic midpoints, tangents, and distances is particularly effective, as they offer complementary descriptions of intermediate states, movement directions, and transition magnitudes. Furthermore, the distance-aware fusion module sensibly balances these two types of information for report generation.
Critical weaknesses
- I have a concern regarding how the geodesic trajectory is constructed. It is fitted between two latent endpoints, but there is no clear evidence that this geometric path corresponds to how the disease actually evolves. The formulation ignores the actual time gap between exams or any intermediate observations. Hence, the method seems to model only the spatial displacement between endpoints, rather than true disease dynamics. The authors need to provide further justification.
- I am not convinced by the current clinical validation. Although the authors report Temporal F1 and provide qualitative examples, these evaluations do not sufficiently support whether EvoRG reliably identifies clinically meaningful changes, such as improvement, worsening, or stability. A more systematic evaluation is needed.
- The DTF module shows a mixed impact. It clearly helps with clinical precision, recall, and F1, which is great. However, we also observe a slight decrease in CIDEr (0.305 vs. 0.309 without DTF). This trade-off suggests that the fusion might not universally improve the generation quality. It would be helpful if the authors provides a more detailed analysis to show which aspects of report generation benefit from this module.
Questions for authors
- How do the authors justify interpreting the shortest geodesic between two latent endpoints as a meaningful representation of disease evolution, rather than merely a geometric interpolation?
- Beyond general report similarity and label agreement, can the authors directly evaluate disease evolution? Please report the accuracy of identifying improvement, worsening, stability, and new findings, preferably with radiologist annotations. This would confirm whether the performance improves truly because of better evolution modeling.