- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
VESP combines schema-guided field-specific visual retrieval, visual-text finding alignment, and inference-time candidate-token refinement for structured MRI report generation. The reported gains on shoulder MRI and KneeCoT are promising. However, the experiments do not adequately separate the proposed evidence-preservation explanation from simpler effects of auxiliary classification and score fusion. Important direct baselines and implementation details are missing, and a numerical inconsistency affects the results discussion.
Critical strengths
- The reporting schema connects visual representations, auxiliary supervision, and generation-time decisions.
- The shoulder and knee datasets provide evidence across different anatomy, imaging configurations, and schemas.
- The main comparison tables include confidence intervals, and the progressive ablation provides an initial breakdown of gains.
Critical weaknesses
- Diagnosis fields differ from earlier Findings fields in task, class distribution, difficulty, and graph connections. The section analysis therefore does not isolate position or prefix length. Reordering sections, placing the same field at different positions, and testing image removal or replacement would more directly assess the mechanism.
- A direct classifier-to-template baseline is missing. The model already predicts field-level visual labels from a predefined option set. Directly rendering these predictions into the schema, or applying simple classifier-language-model score fusion, would test whether the full proposed pathway is needed.
- The ablations do not establish that all components are necessary. In Table 3, SVEL changes shoulder micro-F1 from 73.36 to 73.48, only 0.12 points without an uncertainty estimate. Sequential additions cannot isolate each component. Controls for graph propagation, auxiliary classification, KL alignment, and a simplified ERAD design are needed, preferably on both datasets.
- Reproducibility details are incomplete. Figure 2 depicts ERAD gates and thresholds that are not fully defined in Section 3.4. The complete training objective, loss weights, extraction point of H_f, volumetric input handling, schemas, and annotation validation protocol need clarification. In particular, the paper should state whether H_f has observed the target field value during training.
- Results reporting requires correction. The page 7 text reports shoulder Med3DVLM F1 and recall as 35.58 and 24.48, while Table 1 gives 57.22 and 56.46. The associated explanation depends on the former values. KneeCoT BLEU-4 values near 0.99 also warrant a precise account of template normalization and metric computation, together with rare-condition and default-option baselines.
Questions for authors
See weakness.