- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
SpineDiag introduces a multimodal scoliosis dataset of 155 subjects, pairing body-surface images, depth, anatomical keypoints, and clinical descriptions. It benchmarks pose estimation and VLM-based assessment for radiation-free spine evaluation.
Critical strengths
The dataset addresses a clinically meaningful problem and provides paired modalities rarely available in existing spine benchmarks. Surgeon-reviewed annotations and subject-level splits are valuable design choices. The experiments also highlight that good keypoint accuracy does not necessarily imply accurate curvature estimation.
Critical weaknesses
- Unvalidated reference consistency. Cobb references mix radiographic measurements with estimates derived from visual annotations (Section 2.2). Without validating their agreement and reporting results separately, the clinical meaning of pooled Cobb errors remains unclear.
- Confounded modality comparisons. Table 6 evaluates different input settings on different image subsets. Although acknowledged, this prevents attributing performance differences to structured keypoints or depth, weakening a central empirical conclusion.
- Insufficient validation of diagnosis scores. The clinical justification for the VQA weighting and the agreement between LLM-based scoring and independent clinician assessments are not established (Sections 3.2 and 4.3). Surgeon verification of reference descriptions does not validate the scoring of model outputs.
Questions for authors
- What proportion of Cobb references comes from each source, and do the main findings hold when evaluated exclusively against radiographic measurements?
- Do the conclusions about structured keypoints and depth remain valid when all input settings use identical training and test cases?
- How well do the weighted VQA and LLM-verification scores agree with independent clinicians’ assessments of diagnostic correctness?