- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes HiSTAR, a framework for radiology scanpath prediction. It combines hierarchical clinical semantics from VLMs, spatial-guided temporal decoding, and geometry-attention consistency to generate scanpaths. Experiments on GazeSearch show improvements over existing methods, with additional downstream classification results.
Critical strengths
- Interesting Problem: Predicting radiologists' scanpaths is a meaningful task with potential clinical applications.
- Effective Framework: The proposed method combines clinical semantics with spatial and temporal modeling and achieves strong performance.
- Detailed Experiments: The paper provides comparisons with existing methods, ablation studies, and downstream classification experiments.
Critical weaknesses
- Unclear Novelty: The main components, including VLM-based semantic features, spatial attention, temporal decoding, and geometric constraints, are related to existing approaches. The paper should better clarify its technical novelty and new insights beyond combining these components.
- Limited Baseline Comparison: HiSTAR uses a strong external VLM to generate detailed clinical descriptions, while existing baselines do not use the same semantic information. It is unclear how much improvement comes from the proposed architecture rather than stronger VLM features.
- Limited Generalization: The main radiology scanpath evaluation is conducted only on GazeSearch, which focuses on target-present chest X-ray search. The performance on other medical datasets and target-absent cases remains unclear.
- VLM Dependency and Cost: The method relies on VLM-generated global and region-level descriptions. The impact of different VLMs, incorrect clinical descriptions, and the additional inference cost is not sufficiently evaluated.
Questions for authors
- Can the authors compare against baselines using the same VLM-generated semantic features?
- How robust is the method to inaccurate VLM descriptions or different VLM backbones?
- Can the authors provide further evaluation on independent medical scanpath datasets or target-absent cases?
- What is the total inference cost of generating the global and region-level clinical descriptions?
I am willing to adjust my score according to the rebuttal.