- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
QGR combines medical visual question answering with object detection and query grounding. Its architecture uses shared representations and auxiliary localization supervision. The authors report improved answer and localization metrics on Med4VQA and additional evaluations, suggesting benefits from integrating spatial supervision, although question-specific grounding and generalization remain incompletely established.
Critical strengths
- Table 3 includes a detector-fusion comparison rather than only a language-model baseline. QGR improves localization while recovering answer performance degraded by simpler fusion. This supports a meaningful integration contribution, even though substantial localization capability already comes from the detector.
- Med4VQA provides a structured setting for jointly studying medical answers and localization. The architecture, auxiliary supervision, and reported component ablations make this a useful empirical direction. Evaluations across imaging modalities and additional datasets also expose both benefits and limitations, rather than relying on one aggregate result.
Critical weaknesses
- Equations 3–4 and Algorithm 1 use a single context token for cross-attention, making the attention output a shared context broadcast. Residual pathways can still support question dependence, but the manuscript insufficiently explains how question-specific targets, ranking, and final answers are connected. This ambiguity limits assessment of the central grounding claim.
- The evaluation does not fully establish question-specific grounding or robust transfer. Box measures top-ranked overlap at IoU ≥ 0.10, rather than mean localization quality; Table 12 shows mixed answer generalization. Generated target attributes and discrepancies between Tables 3 and 12 further require clarification before interpreting the broader claims.
Questions for authors
- Please trace the question-conditioned path from input through grounding queries, box ranking, and answer generation. Are ground-truth objects filtered by the question, and what score selects the reported box? A precise account would clarify whether the localization metric evaluates question-specific selection.
- What processing produces the single context token in Equations 3–4? How does auxiliary grounding supervision influence the answer pathway? Please distinguish direct inference connections from training effects through shared parameters; the latter can improve answers without directly exposing grounding outputs to the decoder.
- Please reconcile the Region results in Tables 3 and 12 and describe validation of generated question–attribute targets. Existing protocol details and annotations would help determine whether the reported gains reflect the intended task rather than differences in evaluation versions or target construction.