- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Q-VG introduces count prediction into weakly supervised visual grounding. It learns phrase-conditioned object slots, predicts how many targets the expression refers to, and uses that estimate to select candidate boxes. Training combines contrastive alignment, reconstruction, and count constraints derived from language. The paper also introduces QGround-Bench to test exact, generalized, and compositional quantity expressions, and evaluates the method on existing grounding datasets.
Critical strengths
-
Count constraints address a real limitation of weakly supervised grounding, and the loss comparisons support their contribution to the gains on existing datasets.
-
Separating exact, vague, and composed quantity expressions makes the benchmark more useful than a single counting test.
Critical weaknesses
- In the compositional protocol, a full-query box is dropped from Set-F1 if it cannot be matched to predictions from separate entity queries. Count-Acc still counts that box but cannot distinguish a correct target set from an equally sized wrong one, so the reported scores do not reliably measure the complete answer to the composed query.
Questions for authors
-
Please rescore the saved full-query outputs with one-to-one matching to all required targets, counting every unmatched prediction as a false positive. Does the compositional advantage remain without using separate entity-query predictions to filter or attribute boxes?
-
When the predicted count is too small, true target anchors outside the selected set become contrastive negatives. What prevents this from reinforcing under-counting? A training trace relating count errors to anchor selection would be useful.
-
Among correctly counted compositional queries, how many failures select the wrong instances rather than merely localizing the right instances poorly? Please separate relation-selection errors from box-overlap errors using existing outputs.
Thank you for the experiments. The response address my main experimental concerns. Though the contribution remains limited, I will increase my rating to 3.