- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies partially relevant video retrieval (PRVR), where training data provide query–video pairings but do not identify the relevant content inside each video. The authors propose GRACE, which uses evidence during training to calibrate the constraints on unpaired candidates. SEAR treats the queries paired with each candidate video as semantic prior evidence and uses them to recalibrate candidate allocation. PAIR compares paired and unpaired relations at similar difficulty and uses positive-reference evidence to adjust their constraint weights. Experiments on Charades-STA, ActivityNet Captions, and TVR show higher Rsum on all three benchmarks.
Critical strengths
- The method has a clear motivation and division of roles. The paper argues that local matching scores are unreliable early in training, so using them to adjust unpaired candidates can reinforce the model’s initial preferences. Later, a high score may reflect candidate difficulty rather than local relevance. GRACE uses SEAR to reallocate candidate weights from semantic priors early in training, then uses PAIR to adjust constraint strength from task-derived evidence after controlling for difficulty. Each module improves the baseline when used alone.
- The mechanism analysis is consistent with the proposed roles. The overlap between SEAR’s semantic evidence and the retriever’s candidate ranking grows during training, which supports using semantic priors early and reducing their influence later. For PAIR, paired relations still show stronger local specificity after difficulty is controlled, suggesting that the task evidence contains information beyond candidate difficulty.
Critical weaknesses
- PAIR’s core statistic lacks direct validation against local relevance. Appendix C.3 says that the responsibility estimated by PAIR represents distributional compatibility, not the probability that a particular relation is truly relevant. The paper shows paired and unpaired differences after controlling for difficulty, but does not use local relevance labels or human judgments to test whether PAIR assigns relevance correctly to individual candidates.
- PAIR’s key adaptive rules are not fully specified. The paper does not give the exact computation of the attenuation strength lambda_a or the rule for deciding when the conditional statistics are too weak to use and identity refinement should be triggered. These choices affect the constraint adjustment and make the method harder to reproduce and the gains harder to attribute.
Questions for authors
- Could the authors clarify how the attenuation strength lambda_a is computed in PAIR, and how they decide when the conditional statistics are insufficient to trigger identity refinement?
- Could the authors manually check a subset of candidate relations from the existing experiments to assess how well PAIR’s responsibility agrees with actual local relevance?