W1. Insufficient positioning of the contribution and comparison with related methods
The main components of GAR all have relevant precedents: visual token aggregation, cross-frame information integration, and token-level late interaction. Although the paper discusses some prior work, it does not sufficiently explain what the hierarchical conduit construction contributes beyond existing prototype-matching and multi-granularity alignment methods.
In particular, two closely related works are neither discussed nor compared against:
● ProST [1] performs hierarchical video–text matching through spatial object prototypes and temporal event prototypes.
● UCoFiA [2] jointly performs cross-modal alignment at the patch, frame, and video levels.
Both are directly relevant to the core motivation and representational organization of this paper. The authors should clarify how GAR differs from them in prototype construction, cross-frame aggregation, and matching mechanism, and should provide corresponding comparative evidence.
The experiments also omit other relevant methods, including HBI [3], UATVR [4], DiCoSA [5], and T-MASS [6]:
● T-MASS reports 50.2% R@1 with ViT-B/32 and 52.7% with ViT-B/16 on MSR-VTT.
● UCoFiA reports 49.4% R@1, a result that includes Sinkhorn-Knopp normalization.
These methods differ in query dependence, sampling, and post-processing. I therefore suggest either including their results with the comparison conditions clearly annotated, or explaining why they fall outside the scope of this comparison.
The paper should also distinguish between results quoted from the literature and results reproduced by the authors. GAR's reported preprocessing and main training configuration match those of Video-ColBERT [7], but the two differ in loss function, query expansion, and matching branches. These design differences do not by themselves make the comparison unfair. They do mean, however, that the performance gap cannot be attributed solely to the conduit representation. A reproduction under a unified pipeline, together with controlled comparisons, would allow a more accurate assessment of the contribution.
W2. Small improvements over the closest baseline, with insufficient evidence of stability
According to Tables 2 and 3, GAR improves R@1 over Video-ColBERT by only 0.1–0.6 percentage points in seven of the eight dataset/backbone settings. The paper reports no means or standard deviations over multiple random seeds and no paired bootstrap or other statistical analysis. It is therefore unclear whether these small advantages are stable.
In addition, Figure 4 shows that R@1 ranges from 44.2% to 48.5% across α/β configurations, so the compression configuration has a substantial effect on performance. Appendices B.2 and B.3 justify the final hyperparameters using the reported results, but they do not say whether the test set was involved in hyperparameter selection, nor what criterion determined the final model configuration.
This sensitivity does not by itself bear on statistical significance. Combined with the small margins over the baseline, however, it makes repeated runs and a clear account of parameter selection necessary to support the reliability of the comparison.
W3. Current ablations do not establish the independent contribution of the GMM and of conduit initialization
The existing ablations show that GMM refinement and soft assignment are effective together. They do not show whether the GMM is better than other clustering schemes, or whether initialization from cross-frame conduits is necessary.
I recommend the following controlled comparisons, all using the same encoder, training configuration, downstream Transformer, and output token budget:
● GMM versus alternatives such as K-means;
● conduit-based mean initialization versus standard initialization;
● applying a GMM directly to all video patches, without the graph-based stages.
In the initialization ablation, the number of components per video should be held fixed, so that the effect of the initialization strategy can be separated from the effect of the number of components. These comparisons would show whether the gains come from the GMM itself, from the initialization provided by the cross-frame graph structure, or from patch aggregation more generally.
W4. Efficiency evaluation lacks measured comparison of video representation construction
The paper quantifies cached embedding size and the number of similarity computations needed for query–video matching. It does not compare the actual cost of the full video representation pipeline. GAR adds intra-frame affinity computation, graph construction, connected-component extraction, and per-video GMM fitting. The authors should therefore report:
● offline construction time, throughput, and memory overhead relative to methods such as Video-ColBERT;
● how often the GMM is fitted during training, and how this affects training throughput.
Moreover, fewer similarity computations do not necessarily translate into faster online retrieval. In its experimental setting, Video-ColBERT observed that single-branch and dual-branch matching had very similar query latencies even though they required different numbers of dot products [7, Appendix, Sec. 9]. The reported reduction in cache size is valuable, but measuring actual query latency under unified hardware, gallery size, and batching conditions is needed to fully assess the overall efficiency gains.
[1] P. Li et al. Progressive Spatio-Temporal Prototype Matching for Text-Video Retrieval. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
[2] Z. Wang et al. Unified Coarse-to-Fine Alignment for Video-Text Retrieval. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
[3] P. Jin et al. Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
[4] B. Fang et al. UATVR: Uncertainty-Adaptive Text-Video Retrieval. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023.
[5] P. Jin et al. Text-Video Retrieval with Disentangled Conceptualization and Set-to-Set Alignment. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2023.
[6] J. Wang et al. Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
[7] A. Reddy et al. Video-ColBERT: Contextualized Late Interaction for Text-to-Video Retrieval. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 19691–19701, 2025. arXiv:2503.19009.