- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper suggests to reuse the cross-attention key and value representations from the previous training unit. Also, to regulate the deviation of current representation from its historical reference, the paper suggest to use the Negative-Feedback Adapter. The paper further analyze the effectiveness of the suggested technique from the perspective of variance reduction analysis of HIRR, which is linked to a reduced effective sample requirement, and a local perturbation analysis showing that the negative feedback regulation can reduce representation deviations. Experiments on image-text retrieval report improvements over the baselines, as well as improved data efficienty.
Critical strengths
The paper proposed a effective technique with potentially interesting idea to use the historical information to improve the cross-attention-based VLMs.
Critical weaknesses
Weaknesses
- The manuscript does not currently meet the standards of academic writing expected for a conference paper.
- The paper lacks of essential sections such as Related Work, Background, or Preliminaries. As a result, it is difficult to understand how the proposed work relates to prior literature, what gap it is intended to address, and how it should be positioned within the current research landscape.
- More importantly, several citations do not appear to directly support the claims for which they are provided. I highlight two representative examples below:
- For example, in the Introduction, the authors cite [1] and [2] to support the argument “such as mini-batch sampling, limited training data, and stochastic optimization.” However, these references do not appear to be directly related to this claim.
- Similarly, the argument “their intermediate representations may therefore share statistical and cross-modal structural information even without sample-level correspondence.” is supported by citations to [3], [4], and [5], but it is difficult to identify a direct connection between these references and the stated assumption.
Given these issues, I believe the manuscript would require fundamental revisions before it could be considered suitable for acceptance as a conference paper. In particular, the citation issues described above also raise concerns regarding scholarly rigor and appropriate attribution. In its current form, I do not believe the manuscript has reached a sufficient level of academic maturity to support a meaningful technical evaluation.
[1] Li, Xiping, et al. "Cpgrec+: A balance-oriented framework for personalized video game recommendations." ACM Transactions on Information Systems 44.3 (2026): 1-44.
[2] Cheng, Zhiyong, et al. "Modeling Stage-wise Evolution of User Interests for News Recommendation." Proceedings of the ACM Web Conference 2026. 2026.
[3] Wang, Zening, et al. "ML-MIFD: Multi-Level Multimodal Invariant Feature Descriptor." The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences 49 (2026): 79-85.
[4] Pu, Ruitao, et al. "Deep reversible consistency learning for cross-modal retrieval." IEEE Transactions on Multimedia 27 (2025): 4095-4106.
[5] Duan, Siyuan, et al. "Fuzzy multimodal learning for trusted cross-modal retrieval." 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2025.
Questions for authors
I have no question.
2 comments
I appreciate the authors' response about clarification. However, I'm not particularly convinced by the authors' response, and also, there are numerous citations that raise me similar concerns. I'll not change my decision.
Thank you for identifying the two passages. The cited studies provide relevant evidence for narrower claims, and we agree that the Introduction should make the scope of each citation explicit.
Lines 64–66 — representation variability.
Cheng et al. (2026, §4.4) explicitly discuss how short temporal windows can produce sparse subgraphs and unstable representations in news recommendation. This provides a task-specific example of a link between data sparsity and representation stability. Li et al. (2026) address over-smoothing in graph convolution, which is a different phenomenon. We will remove Li et al. from this passage, limit the attribution to Cheng et al. to its specific setting, and cite Bottou et al. (2018, §4.2) for variability in stochastic mini-batch gradients.
Lines 40–44 — shared structure and sample correspondence.
Pu et al. (2025, §I) provide a direct precedent for learning modality-invariant category representations without instance-paired training. Duan et al. (2025, §1) explain how a shared embedding space can preserve semantic relationships across modalities, and their consistency objective uses matched instances (§3.3). Wang et al. (2026) demonstrate shared structural cues in cross-sensor image matching. These works motivate the possibility of shared structure across modalities. The common expectation of successive training batches in Theorem 1 is an explicit local modeling assumption of our paper. We will revise the passage to make that distinction clear.
Technical positioning and evidence.
Section 2.1 introduces the cross-attention formulation, and a dedicated Related Work section will make the comparison to ARXSA explicit. ARXSA uses a recurrent key in self-attention. Our method uses normalized historical mixing for both cross-attention keys and values and a separate, learned output correction driven by the current-to-history discrepancy. The β-CLIP/MS COCO full-model entries in Tables 1 and 7 come from the same runs using both operations as formulated. Table 7 also tests them separately. I2T R@1 rises from 61.9 for the baseline to 62.3 with historical K/V reuse alone and 62.1 with the adapter alone, reaching 63.1 with both. The adapter-only result provides direct evidence for the added output correction with historical K/V mixing disabled.