- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SignRet for bidirectional sign-language–text retrieval, combining (i) Sign Language Description Enhancement (SDE), which injects MLLM-generated frame-level gesture descriptions into RGB clip features via temporally aligned local cross-attention, and (ii) Candidate Ranking Refinement (CRR), which applies listwise contextual re-scoring to top-K candidates using relative scores, reverse-matching statistics, and global similarities. Experiments on PHOENIX-2014T, How2Sign, and CSL-Daily show consistent gains over SEDS (e.g., +4.5/+3.8 R@1 on PHOENIX-2014T) with modest latency overhead.
Critical strengths
The core strength is the complementary two-level design: SDE addresses the representation bottleneck (fine-grained gesture cues missing from RGB) while CRR addresses the ranking bottleneck (listwise context ignored by pairwise scoring). This cleanly disentangles two distinct failure modes, and the component ablations (Tables 2, 6, 7) convincingly show they are complementary (SDE alone +2.1/+3.1, CRR alone +3.8/+0.7, both +6.5/+4.7 R@1 on CSL-Daily RGB). Second, the method is practically efficient — descriptions are generated offline and CRR adds only ~2.6–2.8 ms/query over the baseline (Table 8), making the gains cheap to obtain. Together these make the approach consequential: it is a realistic, deployable refinement of a strong existing backbone rather than a costly redesign.
Critical weaknesses
- The English language needs to be revised, as there are obvious traces of AI translation. The abstract contains garbled citation strings and machine-translation artifacts (e.g., "(Jang et al.,2025;Guan et al.,2025;Guo et al., 2025;\ i;\ \ ;\ \ {i t\ \ l a l,\ 025…"), equations are broken in multiple places (e.g., "D__{Ω_{l}},,", "V22" vs. V2T, "δ>0\ s the required margin"), and spacing/punctuation errors recur throughout (e.g., "videos.Natural"). Given ICLR's explicit scrutiny of AI-polished text, this level of drafting care undermines the paper's credibility and requires full revision.
- Table 1 should include the references for the comparison methods, and it would be even better if the publication years of these comparison methods could also be clearly indicated. Currently the main comparison table lists SA-SR, SA-CM, SA-COMB, GFSLT-VLP, CiCo, UPRet, and SEDS without citations or years, forcing readers to guess their provenance and recency. As the central evidence for the claimed state-of-the-art status, Table 1 must be self-contained and traceable.
- The comparative experiment was only conducted in comparison with one method involving pose (SEDS), which is clearly insufficient. The pose-based ablation (Table 5) appears only on PHOENIX-2014T, and the main tables contain no other pose-based competitor. Consequently, the gains attributed to SignRet could be confounded with the contribution of the pose stream itself; without multiple pose-based baselines (e.g., pose-enhanced variants of CiCo or C2RL), the source of improvement is not cleanly isolated.
- Due to the lack of recent work, the advancement of this paper has been questioned. Most baselines date from 2023–2024 (CiCo, SEDS, UPRet); recent sign-language retrieval advances (e.g., SignCLIP's multilingual contrastive pretraining, hard-negative mining approaches cited in the related work) and strong recent generic text–video retrieval methods with demonstrated transferability are cited but never evaluated. The claimed SOTA position is therefore not convincingly established against the current frontier.
- There is a lack of quality and robustness analysis for the reliance on the descriptions generated by MLLM. The frame-level descriptions are taken wholesale from MMSLT's LLaVA-OneVision setup, yet there is no analysis of description accuracy, failure modes, or sensitivity to the prompt — even though a single mis-described frame (e.g., wrong handshape) directly contaminates the enhanced clip features. Nor is there an experiment replacing LLaVA-OneVision with another MLLM to show the framework is not tied to one captioner. Combined with the transductive use of full-split ranking statistics in CRR (potential train/test information leakage without discussion), these omissions weaken the robustness claims.
Questions for authors
- The English language needs to be revised, as there are obvious traces of AI translation. The abstract contains garbled citation strings and machine-translation artifacts (e.g., "(Jang et al.,2025;Guan et al.,2025;Guo et al., 2025;\ i;\ \ ;\ \ {i t\ \ l a l,\ 025…"), equations are broken in multiple places (e.g., "D__{Ω_{l}},,", "V22" vs. V2T, "δ>0\ s the required margin"), and spacing/punctuation errors recur throughout (e.g., "videos.Natural"). Given ICLR's explicit scrutiny of AI-polished text, this level of drafting care undermines the paper's credibility and requires full revision.
- Table 1 should include the references for the comparison methods, and it would be even better if the publication years of these comparison methods could also be clearly indicated. Currently the main comparison table lists SA-SR, SA-CM, SA-COMB, GFSLT-VLP, CiCo, UPRet, and SEDS without citations or years, forcing readers to guess their provenance and recency. As the central evidence for the claimed state-of-the-art status, Table 1 must be self-contained and traceable.
- The comparative experiment was only conducted in comparison with one method involving pose (SEDS), which is clearly insufficient. The pose-based ablation (Table 5) appears only on PHOENIX-2014T, and the main tables contain no other pose-based competitor. Consequently, the gains attributed to SignRet could be confounded with the contribution of the pose stream itself; without multiple pose-based baselines (e.g., pose-enhanced variants of CiCo or C2RL), the source of improvement is not cleanly isolated.
- Due to the lack of recent work, the advancement of this paper has been questioned. Most baselines date from 2023–2024 (CiCo, SEDS, UPRet); recent sign-language retrieval advances (e.g., SignCLIP's multilingual contrastive pretraining, hard-negative mining approaches cited in the related work) and strong recent generic text–video retrieval methods with demonstrated transferability are cited but never evaluated. The claimed SOTA position is therefore not convincingly established against the current frontier.
- There is a lack of quality and robustness analysis for the reliance on the descriptions generated by MLLM. The frame-level descriptions are taken wholesale from MMSLT's LLaVA-OneVision setup, yet there is no analysis of description accuracy, failure modes, or sensitivity to the prompt — even though a single mis-described frame (e.g., wrong handshape) directly contaminates the enhanced clip features. Nor is there an experiment replacing LLaVA-OneVision with another MLLM to show the framework is not tied to one captioner. Combined with the transductive use of full-split ranking statistics in CRR (potential train/test information leakage without discussion), these omissions weaken the robustness claims.