- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
SignRAG proposes a unified framework for gloss-free sign language translation using decoder-only LLMs. It combines hierarchical pretraining for visual-language alignment, target-domain retrieval augmentation for additional translation cues, and retrieval utility-guided reinforcement fine-tuning to improve the use of retrieved information. Experiments on four SLT benchmarks demonstrate good performance.
Critical strengths
1.Strong empirical results across multiple SLT benchmarks. 2.Effectively integrating retrieval augmentation and reinforcement learning into gloss-free SLT.
Critical weaknesses
- Although the combination of the three core components achieves strong empirical results, the paper does not clearly establish its novelty over prior work. The proposed framework appears more like an integration of existing techniques than a substantially new methodological contribution.
- The experiments do not sufficiently isolate the proposed contributions, and some comparisons are not fully controlled.
- The RUG-RFT reward design does not clearly demonstrate that it effectively encourages the use of beneficial retrieval information, rather than simply rewarding outputs that the model already favors.
- It remains unclear whether the substantial performance gains from hierarchical pretraining stem from its specific design or primarily from additional supervision and training stages.
Questions for authors
1.The problem addressed by Hierarchical Pretraining is very similar to that of FLa-LLM. Why is the staged training strategy in FLa-LLM insufficient, and what additional challenges are addressed by the architectural differences introduced in SignRAG? 2.What are the novel technical contributions of Target-domain Retrieval compared with existing retrieval-augmented methods? Furthermore, the paper does not sufficiently demonstrate that the proposed Attention-weighted Similarity outperforms simpler retrieval strategies, such as global feature cosine similarity. 3.RUG-RFT measures retrieval utility through likelihood differences, but an increase in likelihood does not necessarily indicate that the retrieved information contributes to correct translation. Furthermore, the reward only retains positive likelihood differences without explicitly penalizing harmful reliance on incorrect retrievals. Can the authors demonstrate that RUG-RFT effectively distinguishes between beneficial and harmful retrieved information, rather than merely increasing the model's confidence in its generated outputs?