- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper focuses on the data scarcity challenges in the field of endangered machine translation. It uses a fine-grained data augmentation method, along with bilingual dictionary augmentation, lexical augmentation, and confidence-aware example selection. The examples selected by a pre-trained ByT5 model show a positive effect on the translation metrics.
Critical strengths
- An easy-to-apply unsupervised data selection method based on the confidence generated by pre-trained models
- Illustrate that data augmentation is an effective method for data-scarce languages like Manchu–Mandarin
Critical weaknesses
- first the base model is limited to one pre-trained model, which cannot show the generality of this data augmentation method
- The endangered languages may not be suitable for this data augmentation method; more languages are needed to support this method.
- Currently, LLMs are able to receive large context to do context learning on machine translation. In this paper, the dataset is small enough to be loaded and used to test this current paradigm with SOTA models like GPT-6.1 and DeepSeek-4.1-flash, which lack the capacity to support this data augmentation method and supervised training.
Questions for authors
NA
2 comments
Thanks to the authors, my questions have been answered, and I will keep the score.
We added NLLB and Qwen to form a three-architecture, four-task comparison, extended experiments to Mandarin→Manchu, Yi→Mandarin, and Swahili→English with reported BLEU gains, added LLM comparisons with DeepSeek-4.1-flash and GPT-6 (BLEU 31.43 and 33.94), transparently reported the associated data-contamination risk, and reiterated that this paper focuses on training deployable models under constrained resources.
We thank the reviewer for the suggestions on model generality, language coverage, and LLM comparison. We added two architectures and three translation tasks, and ran an initial LLM comparison that revealed a data-contamination risk, reported transparently below.
Critical Weaknesses Weakness 1: First the base model is limited to one pre-trained model, which cannot show the generality of this data augmentation method.
We agree that using only ByT5 is insufficient. We added NLLB-200-distilled-600M and Qwen2.5-1.5B-Base, forming a three-architecture comparison across Manchu→Mandarin, Mandarin→Manchu, Yi→Mandarin, and Swahili→English. On Manchu→Mandarin, DKC raises BLEU for ByT5, NLLB, and Qwen from 16.00, 15.82, and 0.85 to 18.02, 19.10, and 8.11. Selection preferences also differ by architecture: ByT5 and NLLB favor high-confidence samples, whereas Qwen favors low-confidence samples, revealing model dependence (Sections 4.3.1–4.3.2; Appendices A–C).
Weakness 2: The endangered languages may not be suitable for this data augmentation method; more languages are needed to support this method.
Manchu is itself endangered, with extremely scarce parallel data and no mature tokenization or alignment tools, which is precisely why augmentation under limited resources matters. We added ByT5 Mandarin→Manchu, ByT5 Yi→Mandarin, and NLLB Swahili→English. BLEU rises from 16.00 to 25.40 (+9.40) for ByT5 Manchu→Mandarin, from 14.15 to 18.01 (+3.86) for Mandarin→Manchu, and from 19.59 to 23.22 (+3.63) for Yi→Mandarin. NLLB Swahili→English provides a richer-knowledge control, and selection preferences vary by language. These gains reflect the overall training scheme rather than augmentation alone (Section 4.3; Appendices A–B).
Weakness 3: Currently, LLMs are able to receive large context to do context learning on machine translation. In this paper, the dataset is small enough to be loaded and used to test this current paradigm with SOTA models like GPT-6.1 and DeepSeek-4.1-flash, which lack the capacity to support this data augmentation method and supervised training.
Our work targets trainable models exploiting a dictionary plus few parallel sentences, a different resource assumption from long-context in-context learning. We agree an independent LLM comparison matters: DeepSeek-4.1-flash and GPT-6 achieve BLEU of 31.43 and 33.94. However, we found a data-contamination risk. For "emu aniya de duin forgon bi", the reference is "一年有四季" and DeepSeek-4.1-flash outputs "一年有四季。"; for "mini gebu batu sembi", the reference is "我的名字叫巴图" and it outputs "我的名字叫巴图。". Both match after ignoring final punctuation, including the noun "batu". These results clarify our question: improving deployable models under limited compute and supervision via dictionary adaptation, augmentation, and training scheduling. Future work will add stricter comparisons and contamination detection.
Questions for Authors NA
No separate questions were raised; the comments on generalization, language scope, and LLM comparison are addressed in Weaknesses 1–3.
We thank the reviewer for the broader perspective and candid criticism. As a team new to this direction, we had not fully considered cross-model applicability, cross-lingual validation, or the relationship with frontier LLMs. Your comments led us to extend to three architectures and multiple tasks and to add an initial LLM comparison, helping us rethink the paper's positioning. Constrained by capability, compute, and time, we have not completed all ideal validation, especially the strict long-context comparison, for which we are sorry. Your suggestions have opened new directions we will pursue in future work.
Sincerely, The Author Team