- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a multi-expert collaborative optimization framework for low-resource Mongolian–Chinese machine translation, combining hierarchical multi-agent debate with ant colony optimization (ACO). The framework constructs a translation collaboration graph from candidate translations generated by heterogeneous expert models and explores iterative refinement and fusion paths. Intra-group debate identifies local translation errors, while inter-group interaction facilitates the exchange of high-quality paths and complementary information. Debate feedback is incorporated into transition estimation and pheromone updating to guide subsequent search.
Experiments on Mongolian–Chinese translation demonstrate improvements over several baselines, including single-expert translation, quality-estimation reranking, static multi-expert fusion, standard ACO, and flat multi-agent debate. Ablation studies and convergence analyses further examine the contributions of the proposed components.
Critical strengths
-
An interesting integration of multi-agent debate and collaborative search. The paper combines hierarchical multi-agent debate with ACO, allowing linguistic feedback to influence both transition estimation and pheromone updating. This provides a potentially useful mechanism for iterative translation refinement beyond conventional candidate selection and static fusion.
-
Consistent improvements over the evaluated baselines. The proposed method achieves the best BLEU, chrF++, and COMET scores among the evaluated approaches. The ablation results suggest that hierarchical debate, debate-aware search, and candidate fusion each contribute to the overall performance. The method also requires fewer model calls and lower inference latency than the flat multi-agent debate baseline.
Critical weaknesses
-
Limited consideration of Mongolian-specific linguistic characteristics. Although the paper focuses on Mongolian–Chinese machine translation, the proposed framework is largely language-agnostic. Mongolian has rich morphology, agglutinative word formation, and syntactic structures that differ substantially from Chinese. However, these linguistic characteristics are not explicitly incorporated into the debate or search mechanisms. Consequently, the task-specific motivation and novelty of the proposed approach remain insufficiently established.
-
Insufficient comparison with modern state-of-the-art language models. The expert pool consists of LLaMA-7B, BLOOM-7B1, and Qwen-7B, which are not representative of the capabilities of recent high-performing language models. Although the method outperforms the selected baselines, it remains unclear whether the proposed collaborative framework offers meaningful advantages over directly using a stronger contemporary model. Furthermore, the paper does not investigate whether combining modern efficient language models as heterogeneous experts could achieve a better translation quality–cost trade-off.
Questions for authors
I would appreciate clarification and additional evidence regarding the following two directions. Substantively addressing at least one of them would significantly affect my assessment of the paper.
-
Mongolian-specific linguistic characteristics: Given the morphological and syntactic differences between Mongolian and Chinese, how does the proposed hierarchical debate mechanism address translation errors related to morphology, grammatical relations, word order, and semantic omissions? Could the authors provide a linguistically grounded error analysis or demonstrate whether explicitly incorporating Mongolian-specific linguistic information into the debate mechanism improves translation quality?
-
Comparison with modern SOTA models: Why were LLaMA-7B, BLOOM-7B1, and Qwen-7B selected as the expert models instead of more recent and capable alternatives? Could the authors compare their framework against strong contemporary language models on the same Mongolian–Chinese test set? Alternatively, could they construct a heterogeneous expert pool using modern efficient or Flash-style language models and evaluate whether the proposed collaborative optimization framework can achieve competitive or superior translation quality under comparable inference costs?
I do not necessarily expect both directions to be fully explored. However, convincing evidence addressing at least one of them is important for establishing either the linguistic relevance or the practical advantage of the proposed approach.