- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether multilingual sentence embeddings can be extended to languages without parallel corpora using lexical resources alone. The authors propose a lexicon-swappable sentence encoder distilled from a pretrained SONAR teacher using English text only. Its input representations are derived from a multilingual concept space built by propagating ConceptNet vectors through the PanLex translation graph, augmented with dictionary entries harvested by LLMs. For a new language, the model replaces its static word-embedding lookup table without updating the encoder parameters.
Critical strengths
I think the motivation of this paper is good: The lack of parallel corpora remains a major obstacle to developing NLP technologies for low-resource languages. Dictionaries and word lists are often more accessible than parallel sentences, so investigating whether they can support cross-lingual sentence representations is worthwhile. The proposed method is clean: the lexicon-swappable architecture is soild, the encoder remains fixed, and a new language can be introduced through lookup tables without language-specific model training. This could reduce the computational burden of supporting additional languages.
Critical weaknesses
1.My main concern of this paper is the novelty: The core architecture replaces a conventional token-embedding layer with static multilingual concept vectors and trains a Transformer to reproduce SONAR embeddings. The main technical components: knowledge distillation, graph-based lexical propagation, set encoders, and static cross-lingual embeddings are individually established techniques. The potentially novel element is their combination into a model whose lexical input can be swapped without further training. However, the paper does not sufficiently isolate how much of the improvement comes from this particular architecture versus the quality and alignment of the underlying concept space.
- Another possible miscliam is the language-independent transfer. The paper emphasizes languages without bitext and languages unseen by the teacher. However, the authors acknowledge that only 13 of the 216 FLORES+ devtest languages are genuinely outside SONAR's language list. This is a substantial limitation because the intended application is to languages that lack both parallel data and strong overlap with high-resource languages.
Questions for authors
see weakness part
Because I re-examined the paper and reviewed all of the reviewers' responses, my score adjustment is somewhat late. I ask for your understanding on this. From now on, we can have an active discussion. I will respond to the authors' replies as quickly as possible.
After reviewing the other reviewers' reviews together, I decided that I should lower my overall score to Clear rejection because of concerns about how the evaluation resources are built and because my own concerns have grown. According to Appendix C, the word vectors for evaluation are selected to match the FLORES+ word list, and words that are still missing are filled in through LLM search. Since both coverage and performance are measured on FLORES+ devtest, this reads as matching the words that appear in the test sentences in advance. Could you provide a response to this? Also, Table 3 shows that this final LLM step alone noticeably improves performance. In addition, the source of the sentences used to compute the word frequency ranking is not disclosed, and their amount is almost the same as the combined size of FLORES+ dev and devtest. If so, the main results and the coverage law may reflect performance under a condition where the words of the test sentences are known in advance, rather than performance on unseen sentences.
In addition, only a small number of languages are not supported by SONAR, and the coverage law has not been separately validated on language families that were not used for fitting.
If you show the above, I will consider adjusting my score.