- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SPELL-OUT, a cross-lingual alignment method that aims to preserve shared semantic progression while allowing language-specific representations to remain distinct. The method aligns teacher-forced prediction-residual trajectories across parallel languages and introduces a source-side preservation objective to limit representation drift. Experiments across multiple multilingual models and language pairs evaluate target-language adaptation and source-language retention. The authors further analyze representation trajectories, ordering correspondence, and sensitivity to source languages and training objectives.
Critical strengths
-
The paper addresses a meaningful problem in cross-lingual alignment. Directly aligning representations across languages may overlook differences in word order, grammatical structure, and linguistic expression. The idea of preserving shared semantic progression while allowing language-specific realizations is a reasonable and interesting direction.
-
The proposed method is clearly formulated and accompanied by several analyses. SPELL-OUT combines teacher-forced residual trajectories, source-anchored relational alignment, and explicit source preservation. The authors also examine representation geometry, ordering correspondence, source-language sensitivity, and objective-weight sensitivity, rather than relying solely on downstream performance.
Critical weaknesses
-
The empirical improvements are marginal, and their statistical significance is unclear. The gains are also relatively small across individual models. It is helpful to establish whether the improvements are consistent across random seeds and statistically significant. Without such evidence, the practical effectiveness of the proposed method remains unclear.
-
The connection between the proposed objective and semantic progression is not sufficiently established. SPELL-OUT aligns prediction-residual trajectories, but it is unclear why these residuals should reliably capture semantic progression rather than token prediction errors or other language-specific effects. While the representation-level analyses show that SPELL-OUT better preserves trajectory geometry, this does not necessarily demonstrate preservation of semantic progression.
Questions for authors
-
Regarding the empirical improvements: Are the gains reported in Table 1 consistent across random seeds and statistically significant? Given the relatively small differences compared with Vanilla and SFT + Pres., additional evidence of their robustness would materially strengthen the empirical conclusions.
-
How much of the observed improvement and representation preservation can be attributed specifically to the relational alignment objective rather than source preservation? In particular, could the authors provide a controlled comparison of these components, including the representation-level analyses?