Why Better Cross-Lingual Alignment Fails for Better Cross-Lingual Transfer: Case of Encoders

Excerpt

arXiv:2603.18863v2 Announce Type: replace Abstract: Cross-lingual alignment is often assumed to improve cross-lingual transfer by bringing representations of different languages closer together. However, improvements in representational alignment do not consistently translate into better downstream performance. We investigate this disconnect using XLM-R models explicitly aligned across four language pairs with token-level, sentence-level, and masked-language-modeling objectives. We evaluate thei