Cross-lingual Transfer Dynamics in Intermediate-Task Training Order for PAWS-X Paraphrase Identification

Zero-shot cross-lingual transfer is a central task in multilingual NLP, allowing models trained in languages with more sufficient training resources to generalize to other low-resource languages. Earlier efforts on this task use parallel corpora, bilingual dictionaries, or other annotated alignment data to improve cross-lingual transferability, which are typically expensive to obtain. In this paper, we propose a simple yet effective method, SALT, to improve the zero-shot cross-lingual transfer of the multilingual pretrained language models without the help of such external data. By incorporati

Research goal: What is the impact of intermediate-task training order (e.g., NLI before QA vs. QA before NLI) on zero-shot cross-lingual transfer when evaluated on the PAWS-X dataset for paraphrase identification in low-resource languages?

Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 7.5/10.