Impact of Domain Mismatch on Zero-Shot Cross-Lingual Transfer in XTREME Benchmark

Cross-lingual transfer learning without labeled target language data or parallel text has been surprisingly effective in zero-shot cross-lingual classification, question answering, unsupervised machine translation, etc. However, some recent publications have claimed that domain mismatch prevents cross-lingual transfer, and their results show that unsupervised bilingual lexicon induction (UBLI) and unsupervised neural machine translation (UNMT) do not work well when the underlying monolingual corpora come from different domains (e.g., French text from Wikipedia but English text from UN proceedi

Research goal: What is the impact of domain mismatch between intermediate tasks and target tasks on zero-shot cross-lingual transfer performance in the XTREME benchmark, measured by accuracy degradation across language families?

Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.4/10.