Intermediate Task Difficulty and Zero-Shot Cross-Lingual Transfer Accuracy in Multilingual Models on XTREME-R

Recent advances in multimodal vision and language modeling have predominantly focused on the English language, mostly due to the lack of multilingual multimodal datasets to steer modeling efforts. In this work, we address this gap and provide xGQA, a new multilingual evaluation benchmark for the visual question answering task. We extend the established English GQA dataset (Hudson and Manning, 2019) to 7 typologically diverse languages, enabling us to detect and explore crucial challenges in cross-lingual visual question answering. We further propose new adapter-based approaches to adapt multim

Research goal: How does the choice of intermediate task difficulty affect the zero-shot cross-lingual transfer accuracy of multilingual models on XTREME-R when varying the size of the target task dataset?

Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.8/10.