Adaptive Pretraining and Source Language Selection vs. Multimodal Intermediate-Task Training for Zero-Shot Cross-Lingual

This paper describes our system developed for the SemEval-2023 Task 12 "Sentiment Analysis for Low-resource African Languages using Twitter Dataset". Sentiment analysis is one of the most widely studied applications in natural language processing. However, most prior work still focuses on a small number of high-resource languages. Building reliable sentiment analysis systems for low-resource languages remains challenging, due to the limited training data in this task. In this work, we propose to leverage language-adaptive and task-adaptive pretraining on African texts and study transfer learni

Research goal: How does the combination of adaptive pretraining and source language selection compare to multimodal intermediate-task training (e.g., image-text alignment) in improving F1 scores for zero-shot cross-lingual sentiment analysis on the XTREME-R benchmark?

Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.2/10.