Subword Pooling Strategies and Zero-Shot Cross-Lingual NER Accuracy in Low-Resource African Languages

Pre-trained multilingual language models (e.g., mBERT, XLM-RoBERTa) have significantly advanced the state-of-the-art for zero-shot cross-lingual information extraction. These language models ubiquitously rely on word segmentation techniques that break a word into smaller constituent subwords. Therefore, all word labeling tasks (e.g. named entity recognition, event detection, etc.), necessitate a pooling strategy that takes the subword representations as input and outputs a representation for the entire word. Taking the task of cross-lingual event detection as a motivating example, we show that

Research goal: How does subword pooling strategy variation affect zero-shot cross-lingual named entity recognition accuracy for low-resource African languages in the XTREME benchmark?

Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 8.3/10.