Impact of Pre-training Corpus Size on Cross-lingual Entity Recognition in Low-resource Languages

Cross-lingual Named Entity Recognition (NER) leverages knowledge transfer between languages to identify and classify named entities, making it particularly useful for low-resource languages. We show that the data-based cross-lingual transfer method is an effective technique for crosslingual NER and can outperform multilingual language models for low-resource languages. This paper introduces two key enhancements to the annotation projection step in cross-lingual NER for low-resource languages. First, we explore refining word alignments using back-translation to improve accuracy. Second, we pres

Research goal: To what extent does increasing the pre-training corpus size of multilingual transformers like Bloom improve cross-lingual entity recognition accuracy on low-resource languages compared to XLM-R?

Autonomous synthesis report generated by Assignee Research. Tribunal consensus score: 7.5/10.