Transfer Learning for Multilingual Classification of Scientific Texts and Skills to the Sustainable Development Goals: A Systematic Review and Research Agenda
Authors/Creators
- 1. Department of Physics, Dire Dawa University, Dire Dawa, Ethiopia
Description
The United Nations Sustainable Development Goals (SDGs) have become a central framework for assessing the societal relevance of research. Automated classification of scientific texts and workforce skills against the SDGs is increasingly required by funding agencies, universities, and policymakers. However, existing systems face two critical limitations: a strong English-language bias and methodological fragmentation between scientific text classification and skill-SDG mapping. This systematic review, conducted according to PRISMA 2020 guidelines, analyzes 47 peer-reviewed studies published between 2018 and 2025 that apply transfer learning to multilingual SDG classification. Results show that multilingual BERT (mBERT) and XLM-RoBERTa dominate the technical landscape, with XLM-R-large achieving state-of-the-art performance (F1 = 85.66%) on Indonesian scientific texts. Nevertheless, language coverage remains highly skewed: pure multilingual studies without English dominance constitute only 8.5% of the literature, while African, South Asian, and Middle Eastern languages are virtually absent. Parallel research streams on scientific text classification and skill mapping operate in methodological silos, preventing cross-fertilization of techniques such as FAISS-based retrieval and zero-shot cross-lingual transfer. Social SDGs (e.g., Goals 5, 10, and 16) consistently underperform environmental and technical goals due to their reliance on implicit, context-dependent language. In response, this review proposes a five-pillar research agenda centered on unified multilingual frameworks, parameter-efficient adaptation for low-resource languages, semantic enhancement of social SDGs, standardized cross-lingual evaluation protocols, and human-AI collaborative systems. Advancing this agenda requires interdisciplinary collaboration across computational linguistics, sustainability science, and information science to develop truly inclusive and interoperable SDG classification systems.
Files
281-293-Birle-Belay Sitotaw Goshu-Nov-2026-LAY.pdf
Additional details
References
- Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., & Stoyanov, V. (2020). Unsupervised cross-lingual representation learning at scale. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 8440–8451). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-main.747 Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020). Don't stop pretraining: Adapt language models to domains and tasks. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (pp. 8342–8360). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-main.740 Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., De Laroussilhe, Q., Gesmundo, A., Attariyan, M., & Gelly, S. (2019). Parameter-efficient transfer learning for NLP. In Proceedings of the 36th International Conference on Machine Learning (pp. 2790–2799). PMLR. https://proceedings.mlr.press/v97/houlsby19a.html Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2022). LoRA: Low-rank adaptation of large language models. In International Conference on Learning Representations. https://doi.org/10.48550/arXiv.2106.09685 Husna, A. S., et al. (2025). Multi-label classification of Indonesian scientific papers into Sustainable Development Goals using pre-trained transformer models. IEEE (forthcoming / conference proceedings). Koundouri, P., Pitti, C., Landis, C., & Feretzakis, G. (2025). AI-powered skills mapping for sustainable and SDG-aligned workforce development (Working Paper No. 25-57). Athens University of Economics and Business. http://wpa.deos.aueb.gr/docs/2025.AI.Powered.Skills.Mapping.pdf Ottaviani, M., & Stahlschmidt, S. (2024). On the performativity of SDG classifications in large bibliometric databases. arXiv. https://doi.org/10.48550/arXiv.2405.03007 Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71 Pal, A., & Mukhopadhyay, P. (2024). Categorisation of Indian research publications by Sustainable Development Goals (SDGs): A machine learning approach. Journal of Information and Knowledge, 61(6), 303–311. https://doi.org/10.17821/srels/2024/v61i6/171637 Pires, T., Schlinger, E., & Garrette, D. (2019). How multilingual is Multilingual BERT? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (pp. 4996–5001). Association for Computational Linguistics. https://doi.org/10.18653/v1/P19-1493 Priem, J., Piwowar, H., & Orr, R. (2022). OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. arXiv. https://doi.org/10.48550/arXiv.2205.01833 Pukelis, L., Bautista-Puig, N., Statulevičiūtė, G., Stančiauskas, V., Dikmener, G., & Akylbekova, D. (2022). OSDG 2.0: A multilingual tool for classifying text data by UN Sustainable Development Goals (SDGs). arXiv. https://doi.org/10.48550/arXiv.2211.11252 SkiLLens authors. (2026). SkiLLens: Recognising and mapping novel skills from millions of job ads across Europe using language models. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 5: Industry Track) (pp. 877–885). Association for Computational Linguistics. https://aclanthology.org/2026.eacl-industry.65/ Suadaa, L. H., Monika, A. K., Putri, B. S., & Rimawati, Y. (2025). Automatic classification of multilanguage scientific papers to the Sustainable Development Goals using transfer learning. Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), 9(3), 656–665. https://doi.org/10.29207/resti.v9i3.6560 Wu, S., & Dredze, M. (2019). Beto, Bentz, Becas: The surprising cross-lingual effectiveness of BERT. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 833–844). Association for Computational Linguistics. https://doi.org/10.18653/v1/D19-1077 Wu, S., & Dredze, M. (2020). Are all languages created equal in multilingual BERT? In Proceedings of the 5th Workshop on Representation Learning for NLP (pp. 120–130). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.repl4nlp-1.16