Published November 9, 2023 | Version v1
Conference paper Open

Evaluation of Explainable Artificial Intelligence methods in Language Learning Classification of Spanish Tertiary Education Students

  • 1. Information Technologies Institute (ITI) - Centre for Research and Technology Hellas (CERTH)
  • 2. Metodo Estudios Consultores
  • 3. University of Macedonia


With the increasing prevalence of AI, significant advancements have been made across various domains, such as healthcare, learning, industry, etc. However, challenges persist in terms of trusting and comprehending the outcomes generated by these technologies. Specifically in the language learning domain, teachers face challenges regarding the classification of the students’ learning capabilities and build the appropriate learning path for them. To address these challenges, the concept of Explainable Artificial Intelligence (XAI) was adopted, which is a set of processes and methods that allows human users to interpret, understand and trust the results derived from machine learning models. In this study, we adopt two well-known XAI algorithms, PFI and SHAP in a proposed Knowledge Generation Model equipped with ML models to derive hidden knowledge. The whole framework has been applied and evaluated on the Language Learning Classification of Spanish Tertiary Education Students acquired from the CEDEL2 database. The analysis concludes that in terms of explaining the black-box models, the SHAP model-agnostic method is the most comprehensive and dominant for visualizing feature interactions and feature importance and be applicable to any type of data.



Files (723.6 kB)

Additional details


AIDEAS – AI Driven industrial Equipment product life cycle boosting Agility, Sustainability and resilience 101057294
European Commission
WELCOME – Multiple Intelligent Conversation Agent Services for Reception, Management and Integration of Third Country Nationals in the EU 870930
European Commission