Journal article Open Access

Metrics for Evaluation of Student Models

Pelanek, Radek

Researchers use many different metrics for evaluation of performance of student models. The aim of this paper is to provide an overview of commonly used metrics, to discuss properties, advantages, and disadvantages of different metrics, to summarize current practice in educational data mining, and to provide guidance for evaluation of student models. In the discussion we mention the relation of metrics to parameter fitting, the impact of student models on student practice (over-practice, under-practice), and point out connections to related work on evaluation of probability forecasters in other domains. We also provide an empirical comparison of metrics. One of the conclusion of the paper is that some commonly used metrics should not be used (MAE) or should be used more critically (AUC).

The file is in PDF format. If your computer does not recognize it, simply download the file and then open it with your browser.
Files (1.2 MB)
Name Size
-1849690092
md5:27c6395c6aa0d0fcedd3380869fe3f1b
1.2 MB Download
30
3
views
downloads
All versions This version
Views 3030
Downloads 33
Data volume 3.7 MB3.7 MB
Unique views 2828
Unique downloads 33

Share

Cite as