Journal article Open Access

Metrics for Evaluation of Student Models

Pelanek, Radek

Researchers use many different metrics for evaluation of performance of student models. The aim of this paper is to provide an overview of commonly used metrics, to discuss properties, advantages, and disadvantages of different metrics, to summarize current practice in educational data mining, and to provide guidance for evaluation of student models. In the discussion we mention the relation of metrics to parameter fitting, the impact of student models on student practice (over-practice, under-practice), and point out connections to related work on evaluation of probability forecasters in other domains. We also provide an empirical comparison of metrics. One of the conclusion of the paper is that some commonly used metrics should not be used (MAE) or should be used more critically (AUC).

The file is in PDF format. If your computer does not recognize it, simply download the file and then open it with your browser.
Files (1.2 MB)
Name Size
-1849690092
md5:27c6395c6aa0d0fcedd3380869fe3f1b
1.2 MB Download
7
0
views
downloads
All versions This version
Views 77
Downloads 00
Data volume 0 Bytes0 Bytes
Unique views 66
Unique downloads 00

Share

Cite as