Journal article Open Access

Analyzing Process Data from Game/Scenario-Based Tasks: An Edit Distance Approach

Hao, Jiangang; Shu, Zhan; Von Davier, Alina

Students' activities in game/scenario-based tasks (G/SBTs) can be characterized by a sequence of time-stamped actions of different types with different attributes. For a subset of G/SBTs in which only the order of the actions is of great interest, the process data can be well characterized as a string of characters (i.e., action string) if we encode each action name as a single character. In this article, we report our work on evaluating students' performances by comparing how far their action strings are from the action string that corresponds to the best performance, where the proximity is quantified by the edit distance between the strings. Specifically, we choose the Levenshtein distance, which is defined as the minimum number of insertions, deletions, and replacements needed to convert one character string into another. Our results show a strong correlation between the edit distances and the scores obtained from the scoring rubrics of the pump repair task from the National Assessment of Education Progress Technology and Engineering Literacy assessments, implying that the edit distance to the best performance sequence can be considered as a new feature variable that encodes information about students' proficiency, which sheds light on the value of data-driven scoring rules for test and task development and for refining the scoring rubrics.

The file is in PDF format. If your computer does not recognize it, simply download the file and then open it with your browser.
Files (778.2 kB)
Name Size
1558864508
md5:6e47d71f0cd84f3b20937f034ce6b9f5
778.2 kB Download
7
0
views
downloads
All versions This version
Views 77
Downloads 00
Data volume 0 Bytes0 Bytes
Unique views 66
Unique downloads 00

Share

Cite as