Published October 18, 2015 | Version 1.0.0

Unraveling Students' Interaction Around a Tangible Interface using Multimodal Learning Analytics

  • 1. Stanford University

Description

In this paper, we describe multimodal learning analytics (MMLA) techniques to analyze data collected around an interactive learning environment. In a previous study (Schneider and Blikstein, 2015), we designed and evaluated a Tangible User Interface (TUI) where dyads (i.e., pairs) of students were asked to learn about the human auditory system by reconstructing it. In the current study, we present the analysis of the data collected in the form of logs, both from students' interaction with the tangible interface as well as from their gestures, and we describe how we extracted meaningful predictors for student learning from these two datasets. First we show how information retrieval techniques can be used on the tangible interface logs to predict learning gains. Second, we explored how KinectTM data can inform "in-situ" interactions around a tabletop by using clustering algorithms to find prototypical body positions. Finally, we fed those features to a machine-learning classifier (Support Vector Machine) and divided students in two groups after performing a median split on their learning scores. We found that we were able to predict students' learning gains (i.e., being above or belong the median split) with very high accuracy. We discuss the implications of these results for analyzing rich data from multimodal learning environments.

Notes

The file is in PDF format. If your computer does not recognize it, simply download the file and then open it with your browser.

Files

Files (13.2 MB)

Name Size
md5:64d65f2d65f5cafc6770b7e7fbc5daaf
13.2 MB Download

Additional details