Published June 1, 2015 | Version v1
Conference paper Open

Tracking Ensemble Performance on Touch-Screens with Gesture Classification and Transition Matrices

Description

We present and evaluate a novel interface for tracking ensemble performances on touch-screens. The system uses a Random Forest classifier to extract touch-screen gestures and transition matrix statistics. It analyses the resulting gesture-state sequences across an ensemble of performers. A series of specially designed iPad apps respond to this real-time analysis of free-form gestural performances with calculated modifications to their musical interfaces. We describe our system and evaluate it through cross-validation and profiling as well as concert experience.

Files

nime2015_242.pdf

Files (2.7 MB)

Name Size Download all
md5:3c626e02f73105a6c14aae7f932d06c7
2.7 MB Preview Download