Conference paper Open Access

Small Dynamic Neural Networks for Gesture Classification with The Rulers (a Digital Musical Instrument)

Yaremchuk, Vanessa; Medeiros, Carolina Brum; Wanderley, Marcelo

The Rulers is a Digital Musical Instrument with 7 metal beams, each of which is fixed at one end. It uses infrared sensors, Hall sensors, and strain gauges to estimate deflection. These sensors each perform better or worse depending on the class of gesture the user is making, motivating sensor fusion practices. Residuals between Kalman filters and sensor output are calculated and used as input to a recurrent neural network which outputs a classification that determines which processing parameters and sensor measurements are employed. Multiple instances (30) of layer recurrent neural networks with a single hidden layer varying in size from 1 to 10 processing units were trained, and tested on previously unseen data. The best performing neural network has only 3 hidden units and has a sufficiently low error rate to be good candidate for gesture classification. This paper demonstrates that: dynamic networks out-perform feedforward networks for this type of gesture classification, a small network can handle a problem of this level of complexity, recurrent networks of this size are fast enough for real-time applications of this type, and the importance of training multiple instances of each network architecture and selecting the best performing one from within that set.

Files (5.1 MB)
Name Size
nime2019_paper030.pdf
md5:bd0873a6de86dba28fc2dfab2b834acb
5.1 MB Download
51
39
views
downloads
All versions This version
Views 5151
Downloads 3939
Data volume 199.0 MB199.0 MB
Unique views 4949
Unique downloads 3737

Share

Cite as