Conference paper Open Access

Design and Interaction of 3D Virtual Music Instruments for STEAM Education Using Web Technologies

Kritsis, Kosmas; Gkiokas, Aggelos; Lamerand, Quentin; Piechaud, Robert; Acosta, Carlos; Kaliakatsos-Papakostas, Maximos; Katsouros, Vassilis

In this paper we present our current work on the development of a web-based system that allows users to design and interact with virtual music instruments in a virtual 3D environment, providing three natural and intuitive means of interaction (physical, gestural and mixed). By employing the Leap Motion sensor, we benefit from its high performance on providing accurate finger tracking data. The proposed system is integrated as a creative tool of a novel STEAM education platform that promotes science learning through musical activities. Our approach models two families of music instruments (stringed and percussion), with realistic sonic feedback by utilizing a physical model-based sound synthesis engine. Consequently, the proposed interface meets the performance requirements of real-time interaction systems and is implemented strictly with web technologies that allow platform independent functionality.

Files (2.6 MB)
Name Size
smc2018_kritsis_1.pdf
md5:38896e2408ee19c3db657a6ded1765ec
2.6 MB Download
85
46
views
downloads
All versions This version
Views 8585
Downloads 4646
Data volume 121.4 MB121.4 MB
Unique views 7373
Unique downloads 4141

Share

Cite as