Conference paper Open Access

Design and Interaction of 3D Virtual Music Instruments for STEAM Education Using Web Technologies

Kritsis, Kosmas; Gkiokas, Aggelos; Lamerand, Quentin; Piechaud, Robert; Acosta, Carlos; Kaliakatsos-Papakostas, Maximos; Katsouros, Vassilis

In this paper we present our current work on the development of a web-based system that allows users to design and interact with virtual music instruments in a virtual 3D environment, providing three natural and intuitive means of interaction (physical, gestural and mixed). By employing the Leap Motion sensor, we benefit from its high performance on providing accurate finger tracking data. The proposed system is integrated as a creative tool of a novel STEAM education platform that promotes science learning through musical activities. Our approach models two families of music instruments (stringed and percussion), with realistic sonic feedback by utilizing a physical model-based sound synthesis engine. Consequently, the proposed interface meets the performance requirements of real-time interaction systems and is implemented strictly with web technologies that allow platform independent functionality.

Files (2.6 MB)
Name Size
smc2018_kritsis_1.pdf
md5:38896e2408ee19c3db657a6ded1765ec
2.6 MB Download
136
66
views
downloads
All versions This version
Views 136137
Downloads 6666
Data volume 174.2 MB174.2 MB
Unique views 117118
Unique downloads 6060

Share

Cite as