Conference paper Open Access

Reflections on Eight Years of Instrument Creation with Machine Learning

Fiebrink, Rebecca; Sonami, Laetitia

Editor(s)
Michon, Romain; Schroeder, Franziska

Machine learning (ML) has been used to create mappings for digital musical instruments for over twenty-five years, and numerous ML toolkits have been developed for the NIME community. However, little published work has studied how ML has been used in sustained instrument building and performance practices. This paper examines the experiences of instrument builder and performer Laetitia Sonami, who has been using ML to build and refine her Spring Spyre instrument since 2012. Using Sonami's current practice as a case study, this paper explores the utility, opportunities, and challenges involved in using ML in practice over many years. This paper also reports the perspective of Rebecca Fiebrink, the creator of the Wekinator ML tool used by Sonami, revealing how her work with Sonami has led to changes to the software and to her teaching. This paper thus contributes a deeper understanding of the value of ML for NIME practitioners, and it can inform design considerations for future ML toolkits as well as NIME pedagogy. Further, it provides new perspectives on familiar NIME conversations about mapping strategies, expressivity, and control, informed by a dedicated practice over many years.
Files (82.1 MB)
Name Size
nime2020_paper45.mp4
md5:20bac6590053bf2e012cd7772231461e
81.5 MB Download
nime2020_paper45.pdf
md5:0e652cc0e792da0be5828d9d8efd77f5
542.1 kB Download
nime2020_paper45.srt
md5:3e6dd12750519c3b15ac82a5ad7b4749
20.5 kB Download
138
98
views
downloads
All versions This version
Views 138138
Downloads 9898
Data volume 376.4 MB376.4 MB
Unique views 112112
Unique downloads 8686

Share

Cite as