Conference paper Open Access
Reflections on Eight Years of Instrument Creation with Machine Learning
Fiebrink, Rebecca; Sonami, Laetitia
Editor(s)
Michon, Romain; Schroeder, FranziskaMachine learning (ML) has been used to create mappings for digital musical instruments for over twenty-five years, and numerous ML toolkits have been developed for the NIME community. However, little published work has studied how ML has been used in sustained instrument building and performance practices. This paper examines the experiences of instrument builder and performer Laetitia Sonami, who has been using ML to build and refine her Spring Spyre instrument since 2012. Using Sonami's current practice as a case study, this paper explores the utility, opportunities, and challenges involved in using ML in practice over many years. This paper also reports the perspective of Rebecca Fiebrink, the creator of the Wekinator ML tool used by Sonami, revealing how her work with Sonami has led to changes to the software and to her teaching. This paper thus contributes a deeper understanding of the value of ML for NIME practitioners, and it can inform design considerations for future ML toolkits as well as NIME pedagogy. Further, it provides new perspectives on familiar NIME conversations about mapping strategies, expressivity, and control, informed by a dedicated practice over many years.
Files
(82.1 MB)
| Name | Size | |
|---|---|---|
|
nime2020_paper45.mp4
md5:20bac6590053bf2e012cd7772231461e |
81.5 MB | Download |
|
nime2020_paper45.pdf
md5:0e652cc0e792da0be5828d9d8efd77f5 |
542.1 kB | Download |
|
nime2020_paper45.srt
md5:3e6dd12750519c3b15ac82a5ad7b4749 |
20.5 kB | Download |
138
98
views
downloads
| All versions | This version | |
|---|---|---|
| Views | 138 | 138 |
| Downloads | 98 | 98 |
| Data volume | 376.4 MB | 376.4 MB |
| Unique views | 112 | 112 |
| Unique downloads | 86 | 86 |
Indexed in
- Publication date:
- June 1, 2020
- DOI:
-
- Published in:
- Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 237--242.
- Meeting:
- International Conference on New Interfaces for Musical Expression, Birmingham, UK
- Related identifiers:
- Part of
- 2220-4806 (ISSN)
- Communities:
- License (for files):
- Creative Commons Attribution 4.0 International