Published March 14, 2025 | Version v1
Conference paper Open

PlayTrainPlay

Authors/Creators

Description

'PlayTrainPlay' is a structured solo human-computer improvisation in two parts. It combines instrumental improvisation with granular synthesis, machine listening and neural networks. Through its structure, PlayTrainPlay describes the process of collecting data, training a neural network and interacting with the resulting model through musical performance; its structure can also be said to represent the transition from a physical effects interface to a data-based one. These concepts are additionally communicated through the projection of live visuals consisting of code outputs, performance footage and abstract audio-reactive images. Section 1 employs a real-time granular effect whose parameters are manipulated via a foot controller. Over the course of this section, analysis of the saxophone's timbre and corresponding effect parameters are logged before the performer triggers training of the neural network. In Section 2, the neural network controls the effect, which is deployed in a loop that the performer interacts with. This work motivates further use of data model-based interfaces for instrumental effects by instrumentalists themselves. It proposes the use of data collection and modelling during performance as a means to create unique situation-based interactions. Lastly, it promotes the use of neural networks as a way of simplifying musicians' workflows.

Files

nime2024_music_38.pdf

Files (73.4 MB)

Name Size Download all
md5:b9eacf6ae51b3af3eb8b9545a5fe9494
452.6 kB Preview Download
md5:7976f7e1d17899424a247dbdeb14888b
73.0 MB Preview Download