Published May 31, 2023
| Version v1
Conference paper
Open
Improvise+=Chain: Listening to the Ensemble Improvisation of an Autoregressive Generative Model
Creators
Description
This paper describes Improvise+=Chain, an audio-visual installation artwork of autonomous musical performance using artificial intelligence technology. The work is designed to provide the audience with an experience exploring the differences between human and AI-based virtual musicians. Using a transformer decoder, we developed a four-track (melody, bass, chords and accompaniment, and drums) symbolic music generation model. The model generates each track in real time to create an endless chain of phrases, and 3D visuals and LED lights represent the attention information between four tracks, i.e., four virtual musicians, calculated within the model. This work aims to highlight the differences for viewers to consider between humans and artificial intelligence in music jams by visualizing the only information virtual musicians can communicate with while humans interact in multiple modals during the performance.
Files
nime2023_94.pdf
Files
(4.9 MB)
Name | Size | Download all |
---|---|---|
md5:7d4c1109c3ba8ceb2ac3c09183f33b89
|
4.9 MB | Preview Download |