Music for Multimodal Agents – Experiment in Improvisation and Feedback Loop

Music for AI Audience is a live, collaborative piece between custom deep learning software and a musician. In the 10-15 minute piece, multimodal LLM agents observe an improvised sound performance and let their minds wander through digital archives. This machine listening and machine seeing results in outputs that, on their part, act as prompts for the musician in the loop. The piece not only explores the creative possibilities of improvising in front of a non-human audience, but the potential and limits of machine sentience in experiencing art.