Accessible Co-Creativity with AI through Language and Voice Input

https://aimc2023.pubpub.org/pub/lo8xj7sb

This project introduces a set of tools for humans to co-create music with AI-based architectures. The aim is for human musicians or non-musicians to be able to augment their creative capabilities and guide neural architectures to understand language and musical nuances. This work is akin to learning a new instrument: the human learns how to co-create with the AI system for musical applications. One of the main goals of the project is accessibility. We want people with various abilities and disabilities to be empowered to explore music creation by interacting with machines and using language and/or their voice. The tools we propose can be used for composition, improvisation, and/or performance.