Conference paper Open Access

URack: Audio-visual Composition and Performance using Unity and VCV Rack

Hughes, Matthew; Johnston, Andrew

Editor(s)
Michon, Romain; Schroeder, Franziska

This demonstration presents URack, a custom-built audio-visual composition and performance environment that combines the Unity video-game engine with the VCV Rack software modular synthesiser. In alternative cross-modal solutions, a compromise is likely made in either the sonic or visual output, or the consistency and intuitiveness of the composition environment. By integrating control mechanisms for graphics inside VCV Rack, the music-making metaphors used to build a patch are extended into the visual domain. Users familiar with modular synthesizers are immediately able to start building high-fidelity graphics using the same control voltages regularly used to compose sound. Without needing to interact with two separate development environments, languages or metaphorical domains, users are encouraged to freely, creatively and enjoyably construct their own highly-integrated audio-visual instruments. This demonstration will showcase the construction of an audio-visual patch using URack, focusing on the integration of flexible GPU particle systems present in Unity with the vast library of creative audio composition modules inside VCV.
Files (610.8 kB)
Name Size
nime2020_paper61.pdf
md5:80f4833b49322d549ef52ae432461050
605.9 kB Download
nime2020_paper61.srt
md5:0dc00a334738395f107fa53b57aaaa80
4.9 kB Download
80
43
views
downloads
All versions This version
Views 8080
Downloads 4343
Data volume 26.1 MB26.1 MB
Unique views 6767
Unique downloads 4141

Share

Cite as