Genny: Designing and Exploring a Live Coding Interface for Generative Models

We present Genny, a live coding interface for interacting with generative models. By implementing a streamlined generative model API within a Web-based live coding environment, we explore possibilities for how generative models can
support live coding. We describe the implementation of our interface components and the backend system for working
with generative models, show several design patterns with template code, and describe use of a practical generation
method for live coding performance. The system currently enables the generation of two-bar rhythm patterns using
lightweight models that support near-instantaneous inference, which are able to suggest and display alternative rhythm
patterns based on live coders’ own inputs. Finally, we discuss reflections on this implementation approach, its current
limitations, and further possibilities.