Published March 14, 2025
| Version v1
Conference paper
Open
Sonic Rhopalia
Description
The Jellyfish is a species with one of the most simplistic and complete Umwelts. Its pulsating movements are caused by a refined network, composing only of a few neurons. These neural receptors, named Rhopalia, receive external simulation which determines their pulses. In the ocean, these pulses then ripple into waves in the water, that is sensed by the Rhopalia, triggering the pulses of the next jellyfish. Such interactions (that cannot be seen by the naked eye) in repetition over time, have sustained the existence of the jellyfish species across 6 billion years. This mechanical system causes organic pulses, radiating an inexplicable feeling of vitality. 'Sonic Rhopalia' is a sound installation that is produced by the pulsation of four Aurelia aurita (a.k.a. moon jellyfish). By using Touch Designer and a web camera to capture the movement of each jellyfish, we detect its pulse through image analysis, using OpenCV and a combination of pixel color channel classification and area calculation. Once the pulse of a jellyfish is detected, it sends a bang to M4L (Max for Live) using OSC (OpenSound Control), where it is used as a trigger for music composition. Sounds are played in response to each pulse, and when the jellyfish pulse at the same time, in synchronization, different chords and sounds are produced. The work develops across one loop comprising of three phases with varying soundscapes, all determined by the number pulse synchronizations. By reframing jellyfish as an interface for music generation, the rhythms and movements of the pulsating jellyfish come together create a unique soundscape, that allows the audience to experience the vitality of jellyfish in a completely new dimension from conventional methods of bio-marine appreciation.
Files
nime2024_installations_10.pdf
Files
(1.0 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:af7b6fa9468e7da5742aa59432f6807a
|
1.0 MB | Preview Download |