Conference paper Open Access

Cross-Modal Terrains: Navigating Sonic Space through Haptic Feedback

Isaac, Gabriella; Hayes, Lauren; Ingalls, Todd

This paper explores the idea of using virtual textural terrains as a means of generating haptic profiles for force-feedback controllers. This approach breaks from the paradigm established within audio-haptic research over the last few decades where physical models within virtual environments are designed to transduce gesture into sonic output. We outline a method for generating multimodal terrains using basis functions, which are rendered into monochromatic visual representations for inspection. This visual terrain is traversed using a haptic controller, the NovInt Falcon, which in turn receives force information based on the grayscale value of its location in this virtual space. As the image is traversed by a performer the levels of resistance vary, and the image is realized as a physical terrain. We discuss the potential of this approach to afford engaging musical experiences for both the performer and the audience as iterated through numerous performances.
Files (2.3 MB)
Name Size
nime2017_paper0008.pdf
md5:d3ba916a5e1ab078a804c5cf652a7d19
2.3 MB Download
94
50
views
downloads
All versions This version
Views 9494
Downloads 5050
Data volume 113.9 MB113.9 MB
Unique views 8484
Unique downloads 4949

Share

Cite as