Gesture-Controlled Soundscapes
Accelerometer-driven modulation for live cello & clarinet interaction
Intro
A performance system translating a cellist's physical gestures into real-time audio transformation. An accelerometer + Arduino pipeline captures bow and arm motion, modulating both cello and clarinet processing. Movement becomes a meta-instrument, expanding phrasing, articulation, and timbral morphing.
Description
The Gesture-Controlled Device was developed during a three-day workshop as part of the Laboratoire de Recherche with Ensemble Contrechamps (26–29 January 2023, Les 6 Toits). The goal was to create an interactive system using Arduino and an accelerometer to capture the hand movements of a cellist and translate them into real-time sound modulation. In the first part of the performance, the cellist’s movements controlled the sound of a clarinet, creating a unique interplay between gesture and music. In the second part, both the cello and clarinet sounds were modulated simultaneously by the cellist’s movements, enhancing the dynamic interaction between the two instruments. Developed over two days of experimentation and ideation, the system was presented during a live concert on the third day, showcasing its innovative approach to merging physical performance and live sound manipulation.
In the making
