Gesture Sound Map is an interactive web interface that lets you draw and play sound using gesture control.

In this project, I wanted to use gesture to control the quality of sound and produce a visual sound map as trails. Using handtrack.js and p5.sound libraries, I connected hand coordinates to ADSR and sound waves to produce sound, using x-axis as pitch and y-axis as echo. I aimed at exploring the qualities of gesture and the use of body as an instrument, as well as how the expressive and poetic quality of sound can be related back to something natural as human motion.