DEV Community

Cover image for Gesture Synth — Play Music with Hand Gestures
sheng li
sheng li

Posted on Originally published at gesturesynth.me

Gesture Synth — Play Music with Hand Gestures

#webdev #showdev #ai #music

![Gesture Synth — Play Music with Hand Gestures]
+

Gesture Synth — Play Music with Hand Gestures

Camera in. Music out. Your performance stays local.

Gesture Synth is a free browser-based gesture synthesizer controlled with two hands. Play chords and theremin tones, sequence loops and practise songs — all while camera frames stay on your device. No microphone or video upload required.

Key Features

  • 🖐️ Two-hand tracking powered by MediaPipe Hand Landmarker
  • 🎹 Gesture mode — control chords, harmony, volume, and tone with hand positions
  • 🎵 Theremin mode — adjust pitch with hand movement
  • 🎓 Learn mode — practise songs interactively
  • 🔁 Four-track loop sequencer — build layered compositions
  • 💾 Export to WAV (with WebM fallback)
  • ⏱️ Tempo control from 30 to 300 BPM
  • 🎼 Time signatures: 3/4, 4/4, 5/4, 6/8, 7/8
  • 🔒 Privacy-first — camera processed locally, no account required

How It Works

Gesture Synth uses the Web Audio API for real-time sound synthesis and MediaPipe Hand Landmarker for hand tracking. Your webcam feed is processed entirely on-device — no video is uploaded to any server.

Try It Out

👉 Launch Gesture Synth

Useful Links

Demo Video

https://www.youtube.com/embed/MOwmvEZUi7k

Gesture Synth — Two hands. One browser instrument. Free forever.

Top comments (0)