DEV Community

Becu Eduard
Becu Eduard

Posted on

Built Air-Cursor - Hand-Gesture Recognition App

Just shipped this: hand tracking via webcam, move your hand = cursor follows. make a fist, hold it = press. open palm = release. colored mist effect around the screen edges so you know it's active. inspired by that old xbox kinect menu system.

tech: electron + mediapipe + webgl. desktop app, locally runs, doesn't tank your cpu.

totally open source. tested, working, ready to use.

github: https://github.com/edic-23/Air-Cursor

would love feedback or feature ideas.

Top comments (1)

Collapse
 
marcusykim profile image
Marcus Kim

I like that you kept the gesture vocabulary small: hand moves the cursor, fist-hold presses, open palm releases. That is the right kind of constraint for an input device, especially with the colored mist edge state so people can tell when the webcam control layer is active. The Electron + MediaPipe + WebGL stack makes sense here, but the product work is probably going to be in calibration and failure modes: lighting changes, accidental fist holds, and giving users a fast way to pause without hunting for the mouse.