Loading models and requesting access to Camera + MIDI...
How to use
This page uses your webcam to turn hand movement into MIDI messages
You should see both camera and MIDI permissions requested, then your webcam video should appear on the screen
When hands are detected they will be highlighted in green and the screen will dim.
MIDI Message Mapping & Configuration
When mapping MIDI to your DAW, the easiest way to do that is send a single message of that type in MIDI mapping mode. So keep your hands out of frame and click the MIDI-map button in your DAW, and then use the Send CC buttons below to send and do the mapping.
Hand On/Off Detection
Left Hand: CC 40
Right Hand: CC 41
Hand X/Y Position
Left Hand X: CC 42
Left Hand Y: CC 44
Right Hand X: CC 43
Right Hand Y: CC 45
Hand Rotation
Left Hand: CC 46
Right Hand: CC 47
Distance from Pinky Tip to Thumb Tip
Left Hand: CC 48
Right Hand: CC 49
Distance from Each Fingertip to Hand Root
Left Hand:
Thumb: CC 50 ,
Index: CC 51 ,
Middle: CC 52 ,
Ring: CC 53 ,
Pinky: CC 54
Right Hand:
Thumb: CC 55 ,
Index: CC 56 ,
Middle: CC 57 ,
Ring: CC 58 ,
Pinky: CC 59
Finger Angles
Each angle measures the bend between three points: wrist → joint → next joint