Gesture Video Controller

A webcam hand-tracking system to control video playback and system actions with gestures.

Links: GitHub repository

A lightweight hand-tracking control system that lets you drive media, browser and system actions using intuitive hand gestures through your webcam, with no keyboard or remote needed. It supports both single-hand and dual-hand operation.

Single-hand gestures

A rich gesture vocabulary maps hand poses to actions, for example an open palm for play or pause, a peace sign to rewind, a single index finger to skip forward, different finger counts for volume up and down, a thumb-and-three-finger pose for fullscreen, thumb-only and pinky-only for scrolling, and an index-plus-pinky hold for 2x playback. A gesture must be held steadily for about 0.2 seconds before it triggers, which avoids accidental activations.

Dual-hand mode

In dual-hand mode each hand is tracked independently and supports its own set of gestures, doubling the available controls for finer, faster interaction.