DJ Spatial Tracking and Gesture Recognition for Audio Effects and Mixing

In the music production world, there is a disconnect between a disc jockey (DJ) and their complex software. Gesture recognition is used to connect the DJ with their software. A glove equipped with controllable tri-color light-emitting diodes (LED) on the fingertips is tracked by a camera to acquire the gesture. Audio effects will be executed based on the performed gesture. Gesture vector information is calculated and processed on the Raspberry Pi using hidden Markov models (HMM). Once a gesture is recognized, a MIDI command is sent to a computer. The software on the DJ's computer executes the appropriate audio effect.