[Ryan Challinor] is part of a group constructing a display for this year’s Burning Man festival that includes the Kinect, Ableton Live, and Quartz Composer. As the programming guru of the project, he was tasked with creating a method for his partners to utilize all three products via an easy to use interface.
His application is called Synapse and was inspired by videos he saw online of people controlling individual Dubstep beats or sound effects with the Kinect. Synapse allows you to map multiple effects to each limb, sending joint positions, hit events, and image depth data to both Ableton and Quartz Composer via OSC. The user interface looks fairly easy to work with, enabling musicians and artists to create awesome audio/visual displays using their bodies as instruments, in a very short period of time.
Check out the pair of videos below to see a brief walkthrough of the software interface as well as a quick video demonstration of what Synapse is capable of.