June 2011
10 posts
SYNAPSE for Kinect
Update: Synapse 1.1 released! Check the release notes for details.
Synapse is an app for Mac and Windows that allows you to easily use your Kinect to control Ableton Live, Quartz Composer, Max/MSP/Jitter, and any other application that can receive OSC events. It sends joint positions and hit events via OSC, and also sends the depth image into Quartz Composer. In a way, this allows you to use...
Synapse
This application is the brain running the whole show. You can get the app for Mac or Windows on the Download page.
The Synapse app gets the input data from Kinect and sends it out for Ableton, Quartz, and Max/MSP to read. To use it, plug your Kinect into your computer’s USB input (and make sure it’s plugged into the wall as well!) and start the application. You should see a blue...
Ableton Live
This requires Ableton Live 8.2.2 or higher. You can get a 30 day free trial here.
The dubkinect project is an example of how to use Synapse to control Ableton Live. You can find it on the Download page.
There are a series of user-friendly Max For Live patches included in the dubkinect project that can be used to control Ableton via Synapse:
Max Kinect Dial - This allows you to map a...
Quartz Composer
Quartz Composer is a free application from Apple which allows you to render graphics using a visual programming language. You can get it by installing the Xcode suite from your Snow Leopard install CD, or you can download the Xcode suite here (free to Apple Developer members, $5 otherwise). Since Quartz Composer is only for Macs, the information on this page only applies to Mac users.
...
MaxMSP/Jitter
This is sort of the “power user” section of the site. You can use Synapse to do plenty of great stuff in Ableton and Quartz Composer without ever having to touch even a bit Max programming. But, if you’re still interested, read on…
Max/MSP is a wonderful visual programming language developed by the fine folks over at Cycling ‘74. You can get a 30-day trial here....
Download
Synapse for Mac
Just plug your Kinect into your USB port (make sure it’s plugged into the wall,too), run the Synapse app, and you’re good to go! Requirements: Snow Leopard or better
Synapse for Windows
Installing on Windows is a bit more of a pain. Instructions here.
Ableton Live Example Set + M4L Patches
Includes all Max for Live patches for...
Source
I made this project in openFrameworks. When I started it, just getting all of the right addons at the right version and getting everything to compile and link properly was such a pain in the ass. It was probably the hardest part of the project!
So, I’m gonna try and make it easier on you. I took my whole openFrameworks directory, and just stripped out all of the unnecessary files. You...
Windows Install Instructions
Windows makes this way harder than it should be. Sorry, I wish this was easier. For the Mac version, all you have to do is unzip and run the application… Anyways, here are the steps to get it running on Windows:
Install the OpenNI binary. You can get it here
Install the PrimeSense Middleware. You can get it here. During installation, enter the key “0KOIk2JeIBYClPWVnMoRKn5cdY4=”
Install...
Release Notes
Release 1.1 (7/4/2011): Updates include:
Better support for doing looping-style performances by recording MIDI clips and using Looper. Check out track 5 in dubkinect to see how you’d use these tools.
Ability to cut the user out of the depth buffer so you don’t see the background.
Improved Max NoteDial.
Other new patches: Max Chord Create, Max Radio Button, Max Many Toggle, Max...
About
Here’s the backstory: I’m a programmer at Harmonix Music Systems in Cambridge, MA. I developed the gestural menu system in Dance Central, so I’ve been working with Kinect for a quite a while now.
A few weeks back I joined a team to work on an art project for Burning Man which involves using Kinect, Ableton Live, and Quartz Composer to create a synaesthetic experience. You can follow the...