PDA

View Full Version : Control Android with a projector and Kinect



wraggster
January 27th, 2012, 00:54
http://hackadaycom.files.wordpress.com/2012/01/android1.jpg
If you’re going to build a giant touch screen, why not use an OS that is designed for touch interfaces, like Android? [Colin] had the same idea, so he connected his phone (http://blog.recursivepenguin.com/?p=70)to a projector and a Kinect.
Video is carried from [Colin]‘s Galaxy Nexus to the projector via an MHL (http://en.wikipedia.org/wiki/Mobile_High-definition_Link) connection. Getting the Kinect to work was a little more challenging, though. The Kinect is connected to a PC running Simple Kinect Touch (http://code.google.com/p/simple-kinect-touch/). The PC converts the data from the Kinect into TUIO commands (http://www.tuio.org/) that are received using TUIO for Android (https://github.com/rjmarsan/TuioForAndroid).
In order for the TUIO commands to be recognized as user input, [Colin] had to compile his own version of Android (http://source.android.com/). It was a lot of work, but using an OS designed for touch interface seems much better than all (http://hackaday.com/2011/10/23/medusa-a-proximity-aware-tabletop/) the (http://hackaday.com/2011/09/06/controlling-samplers-and-sequencers-with-multitouch/) other (http://hackaday.com/2011/08/31/multitouch-tower-defense-uses-physical-towers/) touch screen hacks that start from the ground up.
You can check out [Colin]‘s demo after the break. Sadly, there are no Angry Birds.

http://hackaday.com/2012/01/25/control-android-with-a-projector-and-kinect/