'Wii hacker' part of Microsoft's Natal effort

Johnny Chung Lee, the former Carnegie Mellon researcher known for finding creative ways to adapt the Wiimote, has revealed himself as one of the minions behind Project Natal, Microsoft's effort to add motion-sensing capabilities into the Xbox 360.

Lee, who is now a researcher at Microsoft, said in a blog posting that he has been working on the motion-sensing project.

"Now, I should preface by saying I don't deserve credit for anything that you saw at E3," Lee said in the blog, which he posted on Monday night. "A large team of very smart, very hard-working people were involved in building the demos you saw on stage. The part I am working on has much more to do with making sure this can transition from the E3 stage to your living room - for which there is an even larger team of very smart, very hard-working people involved."

Microsoft demoed Project Natal on Monday as part of its press conference at the E3 trade show. The technology allows a person to act as their own remote, with a depth-sensing camera capturing their motion, and software then translating it into actions.

Lee notes that he can't reveal anything beyond what Microsoft shared, but does talk a little about the technology that underlies Natal.

"The 3D sensor itself is a pretty incredible piece of equipment providing detailed 3D information about the environment similar to very expensive laser range finding systems but at a tiny fraction of the cost," Lee wrote. "Depth cameras provide you with a point cloud of the surface of objects that is fairly insensitive to various lighting conditions allowing you to do things that are simply impossible with a normal camera."

The hard work, he said, is then converting that cloud of points into human actions, something which requires some pretty sophisticated algorithms. That said, the work could lead in some even cooler directions.

"At times, working on this project has felt like a miniature 'Manhattan project' with developers and researchers from around the world to coming together to make this happen," Lee wrote. "We would all love to one day have our own personal holodeck. This is a pretty measurable step in that direction."

Before joining Microsoft, Lee gained attention for his projects using the sensor bar and remote of the Nintendo Wii to work as head-tracking devices, a multitouch user interface and more.

http://news.cnet.com/8301-13860_3-10...?tag=rtcol;pop