Monday, June 7, 2010 at 10:56AM There's a bunch of companies working with 3D cameras and gesture/anatomy analysis, including of course Microsoft's Natal. Control of TVs with this technology seems the first best fit.
Monday, January 11, 2010 at 12:27PM I've been following Microsoft's Project Natal for a while now. Here's a video update — note the impressive 3D images coming in from the camera at 1:14.
Monday, December 21, 2009 at 10:35AM A few days ago I saw Avatar in 3D. Wow. The technical and artistic use of 3D in this film is phenomenal. And the result is the most comfortable 3D movie viewing experience I've ever had.
Wednesday, June 24, 2009 at 10:40AM Techcrunch covers the story of Zugara, a company applying augmented reality to online clothes shopping. I've asked women 'what software would women like to see'' in the past, and got this idea included in their reply a few times. Microsoft included this concept in their Natal mockups as well.
3D, Clothes, augmented reality, women in computing in News Saturday, June 13, 2009 at 11:39AM Project Natal has become an unfolding story on this blog. Johnny Chung Lee, the man behind the Wiimote head tracking hack which I've emulated before, has announced on his blog that he's now working with the Microsoft Project Natal team to take the system from demo stage to finished 3D gaming product.
Critisicsm on the web has been in the lines of "I don't want to wave my arms around to control my computer". And rightly so — I agree that this is a limited niche. However. Digital cameras, in a short decade or so have replaced analogue cameras due to their lowering cost, increasing pixel density and capture quality. In the same way, I envision this 3D technology quickly becoming cheap, high-quality and mainstream. Looking forward, this technology could be embedded into display screens itself. This would allow a touchscreen to obtain 'mouseover' information as well as improved touch information. It would also allow for more human gestures, performed over (but not touching) the flat input device, to activate occasionally needed actions.
For example:
To learn more, watch this 2006 Google tech talk explaining (what I believe is) similar technology. This is the first time I saw this technology, and their more long range version is impressive stuff. You need to scan forward about 20mins to get to the interesting stuff.
The video above shows some scenes which give you a sense of the 3D camera's data might be providing. This still image shows you the 3D data the Natal system may be receiving. However, turning this bunch of pixels into a reasonably accurate model of the human body is, as Johnny points out, really amazing.
Friday, June 12, 2009 at 10:44AM My previous post on Microsoft's 3D system gaming system 'Natal' questioned the 3D system's latency. In this fresh real-world demo on the Jimmy Fallon TV show, Kudo specifically aimed to demonstrate the 'low latency' of the system. I'm not sure if the red jumpsuits were related to demoing the system, but the system seemed very robust, and responsive enough for fun gaming. I think Microsoft has a winner here.
UPDATE: Via Engadget Apparently the red "suits were just for fun" UPDATE 2: Video got pulled down, sadly. I'm trying to find a replacement to embed.
Wednesday, June 3, 2009 at 1:36PM Sony today demoed their upcoming Playstation 3D controller, which integrates with their existing video interface, EyeToy. Fast forward past the uncomfortable engineers introduction, and you'll find an impressively accurate and subtle prototype game controller demo. I particularly like the merging of real-life video and computer generated tools/weapons.
Technically speaking, I'm guessing Sony's new controller uses refined version of existing technologies including image-tracking of the round wand-top, Wii-like accelerometers and potentially 3D radio telemetry. At at guess, the slightly-dorky sphere helps Eyetoy differentiate between wands, and the wands from the background by a imperceptible synchronized flicker. What I do like about this type of system is it's low-latency and high precision, which according to the video is "sub millimeter". What I don't like about the system is that it still needs to makes guesses about how you're holding the device, and so your avatar/character may not be displayed to match.
Doubtless, the Wii is fast-tracking all games companies' 3D research and designs — but in different directions. Wouldn't it be great if the above technologies were combined with 3Dcamera technology as displayed by Microsoft? Low resolution, but comprehensive 3D imaging will be provided by the camera, with high resolution and low-latency data being provided by the controller. On the other hand, given Moore's Law, we may soon see 3D cameras approaching current 2D camera resolution. High resolution 3D data, in conjunction with sub-millisecond parallel processing Xbox/PlayStation/OpenCL computational power might match the data quality these current controllers provide. Richer input (squeeze) and haptic feedback (sharp knocks as swords collide) might be physical controller's saving graces.
3D, Controller, eyetoy, future, microsoft, playstation, sony in News Tuesday, June 2, 2009 at 12:27PM 
Microsoft has announced at this years E3 Games conference a new peripheral/system coming next year for the XBox called 'Natal'. They've got some slick prototypes/ studio mockups which show people interacting with games and other applications in a very convincing manner. The technology is based on 3D camera technology which I've previously discussed, and it's good to see it coming to the fore. Microsoft certainly thinks it's a big deal, pulling out Spielberg and Peter Molyneux to talk up the future.
The promotional material implies that they've got some extra processing turning 3D camera bitmap images into models of the human body to be passed to the game itself. Perhaps this processing is the source of the lag between the person and the on-screen action in the video on this page, which I'm guessing is a real prototype. And too much lag and you end up with a cognitively tiring game. The system also boasts speech recognition — I'm skeptical on how effective that will be you're yelling at the screen. Overall, this new 3D system promises awesome new interaction possibilities, but given the huge hype, expect some post-natal depression if it doesn't meet expectations.
UPDATE: Natal now has a website.
Monday, April 27, 2009 at 11:27AM If you hadn't, erm, bumped into it before, then check out this Windows application. Bumptop is a very cool file management application. It's animated and "pretty", but there is substance to this style. I particularly like the piechart contextual menu.
3D, file management, future, gesture in News Monday, April 6, 2009 at 12:10PM Projection Mapping is a growing trend — exactly mapping the images from a digital projector onto a real world 3D space. I've covered some previous examples here. This is the first example I've seen which is not pure art, and seems to have real-world usability. I particularly like the reply function. What other examples of Project Mapping have you seen? (via createdigitalmotion)