Head Tracking for Desktop VR Displays using the WiiRemote

So damn clever... releasing an SDK for the Kinect[1] was one of the smartest things Microsoft could have ever done and I think has gone a long way to contribute to it being the fastest selling piece of hardware in history[2] (did anyone know that? I sure didn't, and barely believed it reading it). This reminds me a lot of what Johnny Lee did with the Wii soon after it was released with head-tracking 3D[3] Part of me wants to stop using a computer and take up beet-farming because the cool factor seems so much less than what these guys are doing. Anyone on HN actively toying with a Kinect and want to share some video? [1] [link] [2] [link] [3] [this video]

Actually, stereoscopic vision is overrated. There are many hits our brain uses to make the 3D model of the world we have on our minds. Stereoscopic vision is one of them, but really just kick in for objects nearer than you arm cam hold. For distant objects, our brain uses other hints - that's why people aiming at far objects close one of their eyes. One of the strongest is the parallax effect, specially for medium distance and relative distance between objects. If you doubt it, look at this video: [this video] Relative size and color fading works well for big distances - this is the prominent effect in parachuting videos. These are only two mecanisms, and immersion is not only about 3D sensation. Full periphery vision is of great value for this (IMAX, anyone?). Sound hints, brigthness, contrast, and a lot of other hints also help our brain making the 3D model.

"We offer an experience of 3D on a single 2D image using the parallax effect, i.e, the user is able move his real-time tracked face to visualize the depth effect." Since there are no examples I can't be sure if this is is what I think it is, but IF it is: I want this on huge monitor for any 3D game instead of clunky headgear VR or tiny smartphone AR. Months ago I also tested this with a small 3D visualization and very crude head tracking. The effect is damn awesome! To be able to move around in real space with the rendering adapting to it, makes it so immersive, even for my very crude tests. In my opinion the resulting 3D effect is MUCH better than viewing in stereo with one picture per eye. Here is an example from someone else from 2007: [this video] From 2012: [link] Obviously this works for only one person viewing it, but does that really matter? There are a LOT of use cases where only a single person uses a single monitor for viewing, especially in these times. In fact it is the standard.

I absolutely agree. I'm very much a whiteboard hand-wavier guy. I explain with gestures as much as I do with the actual drawing (might be an Italian thing too). That said, this "pancake" problem reminded me of the old Wii head-tracking project.[1] There might be an interesting hybrid opportunity with that idea and 3d avatars. I feel like the head-tracking hack never really took off because it only worked as a solo experience. But since remote work is mostly us all individually sitting at a computer I could see it working better. Combine this idea with a large dedicated monitor/tv and now you have something that would literally just feel like a window/portal to the person you're talking to. [1] [this video]