Pranav Mistry and his SixthSense

Pranav Mistry, the one who says “Nothing can be and can not be one and at the same time and I am” has come up with a new Project called SixthSense / WUW – Wear your world – hope many are aware of it already. As I was just amazed by his new project, I couldn’t stop reading and understanding about this cool project called Sixthsense and just thought to share my a little info on the same.

“SixthSense” is a wearable gestural interface that augments the physical world around us with digital information and lets us use our own natural hand as gestures to interact with the information.

When we come across some object or place, we use our natural senses to perceive information about it, the information which helps us to make decisions and choose the right action at the right time. At the end what matters is the right decision with the right information, but we the human can’t store more information in our tiny mind mainly the data, information and the knowledge which is increasingly all available online.

Even though we have PCs, laptops devices that keep us connected with this digital world but there is no link between our digital devices and our interaction with the world. So there is a lot of gap from devices to physical interaction with the world. SixthSense bridges this gap, by bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. ‘SixthSense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.

By using a camera and a tiny pocket projector mounted in a pendant like a wearable device, a mirror, and a camera. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks the user’s hand gestures and physical objects using computer-vision based techniques.

The built-in software program grabs the video stream data captured by the camera and tracks the locations of the colored markers at the tip of the user’s fingers by using simple computer vision techniques. The maximum number of tracked fingers is only constrained by the number of unique fiducials, thus SixthSense also supports multi-touch and multi-user interaction.

Multi-Touch lets the user zoom in, zoom out or pan using intuitive hand movements or tracking the fingertip movements of the user’s index finger to draw on any surface. SixthSense even recognizes user’s freehand gestures (postures), this system also recognizes the physical objects with which the user is interacting with and projects more information about these objects – for example, a newspaper can show live video news or dynamic information can be provided on a regular piece of paper. The gesture of drawing a circle on the user’s wrist projects an analog watch.

You could check the following video where Pranav Mistry demonstrates about Sixthsense project and watch some visuals at the Official Sixthsense project page…..

You can always share your thoughts or opinions on this new approach…..