Interactive 3D Environment in the “HoloDesk”

The “Holodesk” known from Star Trek is within reach – Microsoft has put its Kinect camera to use for an interactive augmented-reality application with this very name.
Microsoft Messenger 2011 advertisement with a child using a laptop

Archive notice: This article was originally published on October 25, 2011. Links and embedded videos are preserved as part of the historical record.

Simulated 3D objects

The Holodesk is used to simulate an environment in which it is intended to be possible to interact with virtual 3D objects; real objects can also be included. Through the use of a Kinect camera and a transparent display, the simulated reality of an object that can be picked up and moved is intended to be created. The two-dimensional image of the object is projected onto a beamsplitter to appear three-dimensional. The Kinect camera recognizes the movement of the hands of the person interacting with virtual objects; based on a special algorithm, the connected PC calculates the graphics processes of the movement onto a 3D environment.

Practical application

At the UIST specialist conference in Santa Barbara, Microsoft presented another possible application based on this technology, the so-called OmniTouch system. It is intended to be able to display multi-touch user interfaces on any object. However, the OmniTouch system is not yet intended to be suitable for everyday use, because the user would have to attach a camera to their shoulder in order to operate the touchpad. So far, only a prototype exists; Microsoft intends the technology to be used, for example, in the construction area of engineering offices or for interactive board games.

Article details

Published
Reading time
About 2 min
Word count
228

Tags