HoloLens is one of the most exciting, and futuristic products to have come out of Microsoft"s labs in recent years. The headset aims to merge the physical world with the digital, allowing users to interact with holograms as if they were real objects. While this is all impressive, we still don"t know much about how the Redmond-based company creates content for the new platform. While we already knew that the company employs an aptly-named Holographic TV Studio, a new video from the team behind the product explains more.
The video is captured using an astounding 106 RGB and infrared cameras linked to one another, placed around the actors. They are surrounded by a green background around them. The video is then processed to remove silhouettes and then the final product product is created in multiple stages, starting with a 3-D model of the actors. Impressively, the technology is able to distinguish more important things, like the hands and the face, retaining higher quality and more data for these parts when the video is compressed for typical consumer use.
The video features multiple examples, including a traditional dance, a clown and a hamster. All of these can be viewed from any angle and are stationary relative to the user, providing an impressive and exciting look at how we might be consuming media a few years into the future.
Source: ACM via Gdgt Arena