"We're dreaming about holograms," said Alex Kipman of Microsoft, as he unveiled a new set of technologies that will bring 3D imaging and augmented reality to Windows. That's right: holograms – possibly the biggest surprise from Wednesday's the Windows 10 consumer preview unveiling.
It's actually three technologies that will work together: Windows Holographic, which will enable 3D imaging in all future builds of Windows 10. Windows HoloLens (below), a headset for viewing and interacting with 3D images. And finally, the HoloStudio application will let you make your own holograms.
Microsoft teased the possibilities in a video: a HoloLens-wearing man played a 3D version of Minecraft. A HoloLens-wearing woman walking through an office, talking to a colleague on an image floating in front of her. Another user walked within a planetary scene. In a more everyday context, the weather report popped up on a family room rug, with 3D imaging augmenting the data.
The HoloLens itself is "the most advanced holographic computer the world has ever known," said Kipman. The headset will be completely wireless, with its own high-end CPU and GPU – and it will have a third chip, a Holographic Processing Unit, or HPU. (New acronym alert!)
"It will understand your gestures and voice," Kipman promised, "and spatially map the entire world around us." And unlike AR solutions we've seen up to now, the HoloLens will not need markers, external cameras, or a tethered phone or a PC to help it process the data – "terabytes of information from all of these sensors, all in real time," he described.
For the real-time demo of Windows Holographic and the HoloLens, a woman built a flying robot using a 3D "toolbox" that floated in her field of vision along with the object itself. She could pick items from the toolbox and apply them to the hologram, and move the hologram as she examined her work.
Finally, Kipman unveiled HoloStudio, an application for making your own holograms. (We're taking bets on who'll be first with their Princess Leia hologram imitation – "Help me, Obi Wan Kenobi. You're my only hope.")
Windows 10 may still be in preview, but adding holograms, 3D imaging, and augmented reality to the operating system pushes Windows way ahead of Mac OS X and Chrome OS, changing how people use computers in their daily lives. Stay tuned for our hands-on from the event.