StyM
10-04-2016, 05:36 AM
http://www.tomshardware.com/news/owlchemy-depth-camera-mixed-reality,32800.html
Owlchemy Labs (maker of Job Simulator, one of the first Vive titles ever shown to the press) is one of the pioneering developers in the VR industry, and it's once again proving itself by innovating a new way to shoot in mixed reality.
Before the HTC Vive launched, Owlchemy Labs released a mixed reality trailer for Job Simulator as part of its marketing campaign. Soon after, Valve got involved and created tools to allow it to film mixed reality video, which it used for the Vive launch commercial. Valve later released instructions to the developer community that explained how to enable mixed reality rendering in Unity games.
Since then, developers, streamers, YouTubers and HTC have embraced mixed reality VR, but the process is cumbersome?to say the least. The process for mixed reality video today involves rendering foreground and background objects in separate windows and compositing them together with the camera footage stuck in between.
The results from the current mixed reality method are impressive, but Owlchemy thought it could do better. And so it did. Owlchemy Labs built a custom shader and custom plugin that allows the developer to record video with a depth-sensing camera. In other words, Owlchemy is bringing three-dimensional video footage directly into the game through Unity and compositing it in-game. It doesn?t rely on third-party software to composite the scene.
"'Job Simulator' presents a huge problem for mixed reality because the close-quarter environments surround the player in all directions and players can interact with the entire world,? said the Owlchemy Labs team. "Essentially, 'Job Simulator' is the worst case scenario for mixed reality, as we can?t get away with simple foreground/ background sorting where the player is essentially static, and all the action happens in front of them (a la 'Space Pirate Trainer')."
Owlchemy Labs (maker of Job Simulator, one of the first Vive titles ever shown to the press) is one of the pioneering developers in the VR industry, and it's once again proving itself by innovating a new way to shoot in mixed reality.
Before the HTC Vive launched, Owlchemy Labs released a mixed reality trailer for Job Simulator as part of its marketing campaign. Soon after, Valve got involved and created tools to allow it to film mixed reality video, which it used for the Vive launch commercial. Valve later released instructions to the developer community that explained how to enable mixed reality rendering in Unity games.
Since then, developers, streamers, YouTubers and HTC have embraced mixed reality VR, but the process is cumbersome?to say the least. The process for mixed reality video today involves rendering foreground and background objects in separate windows and compositing them together with the camera footage stuck in between.
The results from the current mixed reality method are impressive, but Owlchemy thought it could do better. And so it did. Owlchemy Labs built a custom shader and custom plugin that allows the developer to record video with a depth-sensing camera. In other words, Owlchemy is bringing three-dimensional video footage directly into the game through Unity and compositing it in-game. It doesn?t rely on third-party software to composite the scene.
"'Job Simulator' presents a huge problem for mixed reality because the close-quarter environments surround the player in all directions and players can interact with the entire world,? said the Owlchemy Labs team. "Essentially, 'Job Simulator' is the worst case scenario for mixed reality, as we can?t get away with simple foreground/ background sorting where the player is essentially static, and all the action happens in front of them (a la 'Space Pirate Trainer')."