Oculus Brings Mixed Reality Capture Support to Rift

Trying to capture what someone is experiencing when they’re head-first in a VR game has been an interesting problem to crack. By matching up live video and a digital environment with the help of a green screen setup though, you can essentially create a video that places you straight in the action—one that better communicates the immersion of a VR game than a simple first-person screen capture. Oculus recently revealed in a blog post that in the past months they’ve been working on bringing native mixed reality capture support to Oculus Rift, and it’s available today for developers to start creating mixed reality videos.

Oculus has recently published a guide to teach developers how to capture mixed reality with two important tools (besides a VR headset): a green screen and an external camera. The company says developers can create mixed reality content with either a stationary camera or a mobile camera that can be attached to a virtual, in-game object—letting you capture the scene from various vantage points and making the action even more immersive for non-VR viewers.

To help create a fixed or mobile camera that lets you capture you while in the physical world, Oculus has also provided a 3D-printable CAD model so webcams and small DSLRs can be attached to an extra Oculus Touch controller and either mounted on a tripod or supported by hand.

image courtesy Oculus

It’s not to say everyone with a VR-ready computer can create these sorts of videos though, as the requirements for mixed reality capture are likely higher than the ‘minimum spec’ published by Oculus that allowed computers as affordable as $500 to run VR games. To help out with the additional bandwidth requirements of mixed reality capture, Oculus suggests a number of components including its Oculus-approved Falcon Northwest Tiki computer (MSRP $2,899). The company hasn’t released any hard and fast requirements for mixed reality capture, but has mentioned its selected motherboards “work well” when paired with 16 GB RAM, an SSD hard drive and a GTX 1080.

As for cameras, Oculus provided support for “any USB camera,” but says that higher-spec cameras, including HDMI cameras, will predictably result in higher-quality mixed reality capture scenes.

3D printable mixed reality mount, image courtesy Oculus

Mixed reality setups are notoriously fiddly to build, and the company says their native mixed reality integration “does require numerous steps and a certain level of technical proficiency,” and that users should follow documentation “as precisely as possible, and pay special attention to the directions regarding Oculus sensor setup, USB ports, and chipsets.” Among Oculus’ setup guide, other guides for integrating mixed reality capture support Unity and Unreal apps are also available (UnityUnrealNative).

As pioneers of mixed reality capture, developers of breakout success Fantastic Contraption (2016) Northway Games published an extensive guide on how to set up mixed reality capture for HTC Vive headsets last year. Valve later incorporated the same green screen setup in their official announcement of the HTC Vive.

The post Oculus Brings Mixed Reality Capture Support to Rift appeared first on Road to VR.

World’s Largest Media Services Agency Launches VR Development Initiative

The world’s largest media agency, Horizon Media, has launched UNCVR. Partnering with STXsurreal, an experienced VR development studio, and OmniVirt, specialists in 360 video ads, the teams plan to expand development of virtual reality (VR), augmented reality (AR), mixed reality (MR) and 360 video content.

Horizon Media’s President and Founder, Bill Koenigsberg, is excited about the new mediums; “We  are always looking to create the most immersive and engaging experience for our clients and their brands.”

Koenigsberg continues; “We can only do this if we are continuously looking around the next corner and evaluating the potential creative and business opportunities with every piece of new technology. UNCVR is a big step into the virtual space and we are excited to make this move with STXsurreal to unlock its potential.”

UNCVR’s name is inspired by the team’s ability to work with and innovate in new mediums, ‘uncovering’ new possibilities. STXsurreal’s involvement can’t be understated either – the studio has plenty of experience in producing videos for platforms such as YouTube and Facebook 360 Video.

STXsurreal’s Co-Presidents, Rick Rey and Andy Vick, are positive that UNCVR will open the door for new talent in the medium; “Data increasingly shows that VR/360 platforms deliver significant audience retention and engagement.

They go on to say; “As audience demand for compelling, premium content in the immersive space grows, this represents a huge opportunity to bring major talent into VR and help them engage their fan base in bold and game-changing ways.  We look forward to being the go-to VR partners of Horizon UNCVR’s influential and innovative brands, to unlock the next-generation of storytelling.”

UNCVR will hopefully introduce new talent into the medium, and increase the amount of VR, AR and MR content available to users.

For everything on VR and beyond, stay on VRFocus.

Aryzon zeigt neues Augmented Reality Cardboard

Zwar war das Google Cardboard nie bei echten VR-Nerds beliebt, doch für viele Menschen stellte das Cardboard den Einstieg in die virtuelle Realität dar. Während sich Google mittlerweile auf hochwertigere VR-Erfahrungen mit dem Daydream-System konzentriert, entstehen Augmented Reality Brillen, welche die Cardboard-Idee von Google aufgreifen.

Aryzon zeigt neues Augmented Reality Cardboard

Das AR-Cardboard von Aryzon setzt auf die Verwendung eines Smartphones, doch die Umgebung wird euch nicht durch die Kamera des Smartphones angezeigt, sondern der Inhalt des Displays wird so reflektiert, dass ein transparentes Bild auf einer durchsichtigen Scheibe entsteht. Da ein gewöhnliches Smartphones seine Umgebung nicht scannen kann, setzen die Entwickler auf einen kleinen Marker, der von der Kamera des Smartphones erkannt wird. Durch den Marker weiß das Smartphone, wo die „Hologramme“ angezeigt werden sollen.

Aryzon

Wie gut das System bereits funktioniert, können wir nicht sagen. Die Kickstarter-Kampagne wurde jedoch innerhalb kürzester Zeit finanziert und wenn ihr das Projekt noch unterstützen wollt, dann bleiben euch aktuell noch 33 Tage. Ein Kit der Brille erhaltet ihr, wenn ihr mindestens 29 Euro in das Unternehmen investiert. Leider werdet ihr neben dem Geld auch etwas Geduld benötigen, denn das Cardboard soll erst im September 2017 ausgeliefert werden.

Aryzon ist jedoch nicht das erste Unternehmen, welches ein Cardboard für Augmented Reality nutzen will. Auch die ZapBox für 30 US-Dollar setzt auf Pappe, doch bei diesem System seht ihr die Umgebung nur durch die Kamera des Smartphones.

(Quelle: Upload VR)

Der Beitrag Aryzon zeigt neues Augmented Reality Cardboard zuerst gesehen auf VR∙Nerds. VR·Nerds am Werk!

Zoning AR Permissions with the Mixed Reality Service Spec

MarkPesce

Mark Pesce is a VR pioneer who has been thinking about networked virtual and augmented reality for over 20 years now. He developed the Ono-Sendai Sega VR helmet prototype, co-created VRML, and presented his Cyberspace Protocol spec at the first Web conference in 1994. This CP spec evolved into the Mixed Reality Services spec, which aims to be a distributed system that would grant geospatial permissions for mixed reality applications.

This system would be an open way of preventing AR games from being played at culturally sensitive locations, but also provide Universal Resource Identifiers to bring the open web to the real world. It could provide permissions for airspace & drones, surveillance permissions, AR game permissions, hazmat warnings, electrical and plumbing layouts, and hours of operations for buildings.

I had a chance to catch up with Pesce where he gave me a history of his work on the canceled SEGA VR helmet, VRML, and the evolution of the Mixed Reality Service. We also talk about his first ritual in VR and Technopagan explorations, as well as his thoughts on ethics in overall tech industry.

LISTEN TO THE VOICES OF VR PODCAST

Show Notes


Support Voices of VR

Music: Fatality & Summer Trip

The post Zoning AR Permissions with the Mixed Reality Service Spec appeared first on Road to VR.

Ready Player Cix: How One Rogue is Revolutionizing Mixed Reality

Ready Player Cix: How One Rogue is Revolutionizing Mixed Reality

Several years ago, in a warm Los Angeles court room a young man stood with his hand on a bible. His right hand was raised and his mouth was repeating a solemn oath. Once he was finished speaking, his name would be officially changed. He walked into the court [real name redacted] but would leave freer, fresher and more focused with his brand new identity: Cix Liv.

A few months before that fateful day in court, Liv had his identity stolen. Financial institutions told him in no uncertain terms that he had one of two choices: freeze all of his accounts while they sort out the problems, or get a new identity. This second option was likely more of a joke than anything else, but Liv took it to heart. He decided to use this theft as a chance to reinvent himself, a chance to forge that identity he wanted not the one anyone else had chosen for him. Liv knew exactly where to find this new identity. He had been keeping it for years now in a world separate from our own — World of Warcraft.

Cix the Rogue on the World of Warcraft start screen

Cix was originally the name of a character from the immensely popular MMORPG World of Warcraft. Here was an identity that Liv had been pouring hours of time, intent and skill into for years. Cix was not a random name bestowed by well meaning parents. Nor did it carry a lifetime’s worth of memories and experiences, not all of them wonderful. Cix represented everything Liv wanted from his new persona: freedom, individuality and, most importantly, a personality that would guide his life in the real world going forward.

Human Cix

As we chat at the Upload offices in San Francisco, Liv explains to me how the rebranding of his life connects to his current work in virtual reality.

Originally from Minnesota, Liv reflects that “I always told my friends one day I would just get in my car, drive to San Francisco and start a company. Three years ago I pulled that trigger.”

Even before he changed his name “LIV was always a brand I was building since my early teens.” Today, the young company currently consists of Liv and his fellow co-founders: Pierre Faure (CTO) and AJ Shewki (CMO). Their team may be small but their goals are anything but. In this gold rush era of relatively cheap and easier to produce VR content, LIV has decided it is going to delve into the vastly more complex and expensive world of VR hardware. Their goal is to create “a full stack, deployable content creation platform consisting of custom hardware and software with one goal: to make Mixed Reality accessible to the masses.”

Mixed Reality is a term still in the process of being fully defined and contextualized. As the immersive industry grows and changes, the definition of MR will likely do the same. Today, MR is most often associated with the complicated process by which real life people can be overlayed into the digital world in order to create powerful visual representation of how a VR experience works.

For example, take a look at this video for Fruit Ninja VR:

It’s not bad by any means and it does what most VR videos do nowadays: shows you a first person perspective and highlights hand interactions as best it can.

Now take a look at this gif of the same game created using Liv’s unique MR platform.

By showing you a real human in action, digital situations can be understood and explained much more easily to those outside. MR is a powerful tool for the demonstration of VR, the problem is it’s very technical, very expensive and very specialized. Only a few studios in the world can pull something like what you saw above. LIV wants to change that. The team has created a simple, repeatable, portable MR studio that can be set up and deployed by just about anyone. It is named Cube.

The LIV Cube MR green screen fully deployed

LIV Cube is a “modular, seamless green screen designed from the ground up to capture studio quality Mixed Reality and experience room-scale Virtual Reality.” It measures 8x8x8 feet with a custom aluminum frame and weighs just 27 pounds. The entire thing can be set up in under an hour.

It takes more than a green screen to make MR run, however, and so joining LIV Cube on the front lines of mass-market MR is LIV Box and LIV Client. LIV Box is a custom-built computer designed by Liv himself. It is described by the company as a “future proofed, custom, hand assembled PC hardware pre-calibrated and configured to run the latest in VR experiences.”

The final piece of the puzzle is LIV Client. This is “software built to remove the incredibly complicated task of calibrating virtual cameras and capturing software to successfully run, record and live stream Mixed Reality.”

It’s not terribly difficult to set up a green screen or find a powerful computer if you know what you’r doing and are willing to commit time, money and patience to the task. What is complicated, often prohibitively so, is making sure MR works flawlessly every time. There is an insane amount of minute calibrations necessary to pull of a proper MR experience and for those without months of experience it’s simply too difficult to even attempt.

LIV Client, therefore, is the most valuable component of the entire LIV platform. With just a few clicks you can record reliable MR video or stream it to a live audience.

All together, the LIV system has the potential to revolutionize the way studios and corporations explain and demo their software to the world. Pre-orders for the LIV MR platform are beginning on March 30 and with a goal to begin the shipments in July.

Cix Liv changed his name in an attempt to seize control of his own identity in a world that wanted to define who he was. Now, he sees VR as a place where the rest of the world can do the same.

As he puts it, “in the digital world you choose your own identity and people don’t realize how powerful that is.”

Hopefully, with tech like this, they will soon.

Disclaimer: Cix Liv rents a floating desk at the Upload SF co-working space. His standing as a paying member had no influence on this article’s inception or its content. 

Tagged with: , , , ,

Magic Leap, Jason Rubin And Insomniac Games To Speak At D.I.C.E. 2017

Magic Leap, Jason Rubin And Insomniac Games To Speak At D.I.C.E. 2017

VR fans will be gearing up for the 2017 edition of the Game Developers Conference soon, as it gets underway in just over a month, but another big industry event is taking place just ahead of it.

The 2017 D.I.C.E. Summit, another show aimed squarely at developers, will be taking place from February 21st – 23rd at the Mandalay Bay Convention Center in Las Vegas. It’s a respected event for industry professionals, with talks and panels from pioneering developers and the annual D.I.C.E. Awards, one of the more prestigious videogame awards ceremonies. This year’s show is significant for both the VR and MR industries, as it will feature appearances from some of the biggest names in both.

On the VR side, Jason Rubin, Head of Content at Facebook’s Oculus will be hosting a panel with Insomniac Games CEO and founder, Ted Price. The session, brilliantly titled ‘Jason and Ted’s Excellent VR Panel’, will see the pair discuss the first year of consumer VR and the future of the tech. Rubin has plenty of insight into the VR industry — just listen to him talk in our recent podcast — and Insomniac has already released three games on Rift, so it should be an interesting session.

Perhaps even more enticing is a session from Graeme Devine, Chief Game Wizard at the elusive mixed reality company, Magic Leap. There’s still much to learn about what this team are working on, and hopefully we’ll get a glimpse into that with his presentation, ‘Into the Future’, where he promises to talk about how MR will change our lives and how to create gaming content for it.

The D.I.C.E. Awards don’t have much to offer in terms of VR this year, however. Driveclub VR [Review: 7/10] is up for Best Racing Game and Schell Games’ I Expect You To Die [Review: 7.5/10] is up for Outstanding Achievement in Game Design but that’s about it. With other awards ceremonies starting to make their own categories for VR games, hopefully we’ll see D.I.C.E. follow on in 2018.

Tagged with: , , , , , ,