Tracking Your Hands Using Flex Sensor Technology with Manus VR

Stijn-StumpelI had a chance to try out the Manus VR hand-tracked controller on the expo floor of GDC this year and saw that there a couple of really strong use cases for having your hands and fingers tracked in VR. You can be a lot more expressive within social VR, and in mixed reality experiences where passive haptic feedback is available, having your hands tracked can actually increase the level of embodied presence.

I had a chance to catch up with the lead designer of Manus VR, Stijn Stumpel, at GDC where we compared Manus VR to Leap Motion, talked about how the flex sensors work, the use cases where having tracked hands makes sense, their extremely polished demo called Pillow’s Willow, and where they’re going in the future.

LISTEN TO THE VOICES OF VR PODCAST

At GDC, Manus VR strapped an HTC Vive controller to the back of my wrist, and it gave a lot more consistent tracking of the location of my hands as a result; I didn’t have to worry about keeping my hands within my field of view like I do with optically tracked solutions like Leap Motion. There was some uncanniness in not being able to actually physically grab objects, which can break presence. And I also experienced a lot more than 20ms of latency in my finger movements, which was a presence breaker. But I was told that they are able to achieve much better latency performance in their lab environment.

Manus VR just announced in a press release that their “gloves are being used in experiments to train NASA astronauts in mixed reality to prepare them for the International Space Station.” Here’s some footage of some of that training that they’ve released.

They also announced that Manus VR is joining the first SteamVR Tracking class being taught by Synapse on September 12th in order to create a version of their glove that has the SteamVR Tracking sensors built in. So I expect to see the next iteration remove the stopgap solution of attaching a SteamVR controller onto the back of your arm. With the increased amount of tracking on the arm, then they might also start to be able to do a lot more accurate inverse kinematic tracking of your body and be able to have a powerful invocation of the virtual body ownership illusion.


Support Voices of VR

Music: Fatality & Summer Trip

The post Tracking Your Hands Using Flex Sensor Technology with Manus VR appeared first on Road to VR.

NASA’s Astronauts Training in Mixed Reality with Manus VR Gloves

Manus VR a company designing gloves for virtual reality (VR) applications, has revealed American space agency NASA using its technology to train its astronauts in mixed reality (MR).

In a video released today Manus VR details how its glove are being used in various experiments by astronauts in preparation for them going to the International Space Station (ISS). NASA has recreated the ISS in VR to create a realistic training environment, and with the use of the Manus VR gloves get an accurate representation of their hands for more intuitive interaction.

The environment has been created with Unreal Engine 4 in conjunction with NVIDIA PhysX. The system uses the HTC Vive head-mounted display (HMD) with the controllers attached to the wrists of the user, something Manus VR has been experimenting with for several months.

“This is an amazing opportunity to showcase what the Manus VR glove can do for VR, AR and Mixed Reality. NASA is looking forward to work with the upcoming Manus VR development kit and the Manus VR Tracking Bracelet for SteamVR Tracking,” said Manus VR in a statement.

Last month Valve announced the royalty free opening of its SteamVR Tracking technology to which Manus VR has signed up to the first class provided by Synapse. In doing so Manus VR will learn more about the tech and how to best implement it with the tracking bracelet.

VRFocus will continue its coverage of Manus VR, reporting back with any further announcements.