Mastercard Looks To AR As It Thinks Of Retail’s Future

Money makes the world go round, or so the saying goes. It’s not a statement that many people are necessarily happy with, but there is an underlying truth to it. Unfortunate as that may be. Over the last six months in particular on VRFocus we’ve seen a dramatic increase in the amount of new stories revolving around the subject of money and not just from the financial sector.

Both the advertising and retail sectors have been eying virtual reality (VR) and augmented reality (AR), In the last few months of the year alone we’ve discussed new advertising platforms between Advir and Yahoo!, Nokia and Quello, OmniVirt revealed monetisation platforms for both VR and 360 degree video. We’ve had holographic retail assistants, whilst in China one company is integrating both immersive technologies into the shopping experience. Now it is banking platform Mastercard that are looking to get in on the act.

Mastercard already partnered with Swarovski for a VR shopping trip which we reported on last month, however this time it’s an AR shopping experience that are involved in and one which will also tie-in its secure payments methods. It is a collaboration between Mastercard, ODG (the developers of the experience) and Qualcomm on this occasion. With Qualcomm providing the technology required for iris recognition which will be used to verify purchases.  The idea is that you can see representations of the product before shoppers make a purchase with additional ways to view the product not possible in a regular retail store. Payment can then be made through the same app via the iris recognition.

“At Mastercard, we are seeing major shifts in how commerce is conducted, as people lead increasingly connected, digital lifestyles.” Said Executive Vice President of Digital Partnerships at Mastercard, Sherri Haymond. “As the physical and digital worlds blend together, we are focused on developing solutions that provide merchants with the ability to accept payments across all technology platforms possible—in-store, in-app, online, and in AR and VR—to help drive how people will experience shopping and payments in the future.”

“Qualcomm Technologies’ iris authentication and extended reality technologies for Snapdragon 835 are designed to support a future generation of contextually aware commerce experiences using secure, augmented reality. We are delighted to work with Mastercard and SAKS Fifth Avenue to showcase new AR experiences on ODG’s sleek smart glassed based on our Snapdragon 835 Mobile Platform. Our commitment to innovation has the potential to deliver more personalized in-store experiences in the future.” Commented Neeraj Bhatia, Director, Product Management, Qualcomm Technologies, Inc.”

“ODG is delighted to work with Mastercard and Qualcomm Technologies, fellow leaders in their respective fields, to offer a look into the future of shopping and purchasing habits.” Added Founder and CEO of ODG Ralph Osterhout. “This solution showcases the transformative nature of augmented reality in the retail space and highlights the power and performance of ODG smartglasses and the unparalleled potential for headworn AR to change the way we see and experience the world.”

Mastercard’s rival VISA revealed a in-VR payment app earlier this year, also partnering with Zeality and Bank of America on VR content creation. In June last year the company’s European branch unveiled their own AR payment technology through
partnership with Blippar.

VRFocus will bring you more news on AR developments soon.

 

 

HTC Vive Reveal First Standalone VR Headset

HTC has today announced the first Vive Standalone virtual reality (VR) head-mounted display (HMD), specifically targeting the China market. The device will utilise Viveport as its official content platform, it was revealed at ChinaJoy 2017 today.

Vive Standalone ChinaThe Vive Standalone will offer broader audiences a more affordable, high-quality VR experience, and will expand the Vive family beyond its PC-based VR experiences. Without the requirement for an external PC or smartphone to operate, the Vive Standalone will utilise advanced features of the Qualcomm Snapdragon 835 mobile VR platform designed to support built-in VR functionality and allow developers to more rapidly release compelling content.

“China is the leading mobile market in the world today, and has the momentum to lead the global VR market as well,” said Alvin W. Graylin, China Regional President of Vive, HTC. “Partnering with Qualcomm to deliver an easy to use and more affordable Vive VR system will enable us to make premium standalone VR widely accessible to the masses in China.”

“Snapdragon 835 is designed to deliver superior VR experiences without the need for wires or a separate PC,” said Hugo Swart, Senior Director, Product Management, Qualcomm Technologies, Inc. “We are thrilled to work with HTC’s Vive team as they utilize our rich feature set to create exciting, new VR experiences in the first truly mobile VR headset of the Vive ecosystem.”

The press release accompanying the announcement was light on information, including any specifications for this first Vive Standalone HMD outside of the use of Qualcomm’s Snapdragon 835 processor. However, it was noted in communication with VRFocus that this device is not the same as that which was announced during Google’s I/O conference back in May 2017, and as such further additions to the Vive Standalone line-up should be expected to be revealed soon.

VivePort header newInterested VR developers may register at www.viveport.com/standalonevr-cn to apply for participation in Vive Standalone associated support programs and get early access to upcoming developer events. VRFocus will of course keep you updated with all the latest details on the Vive Standalone HMD range, including more coverage of this announcement coming later today.

Thundercomm Unveils Qualcomm Snapdragon 835 Powered Headset TurboX VR DK1

At the Mobile World Congress (MWC) this week, Thundercomm has announced a new all-in-one head-mounted display (HMD) platform called TurboX VR DK1. 

Powered by Qualcomm’s Snapdragon 835 processor, the TurboX VR DK1 is part of a ‘HMD Accelerator Program’ initiative between the two companies. It’s been designed for OEMs that want to build a virtual reality (VR) HMD of their own, so they’ll be able to choose from a pre-qualified set of components, including the Thundercomm VR HMD platform with Snapdragon 835.

qualcomm-snapdragon-835

Using the latest Snapdragon VRDK V2.0, the reference design takes advantage of up to 1,000Hz sensor fusion algorithm, a high-performance OLED screen, a new ASW algorithm to reduce system latency to 15ms or less, and 3D audio for better immersion. The TurboX VR DK1 can also integrate with eye tracking technology for use with foveated rendering, reducing the performance load on the GPU.

“Thundercomm has great advantages in the fields of chips and operating systems. Focused on providing endtoend intelligent hardware solutions to ODM/OEMs, Thundercomm is an expert in system optimization, sensor fusion, low latency, distortion correction, and more,” said Larry Geng, Chairman of Thundercomm. “I believe the successful launch of the TurboX VR DK1 reference platform will bring huge opportunities to start-ups and accelerate the development of the VR industry.”

“We have a strong relationship with Thundercomm in non-smartphone segments using Snapdragon, and it is exciting to extend the effort to VR with their software, module and standalone HMD as part of the HMD Accelerator Program,” added Hugo Swart, senior director, product management, Qualcomm Technologies, Inc. “The TurboX VR DK1 will be a powerful tool for OEMs and the rest of the ecosystem to support quick timetoproduction of high quality products.”

Qualcomm has been pushing further into VR as the mobile market takes off. The Snapdragon 835 was only officially announced at CES 2017, and this month the company partnered with Leap Motion on a new HMD.

For the latest Qualcomm VR updates, keep reading VRFocus.

Qualcomm’s Standalone VR Is Getting Embedded Leap Motion Hand Tracking

Qualcomm’s Standalone VR Is Getting Embedded Leap Motion Hand Tracking

Last September we reported on the fact that Qualcomm was launching their own VR development kit with the ability to deliver standalone VR. What made the VR 820 so compelling was that it had 6-DoF tracking as well as integrated compute (Snapdragon 820) which was on par with all the latest flagship phones. It even had support for eye tracking, which we now know was through a partnership with none other than SMI. However, there was one thing that was missing, hand tracking. In fact, Intel was already demoing hand tracking this year at CES with their Project Alloy prototype.

Anyone that has used mobile VR knows that controllers are nice, but unless you can ‘see’ your hands and interact with your surroundings with your hands, the immersion is lost. HTC and Valve do this with their Vive controllers that are super low latency and extremely accurate and Oculus does this with their touch controllers and their extremely natural ergonomics. When it comes to mobile, in many cases you’re either stuck with a Bluetooth gamepad on Samsung or a controller like the Daydream controller which simply put isn’t good enough. Thankfully, the team at Leap Motion have been working tirelessly to deliver hand tracking and late last year launched their much more compact hand tracking solution specifically aimed at mobile form factors.

Now that their technology has been miniaturized, it can be integrated into platforms. One such platform that’s launching at MWC and GDC (since both shows are happening simultaneously), is Qualcomm’s new Snapdragon 835 VR development kit. This new Snapdragon 835 VR development kit features a 2560×1440 AMOLED display, 6DoF tracking, eye tracking, foveated rendering and many other performance and power saving features. This system is essentially an upgrade over the Snapdragon 820 developer kit that Qualcomm launched at IFA 2016. The real improvements are increased performance, power savings and support for Leap Motion. While we don’t quite yet know the performance of the Snapdragon 835, the expectations are that it will be quite a bit faster on the GPU than the Snapdragon 820, which is a blessing for VR. The Snapdragon 835 VRDK is expected to be available in Q2 through the Qualcomm Developer Network. This device is really designed to help developers optimize their apps for the Snapdragon 835 HMDs that are due out in the second half of this year.

In addition to announcing the partnership and support of Leap Motion and a new VR development kit based on Snapdragon 835, Qualcomm is also announcing an HMD accelerator program. This program is specifically aimed at accelerating the time to market for HMD manufacturers, which has been an issue for some companies. The program is designed to help HMD manufacturers reduce their engineering costs and time to market so that they can seed the market with these HMDs faster. Part of this program utilizes the newly announced Snapdragon 835 VR HMD and will connect OEMs with ODMs like Thundercomm or Goertek, the two leading HMD ODMs in the world. The program is designed to help OEMs modify the reference Snapdragon 835 VR HMD and enable pre-optimized features like SMI’s eye-tracking and Leap Motion’s hand tracking.


These three announcements are very closely intertwined and show where mobile VR and more specifically standalone VR is going. Mobile VR itself will still benefit from the advances that result from these new developments, however standalone VR is currently the focus of this platform. The interesting thing about the mobile industry and players like Qualcomm is that they can iterate so much more quickly than their PC counterparts that we are seeing mobile HMD feature sets leapfrog PC. The fact that the Snapdragon 835 VR platform will support both eye tracking and hand tracking is huge because both of those are natural interfaces. Combining hand tracking, eye tracking and voice recognition into a single device means that a user can naturally interface with their VR HMD without ever needing to touch anything. Ultimately, hands free VR is the holy grail and I think that Qualcomm has brought us one step closer to that reality.

Disclosure: My firm, Moor Insights & Strategy, like all research and analyst firms, provides or has provided research, analysis, advising, and/or consulting to many high-tech companies in the industry, including Google, Intel, Qualcomm and Samsung cited or related to this article. I do not hold any equity positions with any companies cited in this column.

Tagged with: , , , , , , , , , , ,