VMware Integrates NVIDIA’s CloudXR Into its Collab Platform

VMware Nvidia CloudXR

NVIDIA and VMware have a long-running partnership when it comes to working together on XR solutions. As part of VMworld 2021 which starts today, the companies have announced that VMware’s Workspace ONE XR Hub will utilise CloudXR so the business solution can run on all-in-one (AIO) headsets.

Currently, in open beta, Workspace ONE XR Hub is VMware’s immersive expansion of its Workspace ONE Intelligent Hub, a solution design to improve employee engagement and remote productivity. Facilitating use cases like immersive training and design visualization can warrant using high-end PC’s and tethered headsets which aren’t always suitable or they’re simply expensive. AIO headsets are becoming far more commonplace yet lack the processing power for these high-end enterprise applications.

Hence why VMware is utilising NVIDIA CloudXR so that all the complex environments, scenes and simulations companies want to run can be achieved remotely on RTX GPU’s and RTX Virtual Workstation Software that a standalone headset can tap into.

“From immersive training to immersive design solutions, our customers need the highest fidelity experience with the greatest mobility. Running VR applications on VMware vSphere with NVIDIA vGPU, combined with NVIDIA CloudXR to stream content to a mobile VR headset, is a great way to solve that challenge,” said Matt Coppinger, director of XR at VMware in a statement. “We’ve also been developing Workspace ONE XR Hub, which will provide simple and secure access to native and remote VR applications. CloudXR integrated in VMware Workspace ONE will provide the ultimate enterprise experience for users and IT.”

NVIDIA

This is being showcased at NVIDIA’s booth during VMworld this week, combining Autodesk VRED, Workspace ONE XR Hub, and CloudXR. Attendees will be able to view real-time renderings of digital models on VR headsets, handheld phones and tablets.

NVIDIA unveiled its streaming solution in early 2020, with a beta programme allowing a select number of applicants to register and implement CloudXR. Its most recent advancements took place over the summer, adding support for bidirectional audio as well as Google Cloud integration. As further improvements are made to CloudXR, VRFocus will keep you updated.

NVIDIA CloudXR and Google Cloud to Collaborate on Immersive Streaming

NVIDIA CloudXR - Google Cloud

With SIGGRAPH going on this week computing specialist NVIDIA has released several new updates regarding its virtual reality (VR) compatible tech. The latest focuses on the NVIDIA CloudXR platform, revealing that it’s now collaborating with Google Cloud to provide high-quality XR streaming.

NVIDIA

The announcement sees NVIDIA CloudXR brought to NVIDIA RTX Virtual Workstation instances on Google Cloud, enabling organisations and XR users to securely access data their data and work with others all inside virtual, augmented or mixed reality (VR/AR/MR) experiences.

To showcase the tech NVIDIA has teamed up with Masterpiece Studio and its 3D creation platform Masterpiece Studio Pro which works with a variety of PC-based VR headsets like HTC Vive and Valve Index. Leveraging CloudXR and Google Cloud, artists are able to stream and collaborate on character creation.

Creators should have the freedom of working from anywhere, without needing to be physically tethered to a workstation to work on characters or 3D models in VR,” said Jonathan Gagne, CEO at Masterpiece Studio in a statement. “With NVIDIA CloudXR, our customers will be able to power their creative workflows in high-quality immersive environments, from any location, on any device.”

NVIDIA CloudXR - Masterpiece Studio
Masterpiece Studio Pro

“NVIDIA CloudXR technology delivered via Google Cloud’s global private fiber optic network provides an optimized, high-quality user experience for remotely streamed VR experiences. This unique combination unlocks the ability to easily stream work from anywhere using NVIDIA RTX Virtual Workstation,” said Rob Martin, Chief Architect for Gaming at Google. “With NVIDIA CloudXR on Google Cloud, the future of VR workflows can be more collaborative, intuitive, and productive.”

That all sounds great but it isn’t available just yet. NVIDIA CloudXR is currently in Early Access for developers to sign up to with the Google Cloud feature rolling out later this year. For those interested, a private beta will be available soon. VRFocus will continue its coverage of NVIDIA, reporting back with further updates.

NVIDIA Opens Omniverse Platform to Millions More Users With Blender Integration

NVIDIA Omniverse

NVIDIA’s virtual reality (VR) compatible, enterprise-ready collaboration tool NVIDIA Omniverse saw an early access launch last year after debuting back in 2017 at the company’s GPU Technology Conference (GTC). This week as part of SIGGRAPH 2021, NVIDIA has announced that the platform is expanding by adding new integrations with Blender and Adobe.

NVIDIA Omniverse

NVIDIA has revealed that since the arrival of its open beta in December, Omniverse has been downloaded by over 50,000 creators. These new integrations could open the platform up to millions of designers and artists who use Blender and Adobe software and wish to collaborate.

Blender is an open-source 3D animation tool used around the world and now gets Universal Scene Description (USD) support, enabling access to Omniverse’s production pipelines. On the Adobe side, the two companies are collaborating on a Substance 3D plugin, eventually opening Substance Material support to Omniverse. This will unlock new material editing abilities for users.

“NVIDIA Omniverse connects worlds by enabling the vision of the metaverse to become a reality,” said Richard Kerris, vice president of the Omniverse development platform at NVIDIA in a blog post. “With input from developers, partners and customers, we’re advancing this revolutionary platform so that everyone from individuals to large enterprises can work with others to build amazing virtual worlds that look, feel and behave just as the physical world does.”

NVIDIA Omniverse

“Lots of companies are, and have been, talking about the metaverse, but NVIDIA is one of the few that is actually delivering on its promise,” said Jon Peddie, noted author, consultant and founder of Jon Peddie Research. “NVIDIA brings a broader understanding of the needs of designers of all types and has many of the tools they can use — for free. The NVIDIA Omniverse platform has the potential to transform nearly every industry by making truly collaborative, creative innovation possible in a common virtual space for the first time.”

Designed for global and smaller enterprise customers, NVIDIA Omniverse is currently being evaluated by the likes of SHoP Architects, South Park and Lockheed Martin. Artists can use the platform to design buildings and create new products, viewing them in on a flatscreen or in VR.

Whilst NVIDIA Omniverse is currently in early access NVIDIA plans on officially launching it later this year on a subscription basis. For continued updates on Omniverse keep reading VRFocus.

Latest NVIDIA CloudXR Update Adds Bidirectional Audio Support

NVIDIA CloudXR

NVIDIA’s CloudXR platform envisions a future where high-end virtual reality (VR) and augmented reality (AR) content can be streamed directly to devices so they can be made lightweight and mobile, rather than being tethered. In its latest update, CloudXR 3.0, NVIDIA has implemented bidirectional audio support to make environments immersive whilst aiding social interactions.

NVIDIA CloudXR Autodesk

The addition of bidirectional audio is an important step for CloudXR as it allows real-time communication. This is not only essential for social apps in general but especially important where enterprise collaboration is involved, enabling colleagues around the world to naturally talk to one another.

This area is of particular focus for NVIDIA as it’s also working on the Omniverse Enterprise platform. With bidirectional audio not only can those in VR interact but it fully supports mobile devices for the widest platform support. Alongside mobile CloudXR also supports PC headsets like HTC Vive, Oculus Quest and Windows Mixed Reality. Early testers of CloudXR 3.0 include Autodesk and Accenture who’ve trialled the platform on their design and training software respectively.

“NVIDIA CloudXR is opening new ways for VRED to bring even more people together in collaborative experiences by reducing dependency on hardware and location,” said Lukas Faeth, senior product manager of Automotive Visualization at Autodesk in a statement. “We can’t wait to see where this technology will take automotive design and review workflows for Autodesk VRED users.”

“We tested CloudXR 3.0 and experienced great performance with complex training apps originally built of tethered XR. The addition of bidirectional audio for collaboration will take cloud rendered collaborative XR experiences to the next level,” adds Nicola Rosa, extended reality lead at Accenture in Europe. “With the latest CloudXR 3.0 release, we can finally start designing XR apps for the cloud without any limitation.”

In addition to the bidirectional audio support the NVIDIA CloudXR 3.0 update also includes:

  • iOS client improvements including world origin updates
  • Asynchronous connection support, so clients are kept responsive during connection establishment
  • In the Wave™ VR client, improving colour and gamma handling
  • Updated Windows SDK from 8.1 to 10
  • Multiple API changes — see CloudXR SDK API for additional details
  • Various bug fixes and optimizations

To learn more about NVIDIA’s plans for 5G and more head on over to Mobile World Congress (MWC) 2021 this week. Ronnie Vasishta, senior vice president of telecommunications at NVIDIA, will be giving an in-depth talk at the event. And for further CloudXR updates, keep reading VRFocus.

NVIDIA CloudXR 3.0 Update Brings Bidirectional Audio Support for Remote Collaboration

NVIDIA’s CloudXR technology is designed to provide real-time XR cloud streaming, which aims to remove the need for local high-end PC rendering hardware. At Mobile World Congress 2021 today, the company announced that its CloudXR 3.0 release will include bidirectional audio support—a fundamental piece of the equation when it comes to collaboration and social interaction.

Rendering immersive XR experiences in the cloud, compressing the video and audio streams, and serving that up to VR and AR devices for interactive experiences over 5G and WiFi networks—all at a low enough latency to make it feel like you’re tethered to powerful PC—is no small feat. That’s XR cloud streaming in a nutshell.

Although it’s been two years since the company first publicly demoed the technology, Nvidia appears to be making good headway. It’s already brought CloudXR client applications to PC, HoloLens 2, Android VR devices (including Oculus Quest), Android AR devices, and iOS. It offers support for OpenXR, bringing SteamVR content to those devices. It has an SDK for the service and has also brought CloudXR to the three leading cloud computing platforms: AWS, Microsoft Azure, and Google Cloud.

Now, the company announced it’s added bidirectional audio so developers can bring a host of social-based apps to the cloud rendering platform which were previously impossible. Besides opening the door for early testers like Accenture and Autodesk to integrate their own VR and AR collaboration-based productivity apps, the company says its CloudXR 3.0 release features:

  • iOS client improvements including world origin updates
  • Asynchronous connection support, so clients are kept responsive during connection establishment
  • In the Wave™ VR client, improving color and gamma handling
  • Updated Windows SDK from 8.1 to 10
  • Multiple API changes — see CloudXR SDK API for additional details
  • Various bug fixes and optimizations

Ronnie Vasishta, senior vice president of telecommunications at NVIDIA, is set to speak more about the 3.0 release at Mobile World Congress this week in a talk called ‘AI-on-5G: Bringing Connected Intelligence to Every Industry’. We’ll be tuning in here on July 1st at 8:00 AM CET (local time here).

There, Nvidia says Vasishta will “share how the fusion of enterprise AI-on-5G at the edge opens the doors to multi-trillion dollar industry transformation and new capabilities for smart cities, security systems, retail intelligence, industrial automation and optimization of network capacity utilization.”

The post NVIDIA CloudXR 3.0 Update Brings Bidirectional Audio Support for Remote Collaboration appeared first on Road to VR.