Innovations in AR: Heavy Industry

Augmented reality (AR) is a key pillar of Industry 4.0 (or the fourth industrial revolution), side-by-side with other potentially transformative technologies like machine learning and big data. Indeed, consultancy firm PwC has estimated that industrial manufacturing and design is one of the biggest areas for augmented and virtual reality (VR), with their use in heavy industry having the potential to deliver a $360bn GDP boost by 2030.

In this latest edition of our series on how augmented reality is faring across a range of industries, we’ll be taking a closer look at why AR is proving so useful in heavy industry, in particular the fields of construction, manufacturing and energy.

Construction

AR is proving to be a key tool for the construction industry, whether in the design stage or actually in the construction process itself, leading a 2020 study of the architecture, engineering, and construction (AEC) industry to say that AR and VR would see “strong growth” in the next 5 to 10 years.

On the design side, numerous architectural tools exist to help with space visualisation using augmented reality. One such example is The Wild, which allows designers to view 3D models in both virtual and augmented reality. Such tools can layer virtual details onto a building plan so that plans can be more readily understood by stakeholders. 

That requires highly detailed and accurate 3D models, which is where the technology overlaps with digital twin technology. Using those digital twins, companies like Akular can enable clients to see what a building would look like on-site in the real world before it is built via a mobile application.

When it comes to actual construction, augmented reality again finds a number of uses, not least training workers on safety. That might involve AR headsets that interact with tags on potentially dangerous areas to bring up safety information, but even before workers are on-site, AR can help with training them on how to use heavy machinery – as with the construction equipment training simulators offered by CM Labs or the Arvizio AR Instructor.

Arvizio AR Instructor

“Industries are experiencing a shortage of skilled front-line employees and view augmented reality as a means to accelerate training and efficiently transfer the expertise of experienced workers,” said Jonathan Reeves, CEO of Arvizio. “Arvizio enables organizations to rapidly upskill employees without the need for on-site coaching and mentoring. By delivering no-code authored augmented reality instruction and remote expert connectivity, AR Instructor can substantially increase productivity and reduce errors of workers performing complex operational activities.”

Meanwhile, progress capture and tracking functionality directly compares real-world sites with virtual models to ensure they aren’t deviating – all in real-time. A host of companies provide variations on that technology such as VisualLive, which enables users to witness 3D models in real life via headsets such as the Microsoft HoloLens or mobile devices.

Manufacturing

Much of the technology we’ve covered for construction can equally apply to the manufacturing industry, whether that’s learning how to use dangerous equipment or visualising the layout of equipment and machinery in a factory. None of this is to say there aren’t plenty of bespoke uses for augmented reality in the manufacturing space, however.

One early pioneer was Volkswagen, which was using augmented reality to assist service workers way back in 2013. The MARTA app showed step-by-step instructions on how to repair and replace certain components, overlaying its advice on the car via an iPad app. Along similar lines is Boeing’s more recent use of augmented reality to give technicians real-time, hands-free, interactive 3D wiring diagrams. 

Interestingly, that technology has bled over into the consumer space with AR manuals that assist car-owners with basic maintenance operations by showing precisely where components are located within a car.

In the design space, AR has been deployed by the largest manufacturers to rapidly iterate and do away with expensive and time-consuming physical prototypes. In the case of Ford and its partnership with HoloLens, changes can be made to a design and reflected in real-time to collaboratively sculpt a new vehicle.

AR has been trusted at the very highest levels of manufacturing, too. Lockheed Martin utilised augmented reality in the creation of NASA’s Orion Spacecraft, overlaying information to help with mission-critical procedures such as precisely aligning fasteners.

Nasa Orion HoloLens

Energy

In the energy sector, AR has the potential to remedy significant problems faced by the industry, chief of which is a brain drain caused by an ageing workforce. Indeed, the US Department of Labor estimated in 2019 that 50% of the current energy utility workforce will retire within the next ten years. The institutional knowledge being lost could be replenished more quickly with the help of AR technology.

Shell is duly using the remote collaboration possibilities of AR to educate workers in the field. Expert consultants are able to see through a worker’s eyes via an AR headset, and even draw on the screen of the augmented reality display they are using. That increases safety as workers interact with potentially dangerous heavy oil and gas equipment, as well as allowing experienced but ageing employees the ability to work remotely.

Shell AR
Image credit: Shell

The energy sector is no slouch when it comes to more specific AR solutions either, such as Upskills’s Skylight platform which allows companies to more easily develop bespoke augmented reality apps for use with AR devices, ranging from Google Glass to Microsoft HoloLens 2 and mobile devices. Then there are solutions such as Adroit, which can provide guidance on repairing high-stakes equipment such as oil rigs by scanning and identifying faulty components and machinery.

Final Thoughts

In heavy industry, where the costs of prototyping are enormous and the potential risks from machinery are significant, leaning on the virtual possibilities of augmented reality is common sense – hence the interest in the technology from across the sector.

To find out more about how AR is progressing in other fields, read the previous entry in the series, where we explored the healthcare industry in particular.

Shell Collaborates With EON Reality to Employ AR & VR Solutions Globally

More and more global companies are finding innovative use cases for deploying virtual reality (VR) and augmented reality (AR) based solutions across their infrastructure. Royal Dutch Shell plc – best known for its oil and gas exploration and production businesses – has announced that its Digital Realities team will work with EON Reality to create a global immersive training programme.

EON Reality - Virtual Trainer

EON Reality and Shell have actually been working together for several months now, testing out an aircraft refuelling training programme. This helped Shell test Virtual Trainer, part of the EON Reality connected learning AVR platform.

The whole purpose is that Shell plans to target key uses cases where Virtual Trainer provides an efficient solution that can be scaled, rather than used in only a single facility.

“Shell is on a digital transformation journey. ARVR is a key linking technology in that helps us visualise data and environments and make them tangible for our operational staff,” said Michael Kaldenbach, who leads the deployment of Digital Realities at Shell in a statement. “Liquid intelligence is what the next generation excels at, we want to use their skillsets at Shell, so we have designed a learning portfolio that fits their way of learning, not vice versa”.

Shell - EON Reality

“Shell are not alone in the desire to match learning strategy with multiple VR and AR training applications that is scalable. As VR and AR goes mainstream in enterprise companies like Shell, the connected platform solution is needed to move beyond silos of departmental activity and support systematic delivery of targeted applications, which have been selected to tackle real business issues,“ said Eamonn Watson, Business Development Director at EON Reality’s European Headquarters in Manchester.

Through Shell and EON Realities partnership the immersive training in VR can be made available on demand, via Virtual Trainer lessons and can negate the costs of production or operational shutdown for training and offer global, preparatory training for high risk, HSSE emergencies.

Check out the video below which showcases some of the use cases the pair are working on. And for further updates, keep reading VRFocus.

VR Used For Aircraft Refuelling Training

The use of virtual reality (VR) simulations for training pilots and aircraft mechanics is slowly coming to be accepted in academic institutions and in companies. The success of the VR approach is seeing an increasing number of areas where VR is being applied, such as training for the complex procedure of refuelling a plane.

The refuelling process for an aircraft is very complicated, and can be dangerous. Jet fuel is extremely combustible, so careful attention must be paid to things such the possibility of static discharge. In addition, the operating conditions required for ground crew working on the aircraft are very demanding, as any kind of contamination of the fuel – even water can cause disastrous consequences such as a plane crash.

As a result, Shell’s Aviation Fuelling Division have been working together with EON Reality on the VR Filter Water Separator Trainer. This simulation is a proof of concept system that allows for advanced training in aviation refuelling. The strict standards required for aviation meant that Shell needed the VR simulation to be very accurate and capable of offering photorealistic training.

“We are really proud to have proven Virtual Trainer with Shell,” says Eamonn Watson, Director at EON Reality.“The Proof of Concept won full approval from Shell’s VR/AR incubator in the Netherlands, where it is now being demonstrated to global stakeholders across Shell, to show how Virtual Trainer can deliver a unique, connected enterprise platform for VR learning efficiencies across all global departments.”

The VR environment allows for a collaborative training set-up. The trainee enters the VR landscape and is guided through a lesson remotely by a live trainer, who can administer and monitor the training scenario from a laptop. It is hoped that by using VR training it will be possible to reduce operational downtime and accelerate learning of new employees. The system also allows for learning rates and trainee behaviours to be tracked so the training program can be tailored to address any deficiencies.

It has t yet been disclosed what VR platform the system uses, though EON Reality’s AVR Platform is compatible with most currently available VR headsets, including Samsung Gear VR, Oculus Rift and HTC Vive. VRFocus will be sure to bring you more information once it is available.

The VR Job Hub: Shell, Oculus, Microsoft & More…

Contrary to popular belief the grass is not always greener on the other side. Sometimes things are just better where you are, though you may not fully understand that there are advantages to your present role. Even in this situation however that doesn’t mean you should ignore the other side because there is always potential. Potential for you to advance, potential for you to be happier, potential for you to be a part of something bigger and better for you. One way or the other.

As always when it comes to Sundays on VRFocus we are here with a selection of various different roles in, around or otherwise connected to the world of immersive technology. We’ve picked a selection of different types of roles that went up over the last seven days from all over the world. Check out the list below to see if there’s something that sparks your interest.

Location Company Role Link
Glasgow. UK Soluis Group Software Developer Click here to apply
Singapore via JAC Recruitment Group Lead Designer – Virtual Reality Click here to apply
San Francisco, CA, US Aftershock (FoxNext) Senior DevOps Engineer Click here to apply
Redmond, WA, US Microsoft Studios Principal Software Engineer Lead Click here to apply
Redmond, WA, US Microsoft Studios Software Engineer II-Hololens Click here to apply
Pittsburgh, PA, US Oculus Research Intern, Modeling of Nonhuman Avatars (PhD University Student) Click here to apply
Redmond, WA, US  Oculus Technical Recruiter Click here to apply
 Denver, CO, US  SwarmSales, Inc. Sales Representative – AR/Virtual Reality for Sports/Media Click here to apply
 New York, NY, US  York & Chapel Healthcare Public Relations Specialist – Freelance Click here to apply
 London, UK Sony Interactive Entertainment Europe Ltd Principal Environment Artist Click here to apply
 Los Angeles, CA, US  Wisdom Info Ltd Director/ VP of Sales and Marketing Click here to apply
 Houston, TX, US  Shell  IT Project Manager (Android, IOS, VR, AR, HardWare) Click here to apply
 Taipei City, Taiwan  Next Animation Studio Senior Unreal Engine Engineer Click here to apply

 

For further roles don’t forget to check out last week’s edition of The VR Job Hub for further job listings. With last week’s selection focused primarily around the West Coast of America. Don’t forget that if you are an employer looking for someone to fill a VR or AR related role regardless of the industry and you want that position to be featured on next week’s VR Job Hub, please send details to myself via keva@vrfocus.com and pgraham@vrfocus.com.

Check back with VRFocus next Sunday at 3PM BST and every Sunday for the latest roles in the VR industry.