Innovations in AR: Heavy Industry

Augmented reality (AR) is a key pillar of Industry 4.0 (or the fourth industrial revolution), side-by-side with other potentially transformative technologies like machine learning and big data. Indeed, consultancy firm PwC has estimated that industrial manufacturing and design is one of the biggest areas for augmented and virtual reality (VR), with their use in heavy industry having the potential to deliver a $360bn GDP boost by 2030.

In this latest edition of our series on how augmented reality is faring across a range of industries, we’ll be taking a closer look at why AR is proving so useful in heavy industry, in particular the fields of construction, manufacturing and energy.

Construction

AR is proving to be a key tool for the construction industry, whether in the design stage or actually in the construction process itself, leading a 2020 study of the architecture, engineering, and construction (AEC) industry to say that AR and VR would see “strong growth” in the next 5 to 10 years.

On the design side, numerous architectural tools exist to help with space visualisation using augmented reality. One such example is The Wild, which allows designers to view 3D models in both virtual and augmented reality. Such tools can layer virtual details onto a building plan so that plans can be more readily understood by stakeholders. 

That requires highly detailed and accurate 3D models, which is where the technology overlaps with digital twin technology. Using those digital twins, companies like Akular can enable clients to see what a building would look like on-site in the real world before it is built via a mobile application.

When it comes to actual construction, augmented reality again finds a number of uses, not least training workers on safety. That might involve AR headsets that interact with tags on potentially dangerous areas to bring up safety information, but even before workers are on-site, AR can help with training them on how to use heavy machinery – as with the construction equipment training simulators offered by CM Labs or the Arvizio AR Instructor.

Arvizio AR Instructor

“Industries are experiencing a shortage of skilled front-line employees and view augmented reality as a means to accelerate training and efficiently transfer the expertise of experienced workers,” said Jonathan Reeves, CEO of Arvizio. “Arvizio enables organizations to rapidly upskill employees without the need for on-site coaching and mentoring. By delivering no-code authored augmented reality instruction and remote expert connectivity, AR Instructor can substantially increase productivity and reduce errors of workers performing complex operational activities.”

Meanwhile, progress capture and tracking functionality directly compares real-world sites with virtual models to ensure they aren’t deviating – all in real-time. A host of companies provide variations on that technology such as VisualLive, which enables users to witness 3D models in real life via headsets such as the Microsoft HoloLens or mobile devices.

Manufacturing

Much of the technology we’ve covered for construction can equally apply to the manufacturing industry, whether that’s learning how to use dangerous equipment or visualising the layout of equipment and machinery in a factory. None of this is to say there aren’t plenty of bespoke uses for augmented reality in the manufacturing space, however.

One early pioneer was Volkswagen, which was using augmented reality to assist service workers way back in 2013. The MARTA app showed step-by-step instructions on how to repair and replace certain components, overlaying its advice on the car via an iPad app. Along similar lines is Boeing’s more recent use of augmented reality to give technicians real-time, hands-free, interactive 3D wiring diagrams. 

Interestingly, that technology has bled over into the consumer space with AR manuals that assist car-owners with basic maintenance operations by showing precisely where components are located within a car.

In the design space, AR has been deployed by the largest manufacturers to rapidly iterate and do away with expensive and time-consuming physical prototypes. In the case of Ford and its partnership with HoloLens, changes can be made to a design and reflected in real-time to collaboratively sculpt a new vehicle.

AR has been trusted at the very highest levels of manufacturing, too. Lockheed Martin utilised augmented reality in the creation of NASA’s Orion Spacecraft, overlaying information to help with mission-critical procedures such as precisely aligning fasteners.

Nasa Orion HoloLens

Energy

In the energy sector, AR has the potential to remedy significant problems faced by the industry, chief of which is a brain drain caused by an ageing workforce. Indeed, the US Department of Labor estimated in 2019 that 50% of the current energy utility workforce will retire within the next ten years. The institutional knowledge being lost could be replenished more quickly with the help of AR technology.

Shell is duly using the remote collaboration possibilities of AR to educate workers in the field. Expert consultants are able to see through a worker’s eyes via an AR headset, and even draw on the screen of the augmented reality display they are using. That increases safety as workers interact with potentially dangerous heavy oil and gas equipment, as well as allowing experienced but ageing employees the ability to work remotely.

Shell AR
Image credit: Shell

The energy sector is no slouch when it comes to more specific AR solutions either, such as Upskills’s Skylight platform which allows companies to more easily develop bespoke augmented reality apps for use with AR devices, ranging from Google Glass to Microsoft HoloLens 2 and mobile devices. Then there are solutions such as Adroit, which can provide guidance on repairing high-stakes equipment such as oil rigs by scanning and identifying faulty components and machinery.

Final Thoughts

In heavy industry, where the costs of prototyping are enormous and the potential risks from machinery are significant, leaning on the virtual possibilities of augmented reality is common sense – hence the interest in the technology from across the sector.

To find out more about how AR is progressing in other fields, read the previous entry in the series, where we explored the healthcare industry in particular.

Top 8 Uses for Augmented Reality

Augmented reality (AR) is a technology with a dizzying range of potential applications. And as new and more powerful AR hardware enters the market (such as Apple’s mooted glasses), we’re likely to see even more uses for AR. 

That’s not to say that AR, as it exists today, is any slouch, and to prove it we’re looking at eight of the best uses for augmented reality.

Virtual try-ons

The retail industry has been one of the most prominent embracers of AR technology over at least the past decade. Most of the industry’s biggest brands offer some form of the technology, which allows prospective buyers to see how a product would look on them without needing to physically try it on, usually utilising the ubiquitous phone camera to display the virtual elements in real-time.

Prominent virtual try-on examples include make-up from Maybelline, clothing from ASOS and Zeekit, and shoes from Vyking.

Vyking AR Shoes
Image Credit: Vyking

Gaming

Augmented Reality has found a natural home in the gaming industry, where it has powered some huge mobile game successes including Pokemon Go and Pikmin Bloom, both from developer Niantic.

Pokemon Go in particular was a smash hit, peaking at over 250 million players per month on the back of an experience that transported the gameplay of the popular Pokemon video game series to real-world locations. That built on work the developer had done in its previous game Ingress, which allowed players to use their mobile phones to interact with virtual portals appearing in real-world locations as part of its science fiction story.

Construction

AR is a key tool in the construction industry, from the design stage right through to the actual building process. For architecture, numerous tools exist to aid in the visualisation of spaces, such as The Wild, which allows designers to view 3D models in both virtual and augmented reality.

On the building side of the equation, AR has uses ranging from training workers on safety to progress capture and tracking functionality that directly compares real-world sites with virtual models in real-time to ensure they aren’t deviating.

VisualLive
Image credit: VisualLive

Surgery

The high-stakes field of surgery is being revolutionised by augmented reality technology which can overlay vital information onto a surgeon’s field of view as they work. Mixed reality headsets such as the Microsoft HoloLens 2 allow surgeons to operate on patients more effectively, blending the real world with projections of computed Tomography (CT), and Magnetic Resonance Imaging (MRI) scans of the patients.

Holographic representations of the area being operated on can also be observed in 3D before surgery takes place to ensure a surgeon has full familiarity of the area they are working on. To find out more about the role of AR in healthcare, read our article on the subject.

The tricky business of finding your way around busy spaces has been much improved with the help of AR, such as the Live View feature offered by Google Maps, which takes existing data from the map app and overlays it on the camera’s view of the real world with help from your phone’s GPS capabilities.

Individual locations have also explored using augmented reality to help guide visitors, such as Gatwick Airport, which installed navigational beacons that guide a passenger’s way back in 2018 – all accessed via a smartphone app.

Google Maps AR / Google Lens
Image credit: Google

Education

From a school setting to on-the-job training, AR can be used to help learners safely interact with materials they would otherwise not be able to gain access to, all while remaining in a familiar setting. Google debuted augmented reality search during the COVID-19 pandemic to help people learn by placing virtual objects such as spacesuits and animals into real-world locations. A host of apps exist to bring similar objects into a classroom setting, including the Merge Cube, which adds tactility to the experience.

Energy giants such as Shell, meanwhile, are using AR to educate workers in the field by bringing in experts who can see through a worker’s eyes and even draw on the screen of the augmented reality display they are using, boosting safety as they interact with potentially dangerous heavy oil and gas equipment.

Design

Designers at all levels are making use of AR to preview how a space will look before any changes are made physically, from those designing individual rooms all the way up to those planning cities.
Non-professionals too can make use of augmented reality to aid in their designs. Just one example is furniture store IKEA’s IKEA Place app which allows users to place 3D models of the company’s goods into their own rooms in order to preview how they would look, automatically scaling them based on the room’s dimensions to ensure they are true to life.

IKEA PLACE AR app
IKEA Place AR app. Image credit: Ikea

Manufacturing

AR is one of the key pillars underpinning the phenomenon of Industry 4.0, alongside such technologies as machine learning and big data. Consultants PwC has estimated that industrial manufacturing and design is one of the biggest potential areas for augmented and virtual reality, with their use in the industry having the potential to deliver a $360bn GDP boost by 2030.
As a result, examples of the technology in action for manufacturing are easy to come by. One example is Boeing’s use of augmented reality to give technicians real-time, hands-free, interactive 3D wiring diagrams. Lockheed Martin also utilised augmented reality in the creation of NASA’s Orion Spacecraft, overlaying information to help with mission-critical procedures such as precisely aligning fasteners.

Boeing Is Using Varjo Headsets To Train Astronauts For Its Starliner Spacecraft

US aerospace giant Boeing will use Varjo’s VR-2 advanced mixed reality headset to train astronauts for its Starliner spacecraft.

NASA has used virtual reality for training for decades, but the low resolution limited the range of tasks that could be simulated. Boeing says this is the first end-to-end VR astronaut training system.

Starliner, currently in the uncrewed testing phase, is Boeing’s upcoming reusable crew capsule. It will be used for the same NASA program as SpaceX’s Dragon 2, which in late May launched astronauts for the first time. Essentially, the task once handled by the Space Shuttle (ferrying crew to the International Space Station) will now be taken by these two private companies.

Varjo is a Finnish company which sells ultra high end VR headsets, some with powerful mixed reality capabilities. The unique “bionic” display system projects a smaller but higher resolution image in the center of the lenses. Within this central area, Varjo claims “human eye” resolution.

That comes at a cost though- the VR-2 is priced at $4995. Companies like Facebook and Sony design hardware for a consumer market, but Varjo doesn’t have this restriction.

The astronaut training system can be used for an entire mission, from pre-launch to docking with the international space station, and the full journey back to earth.

The system’s development was lead by Boeing’s Connie Miller. Engineers in Australia recreated the Starliner in Unreal Engine, and this was then integrated in the Houston training center. Miller saw Varjo’s headsets as a breakthrough thanks to the resolution, which allows even the smallest controls to be read clearly.

Using VR also has the advantage of allowing training to continue in pre-launch quarantine, which was not possible with traditional systems.

Starliner includes one seat for potential space tourism. Boeing hasn’t announced concrete plans to commercialise this, but the Varjo based training system has the potential to make training tourists much easier than before.

Boeing hopes the VR system can be brought aboard Starliner itself when it launches in 2021, allowing for in-orbit training of advanced scenarios. In 2017 an Oculus Rift was sent to the International Space Station, but Varjo’s resolution enables completely new use cases.

The post Boeing Is Using Varjo Headsets To Train Astronauts For Its Starliner Spacecraft appeared first on UploadVR.

Boeing is Using Varjo Headsets to Train Astronauts for an ISS Docking Mission in 2021

Varjo announced today that Boeing is spinning up a VR training program for its upcoming Starliner mission to the International Space Station in 2021. The company says that its retinal resolution headset enables virtual training scenarios—like docking to the ISS—that weren’t feasible before.

Varjo is the creator of high-end enterprise VR headsets, and the only headset in its class that offers “retina resolution,” meaning that it can resolve detail to the limit of human vision. The headsets accomplish this by using two displays per-eye: one for high detail at the center of the image, and another for an immersive field of view.

The company announced today that Boeing is using Varjo headsets for a new VR training simulations that will prepare astronauts for upcoming missions, including the company’s first crewed mission aboard its Starliner spacecraft which is set to launch and dock with the International Space Station in 2021.

This would be far from the first time that an aerospace company is using virtual reality for training. NASA was experimenting with its own VR headsets at least as far back as 1985, and has been using modern VR tech too, while HoloLens and Rift took their first trip to the ISS back in 2016.

SEE ALSO
HapTech is Aiming its Electromagnetic Haptics at Military VR Training

Boeing had been exploring VR hardware and software since 2017, but found that the limited resolution of headsets made many types of training impractical. Varjo says that its unique advantage—retina resolution—is allowing Boeing to create virtual training scenarios for situations that wouldn’t be feasible with lower resolution headsets, like the ISS docking procedure.

The key, Varjo says, is that astronauts can read instruments, displays, and buttons at a regular viewing distance with its headsets. This makes training scenarios inside the cockpit more practical.

While physical simulators are extensively used for aerospace training, virtualizing expensive physical systems—like complete cockpit replicas—not only stands to save time and money, but also allows astronauts to the training remotely as long as they have access to a headset (handy when you’re in a pandemic situation). Virtual reality training also enables more realistic training of emergency scenarios which would be impractical to recreate in a physical simulator.

Varjo says that the Starliner crew will clock hundreds of hours in Boeing’s virtual reality training program to learn procedures like launching, docking, re-entry, and landing phases ahead of the actual flight to the ISS in 2021.

The post Boeing is Using Varjo Headsets to Train Astronauts for an ISS Docking Mission in 2021 appeared first on Road to VR.

Air Canada Offers Virtual Flight on A Dreamliner

An increasing number of airlines and holiday retailers are turning to virtual reality (VR) to engage with customers and attempt to entice them into paying money for their products. Joining airlines such as KLM who are offering ‘virtual upgrades’ to passengers of other airlines, Air Canada are offering potential customers a virtual trip aboard the Boeing 787 Dreamliner.

The Boeing 787 Dreamliner is one of the world’s biggest commercial passenger aircraft. Designed mostly for long-haul flights, it is one of the most technologically advanced aircraft to travel the skies. Using the VR experience offered by Air Canada, potential customers can experience an interactive trip aboard the Dreamliner in International Business Class, seeing what food, drink and other services are on offer for travellers who travel in one of Air Canada’s ‘executive pods’.

“Air Canada is always developing new ways to enhance the customer experience and to engage partners such as the travel agent community, which plays a key role in helping our customers select the travel options best suited to them. Virtual reality enables us to familiarize thousands of travel agents and potential customers with Air Canada’s offerings through the magic of an interactive, virtual tour,” said Duncan Bureau, Vice President, Global Sales at Air Canada. “We have already seen an increase in bookings since we began using this technology.”

After donning the headset and taking hold of the controls, users begin the virtual journey with an overview of Air Canada’s global routes, followed by an exploration of Air Canada’s livery. Users are then guided through all three cabins, Economy, Premium Economy or International Business. Various items such as in-flight magazines, in-flight entertainment or even tray tables are all available for user’s to peruse and interact with.

The Air Canada VR experience will be available at the following events:

  • Air Canada Pop-Up Poutinerie, Shoreditch, London (UK), until November 11, 2017.
  • True Patriot Love Gala, Toronto, November 9, 2017;
  • BAZAR ED, Santiago, Chile. November 22 to 26, 2017;
  • WX Top 100 Leadership Summit, Toronto, November 23, 2017;
  • EY Entrepreneur of the Year National Gala, The Ritz-Carlton, Toronto, November 30, 2017.

Further information and a sneak peek of the experience can be found on the Air Canada website.

VRFocus will continue to bring you news on new and upcoming VR content.

Boeing Invests in VR and 360-Degree Video Firm C360 Technologies

Boeing’s Horizon X program was launched back in May to provide funding to innovative and disruptive technologies. One of its first recipients was an augmented reality (AR) firm, and the company is seemly continuing with its interest in virtual reality (VR) and AR companies with the investment in C360 Technologies.

Pittsburgh-based C360 Technologies is focussed on broadcast-quality solutions for VR and 360-degree video experiences, and have worked with FOX Sports to provide online telecasts of various sporting events, such as the MLB All-Star Events and the 2017 Daytona 500.

“Our C360 investment is a powerful example of how HorizonX can access rapid advances in innovation outside aerospace and bring them to our Boeing customers,” said Steve Nordlund, Boeing HorizonX vice president. “Putting additional capital to work and linking C360’s innovators with our Boeing teams allows us to accelerate new solutions, while providing new market access for C360. It’s a win-win — especially for our customers.”

“Since the inception of our company, we’ve been fortunate to work with some of the best organizations in the world, integrating C360’s technology into sports telecasts viewed by international audiences,” said Evan Wimer, CEO of C360 Technologies. “It’s extremely gratifying that Boeing HorizonX has recognized our contributions within the sports broadcasting industry, and at the same time envisions how C360 could be utilized in future Boeing applications. We’re confident that Boeing’s investment into C360 will propel and inspire us to further advancements in the 360 VR/AR industry.”

Boeing are said to be looking as possible aerospace applications for C360 Technologies VR and 360-degree video platform, which may include improved autonomous systems and technical training.

VRFocus will continue to provide news on developments within the VR industry.

University of Strathclyde’s AFRC and AMRC Unveil the Construction Industries AR Future

Almost every enterprise sector has or is experimenting with augmented reality (AR) and virtual reality (VR) technology. And the construction industry is no different, looking to use immersive devices to aid training, learning, on site inspections and much more. Today the University of Strathclyde’s Advanced Forming Research Centre (AFRC) and the Advanced Manufacturing Research Centre with Boeing (AMRC) in Sheffield, have unveiled a demo that aims to help contractors to visualise projects from the earliest stages.

The two research centres worked with Glasgow-based design visualisation company Soluis Group and modular building designer and manufacturer Carbon Dynamic to create the prototype which uses Microsoft HoloLens to show a 3D rendering of the plumbing and wiring behind a plasterboard wall. The system can also be used to examine segments of the wall to ensure there are no insulation gaps before being sent to a construction site.

AFRC 3

Speaking about the project, David Grant, partnership development leader at the AFRC, said in a statement: “This new technology has a role to play before, during and after construction of both domestic and commercial properties.

“Prior to work commencing on site, those involved in a construction project will be able to accurately visualise and walk through a building before the foundations are even dug, this will help in identifying any potential issues before they occur. It could also help during a build as contractors will be able to accurately see what’s behind walls and under floors, potentially leading to improved health and safety on sites as all guess work could be eliminated.  Post construction it will help with remedial and retrofitting work – even years down the line – as all of the information relating to a building – from where electricity cables and pipe work are installed to the guarantees and instruction manuals for boilers, light fittings and showers will be accessible using this technology.”

“Projects like this can inspire hearts and minds in the construction sector to accelerate their adoption of new technologies – the potential for AR and VR in the industry is vast,” Grant continued. “Of course, this is just the first phase; demonstrating what could be achieved if the right platform was developed as a standard for the industry – the tools still need to be created.

“What we have done is prove that the technology works and, with the necessary skills, the right kind of software applications can be developed. While there are bespoke programmes already available, there isn’t a platform everyone can use to push and pull information from AR and VR devices. This is the first step forward in addressing that gap.”

While Chris Freeman, technical lead for augmented reality, at the AMRC with Boeing, added: “The AFRC was integral in laying the groundwork for the demonstrator, with thorough research and identifying the business drivers for introducing AR and VR capabilities. We’re hoping to do more in this area with our industrial partners, as more companies in the construction sector begin to realise the benefits these technologies can bring.”

This is still in its early stages but there are plenty of examples of VR and AR use being trialed. In March VRFocus reported on ProBility and GlobalSim launching a software library of virtual heavy equipment models for training. Or last year for example where Suffolk Construction had a VR simulator created for the traditional act of digging a shovel into the ground on a new building project.

For the latest use of VR and AR around the world, keep reading VRFocus.

New Boeing Innovation Group Provides Upskill Funding

Aerospace company Boeing have formed a new group called Boeing HorizonX, with aims of investing in companies that are working on innovative and disruptive technologies and business models than can change the face of the aerospace industry.

One of Boeing HorizonX’s first investments is in Upskill, a company that provide wearable augmented reality (AR) technology. Boeing have worked with Upskill for over two years to evaluate the potential of the technology, which Upskill claim can enhance productivity and safety in manufacturing.

“Our ability to identify, shape and harness game-changing innovations wherever they are developed is key to sustaining and growing our leadership in aerospace,” said Dennis Muilenburg, Boeing chairman, president and CEO. “Boeing HorizonX is tasked with ensuring we are fully engaged with opportunities from early-stage companies, market trends and emerging technologies while also fostering more rapid and effective internal innovation.”

 

Boeing is now one of Upskill’s largest customers and has deployed Upskill’s AR glasses and Skylight software platform in multiple locations. In one deployment area, there was 25% improvement in production time and product quality.

“Upskill was a priority investment for our newly formed Boeing HorizonX group, as it puts into action our desire to harness innovative technology to drive efficiency, reduce cost and improve quality in our manufacturing as well as clearly having broad application and growth potential across industries,” said Steve Nordlund, vice president for Boeing HorizonX. “We have first-hand experience on the value of Upskill’s Skylight platform and believe the company’s technology will sharpen and accelerate our pace of progress on key growth and productivity efforts, while we help evolve and enhance Skylight through real-world manufacturing applications.”

 

The formation of Boeing Horizon X falls in line with Boeing’s aims of investing in innovative technology and seeking new business opportunities and strategies.

VRFocus will continue to report on new applications and investments in AR and VR technology.

Visualise Unveils VR Experience for Norwegian Airlines & Boeing 787 Dreamliner

UK-based virtual reality (VR) production studio Visualise is prolific in its content output, collaborating with global brands and companies around the world. Its latest VR project has just been unveiled, a 5D experience for low-cost airline Norwegian Airlines and Boeing at Westfield Stratford City. 

Created to promote Norwegian’s low-cost direct flights to the US on the Boeing 787 Dreamliner, Visualise was tasked with producing an immersive two minute 360-degree video aboard the aircraft, transporting viewers into the cabin and showcasing the level of service provided from the cabin crew and specialist features of the 787 Dreamliner.

Visualise launches Norwegian 360 experience_1

Using VR head-mounted displays (HMDs), participants can experience the sounds and motion of a Norwegian Boeing 787 Dreamliner flight in the economy and Premium cabins, with the goal to entice potential holidaymakers to Norwegian’s low-cost transatlantic fares from £135

Henry Stuart, CO-Founder & CEO of Visualise comments: “This project was particularly interesting for us as we also created an app that allows for remote controlling of multiple Gear VR headsets for simultaneous video playback. This was necessary to ensure the activation at Westfield worked seamlessly and it’s great to utilise these skills as well as our traditional VR capabilities.”

Stine Steffensen Børke, VP Marketing at Norwegian said: “Norwegian has always been a trailblazer in technology with free Wi-Fi on all European flights and now we’re the first airline in the UK to offer a virtual reality USA holiday. As we continue to take off in the UK, we’re embarking upon the most eye-catching ways consumers can engage with our brand by demonstrating that low-cost can mean high quality in a truly fascinating way.”

The airline is also encouraging customers to use #USAtheNorwegianWay on social media to enter into a prize draw for the chance to win a holiday to any one of Norwegian’s eight USA destinations direct from London Gatwick.

If you want to checkout the 5D experience the pop-up is now open until 14th December 2016 every day from 10am – 7pm, except Sunday, which is open from 12pm until 6pm, and is located at The Gallery in Westfield Stratford City.

VRFocus will continue its coverage of Visualise, reporting back with any further announcements.