Top 8 Uses for Augmented Reality

Augmented reality (AR) is a technology with a dizzying range of potential applications. And as new and more powerful AR hardware enters the market (such as Apple’s mooted glasses), we’re likely to see even more uses for AR. 

That’s not to say that AR, as it exists today, is any slouch, and to prove it we’re looking at eight of the best uses for augmented reality.

Virtual try-ons

The retail industry has been one of the most prominent embracers of AR technology over at least the past decade. Most of the industry’s biggest brands offer some form of the technology, which allows prospective buyers to see how a product would look on them without needing to physically try it on, usually utilising the ubiquitous phone camera to display the virtual elements in real-time.

Prominent virtual try-on examples include make-up from Maybelline, clothing from ASOS and Zeekit, and shoes from Vyking.

Vyking AR Shoes
Image Credit: Vyking

Gaming

Augmented Reality has found a natural home in the gaming industry, where it has powered some huge mobile game successes including Pokemon Go and Pikmin Bloom, both from developer Niantic.

Pokemon Go in particular was a smash hit, peaking at over 250 million players per month on the back of an experience that transported the gameplay of the popular Pokemon video game series to real-world locations. That built on work the developer had done in its previous game Ingress, which allowed players to use their mobile phones to interact with virtual portals appearing in real-world locations as part of its science fiction story.

Construction

AR is a key tool in the construction industry, from the design stage right through to the actual building process. For architecture, numerous tools exist to aid in the visualisation of spaces, such as The Wild, which allows designers to view 3D models in both virtual and augmented reality.

On the building side of the equation, AR has uses ranging from training workers on safety to progress capture and tracking functionality that directly compares real-world sites with virtual models in real-time to ensure they aren’t deviating.

VisualLive
Image credit: VisualLive

Surgery

The high-stakes field of surgery is being revolutionised by augmented reality technology which can overlay vital information onto a surgeon’s field of view as they work. Mixed reality headsets such as the Microsoft HoloLens 2 allow surgeons to operate on patients more effectively, blending the real world with projections of computed Tomography (CT), and Magnetic Resonance Imaging (MRI) scans of the patients.

Holographic representations of the area being operated on can also be observed in 3D before surgery takes place to ensure a surgeon has full familiarity of the area they are working on. To find out more about the role of AR in healthcare, read our article on the subject.

The tricky business of finding your way around busy spaces has been much improved with the help of AR, such as the Live View feature offered by Google Maps, which takes existing data from the map app and overlays it on the camera’s view of the real world with help from your phone’s GPS capabilities.

Individual locations have also explored using augmented reality to help guide visitors, such as Gatwick Airport, which installed navigational beacons that guide a passenger’s way back in 2018 – all accessed via a smartphone app.

Google Maps AR / Google Lens
Image credit: Google

Education

From a school setting to on-the-job training, AR can be used to help learners safely interact with materials they would otherwise not be able to gain access to, all while remaining in a familiar setting. Google debuted augmented reality search during the COVID-19 pandemic to help people learn by placing virtual objects such as spacesuits and animals into real-world locations. A host of apps exist to bring similar objects into a classroom setting, including the Merge Cube, which adds tactility to the experience.

Energy giants such as Shell, meanwhile, are using AR to educate workers in the field by bringing in experts who can see through a worker’s eyes and even draw on the screen of the augmented reality display they are using, boosting safety as they interact with potentially dangerous heavy oil and gas equipment.

Design

Designers at all levels are making use of AR to preview how a space will look before any changes are made physically, from those designing individual rooms all the way up to those planning cities.
Non-professionals too can make use of augmented reality to aid in their designs. Just one example is furniture store IKEA’s IKEA Place app which allows users to place 3D models of the company’s goods into their own rooms in order to preview how they would look, automatically scaling them based on the room’s dimensions to ensure they are true to life.

IKEA PLACE AR app
IKEA Place AR app. Image credit: Ikea

Manufacturing

AR is one of the key pillars underpinning the phenomenon of Industry 4.0, alongside such technologies as machine learning and big data. Consultants PwC has estimated that industrial manufacturing and design is one of the biggest potential areas for augmented and virtual reality, with their use in the industry having the potential to deliver a $360bn GDP boost by 2030.
As a result, examples of the technology in action for manufacturing are easy to come by. One example is Boeing’s use of augmented reality to give technicians real-time, hands-free, interactive 3D wiring diagrams. Lockheed Martin also utilised augmented reality in the creation of NASA’s Orion Spacecraft, overlaying information to help with mission-critical procedures such as precisely aligning fasteners.

2021 in Review: Games, Experiences and Technology

2021 was a stand out year for XR. Both virtual reality (VR) and augmented reality (AR) saw some technological leaps, some great videogames and a glimpse of the future. Both technologies are shaking up several industries while laying the foundations for the metaverse. To celebrate the year, we’ve chosen some of our highlights as we look forward to what 2022 might bring.

After the Fall

Probably the biggest VR launch of 2021, After the Fall brings zombie-slaying back and makes it more fun than ever. With co-op modes, cross-platform play and constant action, it’s a title that feels perfectly at home in VR. The game is gorgeous – aside from the grisly zombies – and playing on high-end hardware ensures a smooth experience. The intuitive controls allow for a great experience, and while there are some minor flaws, After the Fall is set to be one of the biggest and best VR games in recent years.

After the Fall

Resident Evil 4

The best Resident Evil game finally has a VR option! Armature brought everything that made the game such a standout success and revolutionised it with plenty of accessible VR additions. We loved the new interactive features; cocking and reloading the weapons, the malleable storage system, pulling grenade pins, all of these bring the action to life like never before. While it’s not the prettiest game, thanks to the browns and beiges of the original game, it’s still a great spectacle to behold.

Ragnarock

VR often brings out the best in rhythm games, mostly due to the accelerometers embedded in the controllers. It gives a sense of interactivity that button presses can’t achieve. In Ragnarock, thumping away on the drums feels invigorating and refreshing. It helps that this Viking environment is backed by a soundtrack of rock and metal. Energising your boat of rowers, you bash out rhythms and melodies on small drums in the hopes of scoring well. Even when you don’t, it doesn’t feel like a chore replaying songs, because who doesn’t love bashing drums and creating a foot-tapping moment of bliss?

Ragnarock

Pikmin Bloom

Niantic Labs’ games always want us to go outside. They’re urging us to put down the mouse or controller and interact with life outside our four walls. Pikmin Bloom is its latest attempt to get us exercising and interacting with the natural world. It’s more about walking than Pokemon Go, as there’s very little need to stand around. Players must find seeds that hatch into cute Pikmin then nurture the relationship by walking, with the app counting steps. It’s a very sedate experience, it’s one that teams up with the nature around us offering a peaceful escape from our world.

The Climb 2

If there’s a better looking videogame in VR, we haven’t seen it. And we’ve played a lot of games! The Climb 2 is a stunning view, whether climbing snow-capped mountains or high rise skyscrapers. Stopping every few minutes to appreciate the scenery is a joy, and that’s no surprise given the game is running on the Crytek CryEngine. Perhaps better than the view is the feeling of adrenaline when climbing, leaping and saving yourself from a deathly fall. The game gives a light workout to your arms, but it’s entirely welcome. The dynamic objects which could spell disaster at any second keep your heart in your mouth and your fingertips gripping on for dear life. The Climb 2 sounds sedate on paper, but in (virtual) reality it’s a nerve-shredding experience!

The Climb 2

VR/AR Concerts

Sadly, in 2021 the global COVID-19 pandemic is still a thing. This means that artists, musicians and film studios are looking for new ways to interact with fans. VR and AR experiences are a booming business and a guaranteed path to extra revenue in a world where concerts are being cancelled or moved from date to date. Through VR apps like Oculus Venues and MelodyVR, you can still attend the gigs of your favourite stars. Megastars Billie Eilish, Lewis Capaldi and Khalid are leading the way, and the adoption of low-cost headsets will make these experiences even more common in a post-pandemic world.

Wizards Unite is Closing

Sometimes you can have too many eggs in a basket. Niantic Labs has seen massive success with their headline game Pokemon Go and their latest release, Pikmin Bloom. This has perhaps overshadowed Harry Potter Wizards Unite; it certainly didn’t help that players didn’t shift from pocket monsters to waving magic wands. Wizards Unite just wasn’t sustaining itself, making $39.4 million in lifetime revenue compared to the $1.1 billion from Pokemon Go in 2021 alone. Sometimes a smash hit brand just isn’t enough.

Harry Potter: Wizards Unite teaser

Haptic Feedback

As VR technology evolves, so too does the need and want for more haptic feedback. We’re beyond rumbling controllers and racing seats that thud and jerk along with a game. Companies like HaptX, Meta and Tesla are all investing heavily into technology that will encompass our entire bodies; gloves that mimic the pressure and weight of physical objects when in a digital world; bodysuits which can react to impacts or environmental changes in a metaverse space. Each of these companies showcased their tech in 2021 to the astonishment of pretty much everyone, for better or for worse.

Facebook rebrand

If you somehow missed Facebook rebranding to Meta, you must have been living under a rock! Mark Zuckerberg shook up the tech world by announcing his company Facebook would now be known as Meta. Why? Because he envisions the future of the internet as the metaverse, a term first coined in the novel Snow Crash by Neal Stephenson. This future, according to Zuckerberg, will be an extension of our physical selves into the digital landscape of web 3.0, through VR and AR technology. Meta wants to help usher in this technological revolution using its power, influence and money to research and launch new hardware and software which will take us into the next evolution of the internet. 

Meta - Zuckerberg

Metaverse

The metaverse is here! Well, kind of. The latter half of 2021 has been awash with talk around a metaverse. What was once a concept that few people acknowledged has now become a buzzword that even your grandmother knows (Thanks Facebook… oh, Meta). Whatever your thoughts on the metaverse, it’s coming up fast. In fact, to some, it’s already here. If you’re playing Fortnite or Roblox then you’re already on the first rung of the ladder, and projects such as Somnium Space, Decentraland and The Sandbox are waiting for you to jump in. This ownership driven, decentralised digital space is an important change to the way we use the internet. Are you ready?

Unreal Engine 5

2021 finally saw the release of Epic Games’ Unreal Engine 5, bringing a dearth of powerful development tools to the industry. With so many developers utilising Unreal Engine to create their projects, this new iteration gives us a glimpse of what’s to come over the next decade. Launching with an interactive ‘“experience” collaborating with The Matrix Awakens, players and creators have seen the potential and it’s revolutionary. The level of detail and fidelity UE5 will bring is likely to change the landscape of games, from battle royales to VR puzzlers.

Unreal Engine 5

Sony’s 8K headset

As reported by our very own Peter Graham, Sony unveiled a prototype VR headset with not only 8K visuals (4K per eye) but also ultra-low latency. This bodes well for the company’s future, given they are soon releasing an upgraded VR headset for the PlayStation brand. Will we see this fidelity over there? It’s unlikely, but the new technology could make waves in industrial and medical avenues. This jump in technology bodes well for the future of Virtual Reality.

Niantic Lightship

If you’re an AR developer, then 2021 was a good year. Niantic Labs, the company behind pretty much every hugely successful AR mobile game, released their ARDK tools for developers to use. What does this mean? Well, it means that the software they use for their titles, including mesh mapping and semantic wrapping, two features that track and map the world seen through a smartphone camera, as well as their multiplayer API, can be utilised by any development team. This sharing of technologies can only benefit the AR community as a whole and further achieve great things in the world of AR.

Niantic Lightship

AR/VR in medicine

Many see Augmented and Virtual Reality as something built for games and experiences. Contrary to that view, both AR and VR are breaking down barriers in the world of medicine. Therapists are using VR to virtually visit their clients or help PTSD sufferers acclimate to the world. AR helped frontline workers learn how to care for those ill with COVID, using phone apps to triage patients when needed. Back in the virtual world, surgeons are completing spinal surgeries and trainee medical students are learning how to intubate patients using the technology rather than plastic dummies.

Digital Influencers

In 2021, the world of influencers got a bit more digital and a bit more creative. Since the advent of social media, influencers have become ubiquitous with the software – a selection of people touting products for corporations. However, with graphical software innovations, virtual and augmented reality, plus motion capture, we can now find digital avatars living the influencer life. Though right now, they aren’t trying to sell us anything, except maybe their art. CB from Casas Bahias, CodeMiko and Blu are amazing CGI avatars living digital lives, creating comedy, drama or interactive experiences. 

Top Ten AR Videogames

AR Game Montage

Augmented reality (AR) is one of the more interesting technologies our smartphones can handle with ease. At first, it felt like a bit of a gimmick, but in the right hands, it can add a lot to gaming. Whether you prefer to stay home and solve puzzles, or roam the area battling or catching creatures, there’s something out there for you. VRFocus has put together a list of some of the best AR infused videogames you can play right now.

Pokemon Go Trainer Battles

Pokemon Go!

It wouldn’t be an AR list without Pokemon Go!, would it? The game that got everyone outside in the summer of 2016 has been using AR technology since the outset. What started with Pokemon placed within the world you inhabited, has become a robust system with avatars that interact while your physical self stands around tapping the screen in a gym or raid battle. AR features are integral to Pokemon Go!, particularly the map view which tracks not only yourself but the gyms, pokemon and pokestops along the route; using photos and location services along with the accelerometer to interact with the fantastical world Niantic Labs have created.

The Birdcage

The Birdcage, and its sequel, are beautiful puzzle games that place the central puzzle within your home space. Aiming the camera, you can place the titular birdcage in the centre of a room. The task is to open the enclosure and free the bird by solving puzzles attached to the cage. Utilising your phone’s camera, the perspective can be changed by moving closer or further, and even around the cage. There are lots of switches to flick, dials to turn and word puzzles to move through the steps. The Birdcage looks and sounds gorgeous and is perfectly taxing on the brain; think The Room but in your room.

Angry Birds AR: Isle of Pigs

Angry Birds had its time in the sun quite some time ago, but recent entries have tried to implement the winning formula onto new technologies. Dabbling in VR (where applicable) and this AR entry, the mechanics feel fresh again. Angry Birds AR: Isle of Pigs opens and asks you to place the traditional looking level on a nearby table (or on the floor). Everything is recognisable – towers and buildings made from blocks with chubby pigs standing by. On your phone, you’ll have a direct view of a catapult, into which the familiar birds jump and can be fired at the puzzle. Watching the blocks and pigs tumble about is joyous and it fits within the AR space ideally. A great game for everyone, but kids will love it!

Angry Birds AR Structure Destroyed

Draw a Stickman: AR

There’s something wonderful about drawing an object on your phone and watching it come to life. With Draw a Stickman: AR, that’s the first step. Your stickman can be as simple or lavish as you want. Once they’re created, an RPG style world is displayed on the floor or surface of your table and you can tap where your stickman needs to go. What comes next is a simple RPG, full of monsters and dungeon crawling… and more drawing! This adds a nice flair to the game, and watching everything pop up in a 3D space through your phone never gets old.

The Walking Dead: Our World

It’s been a few years since TWD: Our World was released and in that time, enthusiasm for zombies has waned a little. Don’t let that stop you from trying this AR gem, though. If one of your daydreams has been how you would deal with a zombie outbreak, now is your chance to live that out. There are walkers roaming your neighbourhood – with maps from Google – and they need to be put down. With legends from the TV show to recruit, you can search out stashes of items and weapons ready to fight it out with the shambling terrors. There are plenty of missions to take on, including saving survivors and holding off rival NPCs, so there’s a lot of variety in this apocalyptic world.

Five Night’s at Freddy’s AR: Special Delivery

The tenth overall instalment in the Five Nights at Freddy’s franchise, it’s time to be scared again. Well, only if creepy, broken, furry robots are your nightmare fuel. There are still puzzles to solve and horrors to avoid, except this time the animatronics are in your home! Played in first-person perspective, the jump scares will get you every time. Thankfully combat is an option, and bashing the demonic beasts has never felt more satisfying. The videogame received a lot of content updates, so anyone jumping in now will have plenty to do.

Pikmin Bloom

Pikmin Bloom

Also from Niantic Labs, comes another Nintendo property in Pikmin Bloom. Some liken this title to a gamified fitness app, as there is no deep gameplay aspect like other AR games on this list. Pikmin Bloom encourages users to leave their homes, walk their local areas and this is reflected in collecting seeds along your route and hatching them into cute Pikmin. Features from the console counterpart have been implemented – like Oliver’s ship log, which is now a daily tracker with photos and captions – to create a richer world.

The Witcher: Monster Slayer

In summer 2021, a surprising AR game popped up on app stores. The Witcher: Monster Slayer is a remarkably enjoyable extension of the Witcher universe. Much like Pokemon Go! the player explores the local neighbourhood battling monsters within the AR world overlaid onto a scale map of your area. Here, instead of using cute creatures, your finger swipes are translated into sword swings and spells to destroy the horrific monsters plaguing the land. A great inclusion are story-driven quests which expand the lore within the games (and the books) and give you a good sense of progression, alongside earned XP and new items to unlock as wander the streets.

Ghostbusters Afterlife: ScARe

Released in conjunction with the latest Ghostbusters movie, this AR app is wonderful jumping on point for the Ghostbusters universe. Packed with puzzles, flying objects possessed by new and familiar ghosts which require ‘busting’ and lots of footage to guide the light story along. This is a great app for kids who can explore their home, or even a local park, while looking for ghosts. There’s something spectacular in swiping and moving the phone to control the stream of the proton pack and wrangle the spectral monsters and slam them into the trap.

Doors: Awakening

Much like The Birdcage above, Doors: Awakening uses your immediate space to position an object bursting with puzzles. In this instance, it’s a door. If you don’t feel like walking back and forth across your living room, you can place these doors on a table and spin them using swipes on the screen. Doors: Awakening has a spooky atmosphere delivered by luscious graphics which bring a real sense of otherworldly adventures to our world. The puzzles aren’t overly difficult, the main reason to play is the visual spectacle it brings to our world.

Niantic Launches Pikmin Bloom, Harry Potter: Wizards Unite To Shut Down

Over the last week or so, AR mobile game developer Niantic has opened one door and closed another – Pikmin Bloom is now available, but 2019’s Harry Potter: Wizards Unite will be shut down in 2022.

Back in March, Niantic announced it was working on a Pikmin mobile AR title in partnership with Nintendo. As of last week, Pikmin Bloom began rolling out to several countries — it’s now available in almost all major markets, including Europe, Asia Pacific, Africa, Middle East, the US, Canada.

Like many other mobile AR games, Pikmin Bloom follows the rough framework and precedent set by Pokemon Go, Niantic’s first and most successful mobile AR title. However, Bloom takes a slightly different approach to the concept — Bloom is more idle, focused more on simply walking around than actively visiting locations or searching for something. The more you walk, the more pikmin you’ll obtain.

Overall, the game seems to markets itself more as a glorified pedometer with a few game elements thrown in. There’s also minimal AR content compared to other Niantic titles. In fact, the only true use of mobile AR appears to be when you send Pikmin to fight mushrooms, which can be viewed as an AR overlay similar to catching Pokemon in Pokemon Go.

In the same week, Niantic also announced that it will be shutting down its 2019 mobile AR game, Harry Potter: Wizards Unite.

Wizards Unite, the studio’s first game to follow in Pokemon Go’s footsteps, announced that it will close on January 31, 2022 in a post on the game’s website. The game will be removed from store fronts even earlier, from December 6 2021.

We weren’t huge fans of Wizards Unite, but it’s just one game of many — Niantic has announced and released a few IP-focused mobile AR titles in the wake of Pokemon Go, but so far none have managed to catch on in the same way.

Let’s hope that changes with Transformers: Heavy Metal, the next Niantic AR game set to release sometime this year.

Pikmin Bloom Arrives to Brighten Up Any Walk

Pikmin Bloom

Niantic Labs’ videogames continually focus on getting players out and about and back in March the company announced a new project in conjunction with Nintendo based on its Pikmin franchise. Today, the pair have begun the global rollout of Pikmin Bloom, a colourful augmented reality-capable experience all about building up a squad of Pikmin simply by walking.

Pikmin Bloom

Offering a much more casual, combat free experience in comparison to Niantic Labs’ other AR titles, Pikmin Bloom is all about nurturing these tiny plant-like creatures which have appeared in several Nintendo videogames. To do this players need to walk, finding Pikmin seedlings along their path which can then be picked, adding to the Pikmin entourage. All the Pikmin will follow the player making flowers bloom on their journey.

When players take their daily stroll they’ll need to collect fruits along the way to feed their Pikmin, in turn making beautiful flowers bloom atop their heads. Their petals can then be collected and planted to create even more flowers with each step, unleashing a cascading effect of colour. That’s not the only interactive element, players will be able to utilise their red, yellow, blue and more Pikmin to remove giant mushrooms to gain more fruit.

As you may have realised, fitness is an integral part of the experience. Pikmin Bloom will have basic pedometer functionality, recording the number of steps players take as well as the routes they walked. Building upon that healthy lifestyle image they can add notes and photos to a lifelog, take pics with the Pikmin who can also bring back postcards of the places players have visited, shared with friends in the app. 

Pikmin Bloom

Whilst Pikmin Bloom is a free app Niantic Labs monetizing the title with in-game purchases, selling booster items to enhance the experience. There will also be monthly Community Day events.

Pikmin Bloom is available to download for iOS and Android devices on the App Store and Google Play respectively in Australia and Singapore, to begin with. Other regions will slowly be incorporated as Niantic Labs expands the launch. For continued updates on the latest AR projects, keep reading VRFocus.