Top 8 Uses for Augmented Reality

Augmented reality (AR) is a technology with a dizzying range of potential applications. And as new and more powerful AR hardware enters the market (such as Apple’s mooted glasses), we’re likely to see even more uses for AR. 

That’s not to say that AR, as it exists today, is any slouch, and to prove it we’re looking at eight of the best uses for augmented reality.

Virtual try-ons

The retail industry has been one of the most prominent embracers of AR technology over at least the past decade. Most of the industry’s biggest brands offer some form of the technology, which allows prospective buyers to see how a product would look on them without needing to physically try it on, usually utilising the ubiquitous phone camera to display the virtual elements in real-time.

Prominent virtual try-on examples include make-up from Maybelline, clothing from ASOS and Zeekit, and shoes from Vyking.

Vyking AR Shoes
Image Credit: Vyking

Gaming

Augmented Reality has found a natural home in the gaming industry, where it has powered some huge mobile game successes including Pokemon Go and Pikmin Bloom, both from developer Niantic.

Pokemon Go in particular was a smash hit, peaking at over 250 million players per month on the back of an experience that transported the gameplay of the popular Pokemon video game series to real-world locations. That built on work the developer had done in its previous game Ingress, which allowed players to use their mobile phones to interact with virtual portals appearing in real-world locations as part of its science fiction story.

Construction

AR is a key tool in the construction industry, from the design stage right through to the actual building process. For architecture, numerous tools exist to aid in the visualisation of spaces, such as The Wild, which allows designers to view 3D models in both virtual and augmented reality.

On the building side of the equation, AR has uses ranging from training workers on safety to progress capture and tracking functionality that directly compares real-world sites with virtual models in real-time to ensure they aren’t deviating.

VisualLive
Image credit: VisualLive

Surgery

The high-stakes field of surgery is being revolutionised by augmented reality technology which can overlay vital information onto a surgeon’s field of view as they work. Mixed reality headsets such as the Microsoft HoloLens 2 allow surgeons to operate on patients more effectively, blending the real world with projections of computed Tomography (CT), and Magnetic Resonance Imaging (MRI) scans of the patients.

Holographic representations of the area being operated on can also be observed in 3D before surgery takes place to ensure a surgeon has full familiarity of the area they are working on. To find out more about the role of AR in healthcare, read our article on the subject.

The tricky business of finding your way around busy spaces has been much improved with the help of AR, such as the Live View feature offered by Google Maps, which takes existing data from the map app and overlays it on the camera’s view of the real world with help from your phone’s GPS capabilities.

Individual locations have also explored using augmented reality to help guide visitors, such as Gatwick Airport, which installed navigational beacons that guide a passenger’s way back in 2018 – all accessed via a smartphone app.

Google Maps AR / Google Lens
Image credit: Google

Education

From a school setting to on-the-job training, AR can be used to help learners safely interact with materials they would otherwise not be able to gain access to, all while remaining in a familiar setting. Google debuted augmented reality search during the COVID-19 pandemic to help people learn by placing virtual objects such as spacesuits and animals into real-world locations. A host of apps exist to bring similar objects into a classroom setting, including the Merge Cube, which adds tactility to the experience.

Energy giants such as Shell, meanwhile, are using AR to educate workers in the field by bringing in experts who can see through a worker’s eyes and even draw on the screen of the augmented reality display they are using, boosting safety as they interact with potentially dangerous heavy oil and gas equipment.

Design

Designers at all levels are making use of AR to preview how a space will look before any changes are made physically, from those designing individual rooms all the way up to those planning cities.
Non-professionals too can make use of augmented reality to aid in their designs. Just one example is furniture store IKEA’s IKEA Place app which allows users to place 3D models of the company’s goods into their own rooms in order to preview how they would look, automatically scaling them based on the room’s dimensions to ensure they are true to life.

IKEA PLACE AR app
IKEA Place AR app. Image credit: Ikea

Manufacturing

AR is one of the key pillars underpinning the phenomenon of Industry 4.0, alongside such technologies as machine learning and big data. Consultants PwC has estimated that industrial manufacturing and design is one of the biggest potential areas for augmented and virtual reality, with their use in the industry having the potential to deliver a $360bn GDP boost by 2030.
As a result, examples of the technology in action for manufacturing are easy to come by. One example is Boeing’s use of augmented reality to give technicians real-time, hands-free, interactive 3D wiring diagrams. Lockheed Martin also utilised augmented reality in the creation of NASA’s Orion Spacecraft, overlaying information to help with mission-critical procedures such as precisely aligning fasteners.

Top Ten AR Videogames

AR Game Montage

Augmented reality (AR) is one of the more interesting technologies our smartphones can handle with ease. At first, it felt like a bit of a gimmick, but in the right hands, it can add a lot to gaming. Whether you prefer to stay home and solve puzzles, or roam the area battling or catching creatures, there’s something out there for you. VRFocus has put together a list of some of the best AR infused videogames you can play right now.

Pokemon Go Trainer Battles

Pokemon Go!

It wouldn’t be an AR list without Pokemon Go!, would it? The game that got everyone outside in the summer of 2016 has been using AR technology since the outset. What started with Pokemon placed within the world you inhabited, has become a robust system with avatars that interact while your physical self stands around tapping the screen in a gym or raid battle. AR features are integral to Pokemon Go!, particularly the map view which tracks not only yourself but the gyms, pokemon and pokestops along the route; using photos and location services along with the accelerometer to interact with the fantastical world Niantic Labs have created.

The Birdcage

The Birdcage, and its sequel, are beautiful puzzle games that place the central puzzle within your home space. Aiming the camera, you can place the titular birdcage in the centre of a room. The task is to open the enclosure and free the bird by solving puzzles attached to the cage. Utilising your phone’s camera, the perspective can be changed by moving closer or further, and even around the cage. There are lots of switches to flick, dials to turn and word puzzles to move through the steps. The Birdcage looks and sounds gorgeous and is perfectly taxing on the brain; think The Room but in your room.

Angry Birds AR: Isle of Pigs

Angry Birds had its time in the sun quite some time ago, but recent entries have tried to implement the winning formula onto new technologies. Dabbling in VR (where applicable) and this AR entry, the mechanics feel fresh again. Angry Birds AR: Isle of Pigs opens and asks you to place the traditional looking level on a nearby table (or on the floor). Everything is recognisable – towers and buildings made from blocks with chubby pigs standing by. On your phone, you’ll have a direct view of a catapult, into which the familiar birds jump and can be fired at the puzzle. Watching the blocks and pigs tumble about is joyous and it fits within the AR space ideally. A great game for everyone, but kids will love it!

Angry Birds AR Structure Destroyed

Draw a Stickman: AR

There’s something wonderful about drawing an object on your phone and watching it come to life. With Draw a Stickman: AR, that’s the first step. Your stickman can be as simple or lavish as you want. Once they’re created, an RPG style world is displayed on the floor or surface of your table and you can tap where your stickman needs to go. What comes next is a simple RPG, full of monsters and dungeon crawling… and more drawing! This adds a nice flair to the game, and watching everything pop up in a 3D space through your phone never gets old.

The Walking Dead: Our World

It’s been a few years since TWD: Our World was released and in that time, enthusiasm for zombies has waned a little. Don’t let that stop you from trying this AR gem, though. If one of your daydreams has been how you would deal with a zombie outbreak, now is your chance to live that out. There are walkers roaming your neighbourhood – with maps from Google – and they need to be put down. With legends from the TV show to recruit, you can search out stashes of items and weapons ready to fight it out with the shambling terrors. There are plenty of missions to take on, including saving survivors and holding off rival NPCs, so there’s a lot of variety in this apocalyptic world.

Five Night’s at Freddy’s AR: Special Delivery

The tenth overall instalment in the Five Nights at Freddy’s franchise, it’s time to be scared again. Well, only if creepy, broken, furry robots are your nightmare fuel. There are still puzzles to solve and horrors to avoid, except this time the animatronics are in your home! Played in first-person perspective, the jump scares will get you every time. Thankfully combat is an option, and bashing the demonic beasts has never felt more satisfying. The videogame received a lot of content updates, so anyone jumping in now will have plenty to do.

Pikmin Bloom

Pikmin Bloom

Also from Niantic Labs, comes another Nintendo property in Pikmin Bloom. Some liken this title to a gamified fitness app, as there is no deep gameplay aspect like other AR games on this list. Pikmin Bloom encourages users to leave their homes, walk their local areas and this is reflected in collecting seeds along your route and hatching them into cute Pikmin. Features from the console counterpart have been implemented – like Oliver’s ship log, which is now a daily tracker with photos and captions – to create a richer world.

The Witcher: Monster Slayer

In summer 2021, a surprising AR game popped up on app stores. The Witcher: Monster Slayer is a remarkably enjoyable extension of the Witcher universe. Much like Pokemon Go! the player explores the local neighbourhood battling monsters within the AR world overlaid onto a scale map of your area. Here, instead of using cute creatures, your finger swipes are translated into sword swings and spells to destroy the horrific monsters plaguing the land. A great inclusion are story-driven quests which expand the lore within the games (and the books) and give you a good sense of progression, alongside earned XP and new items to unlock as wander the streets.

Ghostbusters Afterlife: ScARe

Released in conjunction with the latest Ghostbusters movie, this AR app is wonderful jumping on point for the Ghostbusters universe. Packed with puzzles, flying objects possessed by new and familiar ghosts which require ‘busting’ and lots of footage to guide the light story along. This is a great app for kids who can explore their home, or even a local park, while looking for ghosts. There’s something spectacular in swiping and moving the phone to control the stream of the proton pack and wrangle the spectral monsters and slam them into the trap.

Doors: Awakening

Much like The Birdcage above, Doors: Awakening uses your immediate space to position an object bursting with puzzles. In this instance, it’s a door. If you don’t feel like walking back and forth across your living room, you can place these doors on a table and spin them using swipes on the screen. Doors: Awakening has a spooky atmosphere delivered by luscious graphics which bring a real sense of otherworldly adventures to our world. The puzzles aren’t overly difficult, the main reason to play is the visual spectacle it brings to our world.

Taking the First Steps Into an AR Metaverse

With so many companies and brands expressing their plans for the metaverse, one technology will be key for early adopters – Augmented Reality. AR technology primarily uses smartphones and, to a lesser extent, smart spectacles to adapt the reality we see around us, often adding a new layer of interactivity. Because this tech uses hardware most of us already own, it’s easy to see that one of the ways the metaverse will start being pieced together is via AR videogames and apps.

If you cast your mind back to the summer of 2016, you’ll remember a large portion of the public were wandering parks and streets trying to catch Pokemon. Pokemon Go, created by Niantic Labs, uses AR technology in a few ways; by overlaying Pokemon onto a map which you are physically walking in ‘the real world’; it uses the camera in your phone to show the Pokemon against the backdrop of where you are currently; and it allows you to interact with other players through their avatars within the game, while they might be stood only a few metres away in-person.

It’s not only Pokemon Go capitalising on AR; Spokko Sp. z.o.o. adapted the popular videogame franchise The Witcher into a monster-slaying game; Niantic Labs grabbed another Nintendo franchise with their recent Pikmin Bloom release and in 2018, developer Ludia brought Jurassic World to mobile platforms so that we could capture a T-Rex in our local parks. Games are a great playground for developers to try new technologies.

Pokemon Go is still a very popular mobile game five years later and the AR technology used by Niantic Labs is advancing steadily. In early November 2021, the company announced Niantic Lightship, a platform dedicated to the development of Augmented Reality which can be shared with other developers. This new technology is built for the metaverse, using our phones to capture images and use machine learning to translate that footage into an accurate 3D model. Alongside this, consumers will be able to view particular objects through their phone screens and enjoy a unique experience collaborating together, or creating memories at concerts, like the upcoming Ed Sheeran performance due to take place within Pokemon Go.

However, what started with gaming, is growing into a slice of the metaverse that will become available to anyone with a smartphone. The possibilities for AR are constantly being explored. Coachella, the American music festival, is implementing AR features that will enhance a band’s performance as lights, colours and creatures mix with the live-action on stage; Science Museum Group plan to use the technology to bring their exhibits to life and take strides to further education; while the meditation app, TRIPP, will use this tech to help users become more mindful while out in the world.

As people become more familiar with AR, our phones will transform the way we interact not only with the world, but also how we shop or converse with each other. From the small ideas such as IKEA creating an app that places furniture choices in the intended room for you to see how it will fit your home style. To the big brain concepts – Google is using AR to power their language translation apps and visual search engine with Google Lens where you simply point your camera at foreign wording to see it translated in real-time. Plus, projecting directional arrows onto the ground or floating in the air, to plot a journey in Google Maps. Of course, there’s still a way to go before we’re all connected to each other in a central metaverse. However, these games and apps point to what we can expect from the future.

This link between AR and smartphones is integral, not only to keep consumer costs low but because the hardware is powerful enough at this stage to implement the tech needed. All forms of AR require several pieces of hardware which every smartphone has – camera, speakers, microphone, accelerometers and processing power. Depth registration, which places a digital item overlaid onto our world, needs that camera. The accelerometer gauges distances and moves the AR objects based on how the user moves. Most important, is that processing power; with so many AR apps and games, the processor must use machine learning to crunch algorithms in order to decipher what the camera, and thereby the user, is observing.

At first, AR was feeling too many as a bit of a gimmick. It’s now evolving into a genuinely helpful and impressive piece of technology that could impact our daily lives. The beauty of this technology, starting with gaming, is that it proves an accessible entry. The public can make the leap from throwing pokeballs to using AR in the workplace. With incremental movements within apps, soon projecting videos against a wall during a meeting with colleagues which can then be edited or annotated by anyone in the room, through their phone, could become a metaverse standard, with swish 3D avatars.

To get a sense of where AR is heading, it’s worth sticking close to videogames. Euclidean Skies is a puzzler that has a lot in common with Escher sketches. Holding your phone in front of you, labyrinthine buildings take over the empty space of your living room. These can be turned and rotated to solve the puzzle. While Smash Tanks conjures digital tanks, with a battlefield, and lays it out on the floor with no mess to tidy once you’re done. Each of these games contains the same technology that we’ll see from developers working on Niantic Lightship.

Just these two games can point towards other uses of the technology or other apps available which use similar ideas. Thyng is an interface that projects images and short video clips within a shared space; perfect for meetings in tiny offices. Quiver is a kids AR app which, when paired with colouring pages, brings a child’s artwork to life using the colours the child used.

It’s not a stretch to imagine that one day you’ll raise your phone, look through the screen at a friend and see their digital avatar. If we’re to believe Niantic Labs, it’s not much of a jump to walk over a bridge in your hometown with your phone held out and watch as the scene fades into what that bridge looked like fifty years ago, everyone digitally dressed in period clothing. Or for a group of kids touring a museum to be handed tablets that bring ancient worlds to life before their eyes or whisk them away to stand on the edge of a volcano.

Niantic Launches Pikmin Bloom, Harry Potter: Wizards Unite To Shut Down

Over the last week or so, AR mobile game developer Niantic has opened one door and closed another – Pikmin Bloom is now available, but 2019’s Harry Potter: Wizards Unite will be shut down in 2022.

Back in March, Niantic announced it was working on a Pikmin mobile AR title in partnership with Nintendo. As of last week, Pikmin Bloom began rolling out to several countries — it’s now available in almost all major markets, including Europe, Asia Pacific, Africa, Middle East, the US, Canada.

Like many other mobile AR games, Pikmin Bloom follows the rough framework and precedent set by Pokemon Go, Niantic’s first and most successful mobile AR title. However, Bloom takes a slightly different approach to the concept — Bloom is more idle, focused more on simply walking around than actively visiting locations or searching for something. The more you walk, the more pikmin you’ll obtain.

Overall, the game seems to markets itself more as a glorified pedometer with a few game elements thrown in. There’s also minimal AR content compared to other Niantic titles. In fact, the only true use of mobile AR appears to be when you send Pikmin to fight mushrooms, which can be viewed as an AR overlay similar to catching Pokemon in Pokemon Go.

In the same week, Niantic also announced that it will be shutting down its 2019 mobile AR game, Harry Potter: Wizards Unite.

Wizards Unite, the studio’s first game to follow in Pokemon Go’s footsteps, announced that it will close on January 31, 2022 in a post on the game’s website. The game will be removed from store fronts even earlier, from December 6 2021.

We weren’t huge fans of Wizards Unite, but it’s just one game of many — Niantic has announced and released a few IP-focused mobile AR titles in the wake of Pokemon Go, but so far none have managed to catch on in the same way.

Let’s hope that changes with Transformers: Heavy Metal, the next Niantic AR game set to release sometime this year.

Music-Themed Pokemon Go Fest 2021 Event Begins July 17

Pokemon Go Fest 2021 will run on July 17 and 18, offering various special events and rewards to celebrate the game’s fifth, and Pokemon’s 25th, anniversary.

Tickets are available in-app now for $4.99 — much less than last year’s price of $14.99 — and will grant you access to both days of the event.

pokemon go fest 2021

The main part of the event is themed around a music festival, where you will be the show leader. “Help Professor Willow and the team leaders put on an incredible concert celebration by choosing between certain Pokémon to join the festivities. Complete this Special Research for special rewards, including an encounter with a Mythical Pokémon, a shirt avatar item, and an exclusive avatar pose!” This Special Research event will be available on the Saturday from 10am to 6pm (local time).

In addition to the main Special Research event, there’s other stuff to take part in over both days. Hourly habitats are returning from last year, available on the Saturday from 10am to 6pm (local time) and will include four habitats (Jungle, Desert Mountain, Ocean, Cave) over one hour rotations, with certain Pokemon appearing more frequently in select habitats.

Raids on Saturday will feature Pokemon such Hitmontop, Cranidos, and Deino, meanwhile Shiny Whismur, Chimecho, Audino, and Tympole will all make their Pokemon Go debut during the event. The Global Challenge Arena also returns this year, available on Saturday.

On the Sunday, the focus is on raids, with the opportunity to catch any Pokemon you may have missed the day before. There’s also extra XP and rewards attached to certain activities on the Sunday — you can read about those here.

The event also features new music tracks produced by Junichi Masuda, a legendary Pokemon music producer.

All of the above is just the tip of the iceberg — for Pokemon Go fans, there’s a plethora of content spread across the two-day event. To see the full schedule and all the details, check out the Pokemon Go blog.

Pokemon Go Fest 2021 begins on July 17.