Army orders more AR goggles post-pukegate

(Image courtesy Microsoft.)

Remember those mixed reality combat goggles that Microsoft was building for the Army that made soldiers nauseous? (See our previous story here.) Well, they’re back.

Microsoft got its hands slapped and had to go back to the drawing board after reports came out last year that its new AR goggles were making soldiers literally sick to their stomachs. But it seems they’ve fixed the issues, and are ready for round two.

The Army just placed a new order for the Integrated Visual Augmentation System or IVAS goggles, Bloomberg reports.

Microsoft sent the Army some new prototype headsets this summer. The company apparently fixed the issues that caused headaches, nausea and pain.

The Army spokesperson said the new headsets showed “improvements in reliability, low light sensor performance, and form factor.”

I’m sure Microsoft was sweating bullets about this contract, since its consumer AR efforts seem to be dying on the vine. Apple has been grabbing all the hype with its upcoming mixed reality headset — but at $3,500 a pop, I don’t know how much traction those headsets are going to get, either. Which just leaves Meta and the Quest 2.

Meanwhile, Microsoft laid off a bunch of the HoloLens team earlier this year.

The next steps for IVAS include adding in cloud computing, the Army Times reports. This will let soldiers download apps for specific mission needs.

The Army wants to avoid overloading IVAS by offloading apps to the cloud instead of the device. During testing, soldiers used the goggles for assault planning, mission practice, targeting, and more.

IVAS lets them ditch the sand table to quickly scout and rehearse missions virtually.

Rather than an MRE-box sand table, a unit could virtually “see” the terrain in their heads-up display and rehearse a mission in their patrol base before leaving the wire,” Brig. Gen. Christopher Schneider told Army Times.

“Now we have to make this system producible and affordable,” he added.

Earlier issues around night vision, size, and weight are getting fixed bit by bit. The goal is to nail down cost and manufacturing in 18 months.

If all goes well, IVAS could start hitting units by 2025. Of course, that’s assuming the cloud tech actually works as advertised. And that Congress keeps funding the project.

How it started

Microsoft started working with the Army in 2018 on mixed reality headsets using its HoloLens tech. The goal was to help soldiers train, plan missions and operate better in the field, the company said in a long article about the project two years ago.

IVAS has night vision, heat sensors, 3D mapping and other HoloLens features. It’s meant to give soldiers more awareness by layering digital info onto the real world, the company said.

To get input, Microsoft engineers did mock bootcamps in 2019, where they learned skills like navigating at night. This helped them design IVAS to handle tough conditions soldiers face.

After soldiers tested IVAS for around 80,000 hours by early 2021, Microsoft had a headset ready for combat use.

I’m not sure why they missed the whole nausea thing the first time around. Maybe the engineers had been using the headset so much themselves, during the whole development process, that they were used to it? Or it was so much better than the early iterations, that the nausea didn’t even register as a problem any more?

Life In 360°: Free Fallin’

We’re up in the air once more on Life In 360° and at this point it feels like we spent fully fifty percent of our time above ground. Today’s example of 360 degree video in action however is less concerned with getting airborne as it is concerned with getting back down on the ground again.

Life In 360° / 360 Degree VideoWe’re back to Facebook for our first video of the week, this one coming courtesy of the U.S. Army John F. Kennedy Special Warfare Center and School. ‘Swick’, which is it’s informal name, was first set up in 1950’s although at that time it was the Psychological Warfare (PSYWAR) Center and School. It’s naturally had a number of designations down the years, gaining its most current back in 1985.

It’s the home of a number of army units, including the 1st Special Warfare Training Group (Airborne), six battalions of soldiers, a support battalion and special warfare groups related to education and medical needs. Today’s video relates to Special Operations Forces.

The Military Free Fall Parachutist Course trains these combatants in tactical insertion techniques using ram-air parachutes. It’s not exactly without risk, this training. However instructors move to ensure the safety of each and every student as they make their way down to the ground.

“In today’s global environment, areas of conflict are becoming increasingly difficult for military forces to access. Through advances in technology, tactics and training, potential adversaries are prepared to prevent unwanted forces’ physical presence, and the U.S. military must adapt to face these challenges. ” Explains Major James Branch, B Company, 2nd Battalion, 1st Special Warfare Training Group (Airborne) on the U.S. Army website.

“A collective military free-fall, or MFF, capability throughout the Army’s Special Forces regiment will ensure the U.S. Army’s unconventional warfare force can effectively enter and perform within the operational areas of today and tomorrow. Traditional forced-entry techniques such as low-altitude, static-line airborne operations have lost viability as a clandestine entry technique, especially in special-operations missions where silence and accuracy are crucial to mission success. Discreet, low-visibility free-fall infiltration complements the mission and structure of a Special Forces operational detachment-alpha, or ODA.”

“To meet this challenge, the Special Forces Regiment has re-evaluated its training methodology to ensure its Soldiers have an expansive skill set to meet the demands of our current and future operational environment. This re-evaluation has established that while Army Special Forces units do include select MFF-capable ODAs, the force lacks a formal, wide-spread clandestine infiltration capability; such that would be available through regiment-wide military free-fall qualification.”

You can see the video of one training run below. VRFocus will be back later this week with another example of 360 degree video.

Military Free Fall 360

#FreeFallFriday:The Military Free Fall Parachutist Course trains Special Operations Forces in tactical insertion techniques using ram-air parachutes. During the high-risk training, instructors ensure the safety of each student all the way to the ground.

Posted by U.S. Army John F. Kennedy Special Warfare Center and School on Friday, 9 March 2018

Military Uses AR To Substitute For Live Fire Exercises

Ask any military expert and they will tell you that when it comes to training troops there are no substitutions for the experience gained during a live firing exercise. Its the pressure of being in a live fire situation can have a profound effect on the alertness of troops, and trainers have been unable to find anything close enough the replicate that effect – until augmented reality (AR) came along.

At the U.S. Army’s Annual Meeting and Exposition soldiers donned specialised AR equipment along with dummy riffles and looked around to see the real world with AR holograms superimposed over it, including what appeared to be a full-sized helicopter flying around shooting holographic hellfire missiles at the soldiers who were involved in the demonstration.

Feedback from soldiers who have been involved in testing the equipment has been positive, according to U.S. Army Research Laboratory chief engineer Pat Garrity: “Augmented reality technology now allows soldiers to train indoors, outdoors, day or night,” Garrity said, “They’re no longer tied to brick and mortar training facilities.”

While previously this type of equipment might have cost hundreds of thousands of dollars per solider, using off-the-shelf parts and customising existing technologies such as videogame engines and the types of sensors and hardware already used in consumer AR and virtual reality (VR) hardware has enabled the cost to be substantially reduced.

Another consideration is weight. Soldiers already carry much in terms of body armour and equipment, so any new addition needs to be as lightweight as possible, preferably light enough that soldiers forget they are wearing it. Though the technology is at the moment geared towards ground troops, Garrity believes that in the future it could be configured for use by vehicle crews, aviators and other parts of the military service.

The program is currently in the ‘science and technology’ phase until 2020, when Garrity hopes to be able to transition it into a state where it will be ready to be integrated into training scenarios and demonstrations.

VRFocus will continue to report on uses of VR and AR technology in the military.