Microsoft to Supply US Army More AR Combat Headsets Following Positive Field Test

Microsoft’s HoloLens-based headset built on contract for the US Army has passed an important round of field testing by soldiers. The company is now set to fulfill a larger order to be used in more rigorous testing slated to take place in 2025.

Awarded in 2019, Microsoft’s $22 billion defense contract is aiming to supply the US Army with a tactical AR headset for soldiers based on HoloLens 2 technology, or what’s called an Integrated Visual Augmentation System (IVAS),

According to Bloomberg, 20 prototype versions of the newer 1.2 IVAS headsets were field tested by two squads of solders in late August specifically to check for improvements in reliability, low-light performance and ergonomics. It was reported in early 2022 that Microsoft was bracing for negative field testing, citing concerns with low-light performance and nausea.

Taking place at Fort Drum, New York, those tests “demonstrated improvements in reliability, low light sensor performance, and form factor,” a US Army spokesperson told Bloomberg, saying further that “soldier feedback was positive.”

The Army awarded Microsoft another contract on September 5th for the 1.2 IVAS to see if the company could scale production. Its $22 billion contract indicates an upper target, and not the full amount granted to Microsoft at present.

Epic Games is “exploring native Unreal Engine support” for Apple Vision Pro

Unity, makers of the popular game engine, announced earlier this week it’s getting ready to levy some pretty significant fees on developers, causing many to rethink whether it makes more sense to actually go with the main competition, Unreal Engine from Epic Games. It seems Epic isn’t wasting any time to help transition those creating projects for Apple Vision Pro.

According to Victor Lerp, Unreal Engine XR Product Specialist at Epic Games, the company is now “exploring native Unreal Engine support for Apple Vision Pro,” the upcoming mixed reality headset due to launch in early 2024.

Lerp says it’s still early days though, noting that it’s “too early for us to share details on the extent of support or timelines.”

Lerp posted the statement on Unreal Engine’s XR development forum. You can read it in full below, courtesy of Alex Coulombe, CEO of the XR creative studio Agile Lens:

 

During Vision Pro’s unveiling at WWDC in June, Apple prominently showcased native Unity support in its upcoming XR operating system, visionOS. Unity began offering beta access to its visionOS-supported engine shortly afterwards, making it feel like something of a ‘bait and switch’ for developers already creating new games, or porting existing titles to Vision Pro.

As explained by Axios, Unity’s new plan will require users of its free tier of development services to pay the company $0.20 per installation once their game hits thresholds of both 200,000 downloads and earns $200,000 in revenue. Subscribers to Unity Pro, which costs $2,000 a year, have a different fee structure that scales downwards in proportion to the number of installs. What constitutes an ‘install’ is still fairly nebulous at this point despite follow-up clarifications from Unity. Whatever the case, the change is set to go into effect starting on January 1st, 2024.

In the meantime, the proposed Unity price increase has caused many small to medium-size teams to reflect on whether to make the switch to the admittedly more complicated Unreal Engine, or pursue other game engines entirely. A majority of XR game studios fit into that category, which (among many other scenarios) could hobble teams as they look to replicate free-to-play success stories like Gorilla Tag, which generated over $26 million in revenue when it hit the Quest Store late last year.

Unicorn AR Startup Magic Leap is Killing Its First Headset Next Year

Magic Leap 1, the AR headset that helped the Plantation, Florida-based startup attract over three billion dollars in funding, will be completely defunct by late next year.

The company announced this week that Magic Leap 1’s cloud services are due to be shut off on December 31st, 2024. After that date, the headset will receive no further support.

The loss of cloud services indeed means the headset will essentially be ‘bricked’ on that date, as “core functionality will reach end-of-life and the Magic Leap 1 device and apps will cease to function,” the company says in a recent FAQ.

Image courtesy Magic Leap

On September 29th, 2023, a number of developer resources are being pulled too, including the forum dedicated to Magic Leap 1 as well as the headset’s dedicated Discord channel.

Here’s the full statement from Magic Leap, courtesy a comment made by Reddit user ‘The Golden Leaper’.

Today we are announcing that Magic Leap 1 end of life date will be December 31, 2024. Magic Leap 1 is no longer available for purchase, but will continue to be supported through December 31, 2024 as follows:

Magic Leap 1 Developer Forum: On September 29th, 2023, Magic Leap 1 Developer Forum (https://ml1-developer.magicleap.com/) will no longer be available. Please refer to the Magic Leap 2 Developer Forum for current information and updates on the Magic Leap platform.

Magic Leap Discord channel: On September 29th, 2023, Magic Leap Discord channel will no longer be available. Please refer to the Magic Leap 2 Developer Forum for current information and updates on the Magic Leap platform.

OS Updates: Magic Leap will only address outages that impact core functionality (as determined by Magic Leap) until December 31, 2024.

Customer Care (http://magicleap.com/contactus) will continue to offer Magic Leap 1 product troubleshooting assistance through December 31, 2024.

Warranties: Magic Leap will continue to honor valid warranty claims under the Magic Leap 1 Warranty Policy available here (https://www.magicleap.com/ml1/warranty-policies).

While no longer sold by Magic Leap, the company was selling ML 1 up until mid-2022. Brand new units, including the headset’s hip-worn compute unit and single controller, were being liquidated for the barn burner deal of $550 via Amazon subsidiary Woot. It’s uncertain how many developers and enterprise users will be affected by the shutdown, however they do have a little over a year to figure out a replacement strategy.

Launched in 2018, Magic Leap straddled an uneasy rift between enterprise and prosumers with ML 1 (known then as ‘ML One’), which gained it a lukewarm reception mostly thanks to its $2,300 price tag and relatively narrow differentiation from Microsoft HoloLens. Despite Magic Leap’s best efforts, it simply wasn’t the consumer device the company wanted to make from the onset.

A leadership shuffle in mid-2020 saw co-founder and CEO Rony Abovitz step down, tapping former Microsoft exec Peggy Johnson to take the reins and immediately pivot to target enterprise with its most recent AR headset, Magic Leap 2.

Apple Joins Pixar, NVIDIA, & More to “accelerate next generation of AR experiences” with 3D File Protocol

Today, big tech companies including Apple, Pixar, Adobe, Autodesk, and NVIDIA, announced the formation of the Alliance for OpenUSD (AOUSD), which is dedicated to promoting the standardization and development of a 3D file protocol that Apple says will “help accelerate the next generation of AR experiences.”

NVIDIA has been an early supporter of Pixar’s Universal Scene Description (USD), stating last year it thinks Pixar’s solution has the potential to become the “HTML of the metaverse.”

Much like HTML forms a sort of description of a webpage—being hostable anywhere on the Internet and retrievable/renderable locally by a web browser—USD can be used to describe complex virtual scenes, allowing it to be similarly retrieved and rendered on a local machine.

Here’s how the alliance describes their new OpenUSD inititive:

Created by Pixar Animation Studios, OpenUSD is a high-performance 3D scene description technology that offers robust interoperability across tools, data, and workflows. Already known for its ability to collaboratively capture artistic expression and streamline cinematic content production, OpenUSD’s power and flexibility make it an ideal content platform to embrace the needs of new industries and applications.

“Universal Scene Description was invented at Pixar and is the technological foundation of our state-of-the-art animation pipeline,” said Steve May, Chief Technology Officer at Pixar and Chairperson of AOUSD. “OpenUSD is based on years of research and application in Pixar filmmaking. We open-sourced the project in 2016, and the influence of OpenUSD now expands beyond film, visual effects, and animation and into other industries that increasingly rely on 3D data for media interchange. With the announcement of AOUSD, we signal the exciting next step: the continued evolution of OpenUSD as a technology and its position as an international standard.”

Housed by the Linux Foundation affiliate Joint Development Foundation (JDF), the alliance is hoping to attract a diverse range of companies and organizations to participate in shaping the future of OpenUSD actively. For now it counts Apple, Pixar, Adobe, Autodesk, and NVIDIA as foudning memebers, with general members including Epic Games, Unity, Foundry, Ikea, SideFX, and Cesium.

“OpenUSD will help accelerate the next generation of AR experiences, from artistic creation to content delivery, and produce an ever-widening array of spatial computing applications,” said Mike Rockwell, Apple’s VP of the Vision Products Group. “Apple has been an active contributor to the development of USD, and it is an essential technology for the groundbreaking visionOS platform, as well as the new Reality Composer Pro developer tool. We look forward to fostering its growth into a broadly adopted standard.”

Khronos Group, the consortium behind the OpenXR standard, launched a similar USD initiative in the past via its own Metaverse Standards Forum. It’s unclear how much overlap these initiatives will have, as that project was supported by AOUSD founders Adobe, Autodesk, and NVIDIA in addition to a wide swath of industry movers, such as Meta, Microsoft, Sony, Qualcomm, and AMD. Notably missing in the Metaverse Standards Forum was support from Apple and Pixar themselves.

We’re hoping to learn more at a long-form presentation of AOUSD during the Autodesk Vision Series on August 8th. There are a host of events leading up to SIGGRAPH 2023 though, which goes from August 6th – 10th, so we may learn more at any one of the companies’ own presentations on USD.

Apple Reportedly Has No Plans to Make or Support VR Controllers for Vision Pro

If a recent Bloomberg report from Mark Gurman holds true, not only is Apple not planning to release a motion controller for Vision Pro in the future, but it may not even support third-party VR controllers at all.

When the Cupertino tech giant unveiled Vision Pro last month, it didn’t emphasize the headset’s ability to potentially support VR games, which have typically been designed around motion controllers like Meta Touch or Valve’s Index controller for SteamVR headsets.

Among Vision Pro’s lineup of content, which features a standard suite of Apple ecosystem and standard content viewing apps, the studio only off showed a single VR app, Rec Room, the prolific social VR app that supports most major VR headsets (excluding PSVR 2 for now) in addition to consoles, desktop, and both iOS and Android mobile devices.

Apple Vision Pro | Image courtesy Apple

Mark Gurman, one of the leading journalists reporting on unreleased Apple tech, maintains that Apple is neither actively planning a dedicated controller, nor planning support for third-party VR accessories.

When the $3,500 headset launches in early 2024, this would leave Vision Pro users relying on the headset’s built-in hand and eye-tracking, which admittedly worked very well in our hands-on. It’s also using Siri-driven voice input, Bluetooth and Mac keyboard support, and PlayStation 5 and Xbox controllers for traditional flatscreen games.

For VR gaming though, hand and eye-tracking lack the haptic feedback required for many game genres, meaning what VR games do come to Vision Pro will likely require overhauls to make sure hand-tracking is fully baked in.

Provided Apple sticks with its purported internal plan to not support VR controllers, that would essentially shunt development away from VR gaming and towards the headset’s AR abilities. For Apple, that’s where the ‘real’ money presumably lies.

Denny Unger, founder and lead of pioneering VR studio Cloudhead Games, explains the move as a way to provide a strong development foundation now for Apple’s AR glasses of the future, which will be both more affordable and more capable of replacing a standard smartphone than the admittedly bulky MR headsets of today.

For more from Unger, who heads one of the most successful VR studios, check out his Road to VR guest article to learn more about Vision Pro and why Apple may be launching an AR headset in VR clothing.

Google Reportedly Shelves Multi-year ‘Project Iris’ AR Glasses

Google has reportedly shelved a multi-year project that sought to commercialize an AR headset, known as Project Iris.

According to Business Insider, Google shut down Project Iris earlier this year following mass restructuring, which included layoffs, reshuffles, and the departure of Clay Bavor, Google’s head of AR and VR. The report, which hasn’t been substantiated by Google, cites “three people familiar with the matter.”

According to a report from The Verge earlier this year that first mentioned Project Iris, around 300 people were purportedly working on the headset, which was said to expand by “hundreds more” as production ramped up.

At the time, the prototype was said to be a standalone, ski goggle-like headset providing onboard power, computing, and outward-facing cameras for world sensing capabilities—similar in description and function to headsets like HoloLens or Magic Leap. Project Iris was said to ship as early as 2024.

Two unnamed Google employees told Business Insider the company could actually resurrect Project Iris at some point, as teams experimenting with AR tech haven’t been completely disbanded. Still, it seems its Samsung XR headset partnership and AR software development has become the main focus.

Samsung Future, Daydream Past

With its own in-house hardware allegedly no longer in the picture, moving forward Google is set to focus on the software side of AR, which also includes an Android XR platform it could license to OEM partners. Google is now developing such a platform for Samsung’s upcoming XR headset announced in February, as well as an alleged “micro XR” platform for XR glasses, which is said to use a prototyping platform known internally as “Betty.”

Google is pretty well known for shelving projects all the time for a variety of reasons, so it’s not a big surprise that an expensive hardware project is getting iced during an economic downturn. It’s also possible the company saw the writing on the wall from its earlier VR hardware projects, which were early to the competition, but not persistent enough to stick around.

In 2016, the company’s Daydream VR platform was positioned to compete with Meta’s (then Facebook’s) own mobile VR offering, Samsung Gear VR. Headed by Bavor, the company looked to replicate Samsung/Meta’s strategy of certifying smartphones to work with a dedicated Daydream View headset shell and controller. Google certified a wide swath of smartphones to work on Daydream, including Pixel, LG, Asus, Huawei, and even a number of Gear VR-compatible Samsung phones.

And Google’s ambitions were, let’s say, very big. At its I/O 2016 unveiling, senior product manager Brahim Elbouchikhi said on stage that Google intended to capture “hundreds of millions of users using Daydream devices.” No modern VR headset platform has reached that number of users even today, with Meta likely leading with the sale of nearly 20 million Quest headsets between 2019 and early 2023.

Lenovo Mirage Solo | Photo by Road to VR

Despite big ambitions to own the space early on, Gear VR became the clear winner in the nascent mobile VR market. Undeterred, Google broadened its horizons in 2017 to open its Daydream platform to one of the first truly standalone VR headsets—or rather a single standalone headset—the Lenovo Mirage Solo standalone, which awkwardly mashed up 6DOF positional tracking with a single 3DOF controller. Lenovo Mirage Solo was a real head-scratcher, as its room-scale content was hobbled by a single remote-style controller, which critically wasn’t tracked in 3D space.

In the end, Google shuttered the entire Daydream platform in 2019 because it couldn’t attract enough developer support. On the outside, that makes it seem like Google lost the VR race entirely, but a majority of standalone headsets on the market today run on top of a modified version of Android. Granted, that standalone VR content revenue isn’t flowing into Google’s coffers since it doesn’t control the individual storefronts like it might with a VR version of Google Play.

But that could change with its new Samsung/Qualcomm partnership, representing a fresh opportunity for Google to finally stake a claim in the mounting mixed reality (MR) race.

MR Headsets Walk, AR Headsets Run

MR headsets are virtual reality headsets that use color passthrough cameras to offer up an augmented reality view, letting you do VR things like play games in a fully immersive environment in addition to using passthrough to shoot zombies in your living room, or watch a giant virtual TV in your real-life bathroom (for optimal user comfort).

It’s still early days for MR headsets. While devices like Meta Quest Pro ($1,000) and Apple’s recently unveiled Vision Pro ($3,500) are likely to appeal to prosumers and enterprise due to their high price points, there’s a mounting battle for consumer eyeballs too. Provided that still-under-wraps Samsung XR headset can land at a digestible price for consumers, its brand name cache and patented global reach may serve up strong competition to Meta’s upcoming Quest 3 MR headset, due in September at $500.

Apple Vision Pro | Image courtesy Apple

Price speculation aside, the companies that launch MR headsets today will be better positioned to launch all-day AR headsets in the future. Platform holders like Meta are using their MR headsets today as test beds to see what AR content consumers find most compelling. Apple will be doing just that when it launches Vision Pro in 2024 at arguably an even deeper level, as the Cupertino tech giant seems to be deemphasizing VR stuff entirely.

Whatever the case, Google’s decision to reportedly shelve Project Iris means it’ll be more reliant on OEMs in the near term, and its first volley with that Android-supported Samsung XR headset will reveal the size of its ambitions. It’s a strategy that could work out in its favor as it critically gauges when, if ever to resurrect its own Google-built AR glasses.

Report: Meta in Talks with Magic Leap for Multiyear AR Headset Tech Deal

A report from the Financial Times maintains Meta is currently in talks with AR headset creator Magic Leap to strike a multiyear deal, which could include intellectual property licensing and contract manufacturing of AR headsets in North America.

The AR unicorn is said to possess valuable IP regarding custom components, including its optics, waveguides, and software.

It’s said a potential deal may also allow Meta to lessen its reliance on China for component manufacturing. In 2019, Magic Leap partnered with manufacturing solutions company Jabil to create a Guadalajara, Mexico plant which the report maintains can assemble headsets in “the tens of thousands a year.”

Magic Leap 2 | Photo by Road to VR

Citing people with knowledge of the talks, the report maintains however a specific joint Meta-Magic Leap headset isn’t expected.

While both companies didn’t comment on a potential partnership, Magic Leap said this to the Financial Times:

“Given the complexities of developing true augmented reality technologies and the intricacies involved with manufacturing these optics, as well as the issues many companies experience with overseas supply chain dependencies, we have entered into several non-exclusive IP licensing and manufacturing partnerships with companies looking to enter the AR market or expand their current position.”

Since it exited stealth in 2014, Magic Leap has released two AR headsets, Magic Leap 1 and Magic Leap 2, which have been compared in functionality to Microsoft’s HoloLens AR headsets.

The company has raised over $4 billion, with minority investors including Google, Alibaba, Qualcomm, AT&T, and Axel Springer. Its majority stakeholder is Saudi Arabia’s state-owned sovereign wealth fund.

In addition to Quest Pro mixed reality headset, Meta has confirmed it’s currently working on its next iteration of Quest, likely Quest 3, as well as its own AR glasses. Meta started real-world testing of Project Aria in 2020, a platform for training its AR perception systems and asses public perception of the technology.

Emerging with $61M in Funding, This “AR laptop” Aims to Close the Loop on Virtual Desktop Productivity

First it was the desktop. Then the laptop. And now, the… spacetop? That’s the category that Sightful hopes to carve out with its new “augmented reality laptop” which combines a pair of augmented reality glasses with a keyboard, allowing you to put a huge virtual desktop in your backpack.

Stealth startup Sightful today revealed Spacetop, an “augmented reality laptop” that turns a pair of AR goggles into a large virtual desktop computing environment. The company announced that it is soliciting interest for those who would like to be part of the product’s early access launch, which will cost $2,000 for the complete Spacetop computer. Purportedly only 1,000 units will be available at the outset, with shipments beginning this July.

Sightful, which was previously called Multinarity, says it has raised $61 million in funding to date, with its lead investors being Corner Ventures and Aleph Capital.

While we’ve seen many other ‘virtual desktop’ applications in the PC VR and standalone space, Sightful is trying to close the loop on making virtual desktop productivity… well, actually productive.

Image courtesy Sightful

The company is hoping its all-in-one product—which essentially consists of the bottom half of a laptop, a pair of tethered AR goggles, and a custom software environment—will make for a streamlined virtual desktop experience that’s easy to use. Spacetop has a sort of dock in which to stow the glasses, and a ‘lid’, allowing the entire unit to be portable.

Image courtesy Sightful

Sightful says Spacetop uses a pair of customized Nreal Light AR goggles with 6DOF head-tracking, a 53° field-of-view, and 1,920 × 1,080 resolution per-eye.

Inside the Spacetop base (which includes a full keyboard, trackpad, and USB & DisplayPort ports) is a Qualcomm Snapdragon 865 processor, 8GB of RAM, 256GB of storage, along with enough battery for a claimed 5 hours of work. There’s even a built-in webcam for video calls (though you might look a little strange wearing sunglasses with a cord coming out of them while you’re on video).

Image courtesy Sightful

And yes, you read that right; with a Snapdragon processor this won’t be running Windows but rather the company’s own ‘Spacetop OS’, which we presume is built atop Android, though the company hasn’t said anything about compatibility with Android applications; instead it seems the first version of Spacetop will run almost exclusively on web apps, providing an essentially unlimited virtual desktop upon which to place them.

If you’ve ever used a Chromebook, you’ll know that you can actually get quite a bit done these days operating purely on web apps, but anyone hoping for serious desktop productivity and applications like Photoshop, Illustrator, or Blender, you won’t see them on Spacetop any time soon.

For what it’s worth, the company isn’t trying to hide that fact.

“Sightful is encouraging people who love to be first and look into the future, who work on the go, who live largely in Web apps to come and purchase […] Spacetop,” the company says in its announcement. “Potential customers looking for a hard-core gaming rig or a video-editing monster machine would be better served to wait for a future generation.”

Image courtesy Sightful

The company also says at this point it isn’t focused on leveraging the unique 3D or spatial capabilities that come with AR (no 3D models floating in the air in front of you), nor are they working on any novel inputs (no special gestures to move windows with your hands); all of which is a good idea in my book—its good to walk before you run.

While Spacetop’s focused features and all-in-one design may have some benefits for virtual desktop productivity, the key challenges to unlocking this use-case are about more than just about creating a dedicated software environment and packaging everything together.

Over the years I’ve tried countless variations of XR headsets and virtual desktop software, including using them with a dedicated keyboard, mouse, and even a full Mac and Windows environments. Despite having all of the actual computing power and features I need for my daily workflow, core issues relating to the displays remain; notably: field-of-view, resolution, sweet spot, and comfort.

While the Nreal goggles aren’t terribly heavy, their relatively tiny field-of-view is in direct conflict with the idea of having a massive virtual desktop ready whenever you go. Instead of rotating your head and eyes just a bit to see one monitor or the other with real side-by-side monitors, you’ll need to move your head way more to bring a comparatively sized virtual window ‘into frame’, which can become uncomfortable quickly.

This issue is often amplified by a small sweet spot on many headsets which means that as you rotate your eyes the display becomes blurrier at the edges, meaning you need to nearly center your entire head on any window you want to see at maximum fidelity.

And considering the Nreal goggles use transparent displays, this makes resolution and legibility a challenge because the windows floating in front of you will always have some level of transparency.

As someone who has tried many similar solutions over the years, the pros have yet to outweigh the cons. I don’t personally see Spacetop (or for that matter, any virtual desktop application) catching on in a big way until it’s capable of essentially a perfect replication of a basic 1080p laptop display as it would look in real life right in front of you, let alone an unlimited virtual desktop with a plethora of application windows floating around you.

Report: Apple Mixed Reality Headset Delayed to Late 2023 Amid Decreased Confidence in Market Appeal

Ming-Chi Kuo, a respected supply chain analyst, reports that Apple is tamping down enthusiasm for its upcoming mixed reality headset, which was rumored to see its big announcement at Apple’s Worldwide Developers Conference (WWDC) in June.

In a tweet, Kuo reports Apple is delaying release of its MR headset due to decreased optimism in recreating the “iPhone moment” the company was hoping to achieve with the device.

Kuo, an analyst at Asia-Pacific financial services group TF International Securities, is widely considered one of the most accurate voices in predicting Apple releases. Kuo has made many predictions in the past based on supply chain movements, including Apple’s 2020 switch to its own custom ARM-based processors for Mac computers, the 2019 release of a new MacBook Pro with a 16-inch display, and the release of the entry-level iPad with an A13 chip in 2021—just to name a few.

Kuo says Apple’s MR headset, which is reportedly codenamed N301, is being pushed back “another 1-2 months to mid-to-late 3Q23,” noting that the assembly line delay could mean we won’t see the new device at WWDC 2023 in early June as previously reported by The Financial Times earlier this month.

It was said Apple CEO Tim Cook was a leading force in pushing the device’s launch this year, something that’s reportedly been a source of tension between the Apple chief and the industrial design team since the company began efforts in 2016.

Furthermore, Kuo says that due to the device’s delay in mass production, “the shipment forecast this year is only 200,000 to 300,000 units, lower than the market consensus of 500,000 units or more.”

“The main concerns for Apple not being very optimistic regarding the market feedback to the AR/MR headset announcement include the economic downturn, compromises on some hardware specifications for mass production (such as weight), the readiness of the ecosystem and applications, a high selling price (USD 3,000-4,000 or even higher), etc,” Kuo concludes.

If you’ve been following with the Apple rumor mill for the past few years, you’ll know there are almost too many reports to name at this point. To simplify, we’ve included a list of the headset’s rumored features and specs which we’ve collated from those reports.

Take note, none of the info below has been confirmed by Apple, so please take it with a large grain of salt.

Rumored Apple MR Specs

  • Resolution: Dual Micro OLED displays at 4K resolution (per eye)
  • FOV: 120-degrees, similar to Valve Index
  • Chipset: Two 5nm chips. Includes a main SoC (CPU, GPU, and memory) and a dedicated image signal processor (ISP). Chips communicate via a custom streaming codec to combat latency.
  • Battery: Waist-mounted battery, connected via MagSafe-like power cable to the headset’s headband. Two-hour max battery life, although hotswappable for longer sessions.
  • PassthroughISP chip contains custom high-bandwidth memory made by SK Hynix, providing low latency color passthrough
  • Audio: H2 chip, providing ultra-low latency connection with the second-generation AirPods Pro and future AirPods models. No 3.5mm and possible no support for non-AirPod BT headphones.
  • ControllerApple is said to favor hand-tracking and voice recognition to control the headset, but it has tested a “wand” and a “finger thimble” as alternative control input methods.
  • Prescription Lenses: Magnetically attachable custom prescription lenses for glasses-wearers.
  • IPD Adjustment: Automatic, motorized adjustment to match the wearer’s interpupillary distance.
  • Eye Tracking: At least one camera per-eye for things like avatar presence and foveated rendering
  • Face & Body Tracking: More than a dozen cameras and sensors capture both facial expressions and body movements, including the user’s legs.
  • Room Tracking: Both short- and long-range LiDAR scanners to map surfaces and distances in three dimensions.
  • App Compatibility: Said to have the ability to run existing iOS apps in 2D.
  • Price: $3,000 – $4,000

Design Rumors

  • Outer Shell: Aluminum, glass, and carbon fiber to reduce its size and weight. Cameras are largely concealed for aesthetic reasons.
  • Presence DisplaysOutward-facing display can show user’s facial expressions and also presumably eye movements. Said to be an always-on display similar in latency and power draw of Apple Watch or iPhone 14 Pro.
  • Dedicated Passthrough Switch: Digital Crown-like dial on its right side to switch between VR and passthrough.
  • Headstrap: Various available, including consumer-focused headstrap similar in material to Apple Watch sport bands with built-in speakers. Unspecified, but different headstrap targeted at developers.

ZEISS Takes Majority Stake in AR/VR Optics Creator Tooz Technologies

ZEISS, the German optical systems manufacturer, announced it’s acquired majority share of the joint venture Tooz Technologies, an AR/VR optics creator founded by Zeiss and Deutsche Telekom in 2018.

Zeiss and Deutsche Telekom previously had an even 50% stake in Tooz, which has functioned as a sort of AR optics skunkworks for the companies. Zeiss is now sole owner of the startup.

Zeiss says Tooz will continue to exist independently as it focuses on serial production and visual correction in its imaging systems, further calling Tooz its “AR/VR competence center.”

Image courtesy Tooz Technologies, ZEISS Group

Today, Tooz principally creates smart lenses that integrate curved, reflective waveguides and “invisible” combiners that can also be sandwiched into a vision correction layer.

“In the future, tooz will also equip optical systems from other manufacturers of AR/VR optics with prescription lenses to place products with an integrated prescription on the global markets,” the company say in a press statement.

“tooz covers specific competencies and technologies for design, engineering and manufacturing processes, which complement the existing capabilities at ZEISS quite well,” says Gerrit Schulte, Head of Zeiss Ventures. “tooz will benefit in particular from production and process know-how and the significant experience in the approval of medical optics, and is slated to be better positioned on the international market in the future.”

While Zeiss isn’t a household name is VR or AR headsets, the Oberkochen, Germany-based company has produced a number of head-mounted devices in the past, including its Zeiss VR One Plus created in the vein of Samsung Gear VR and Carl Zeiss Cinemizer multimedia glasses. Zeiss also creates aftermarket VR prescription lenses, sold through VR Optician.