Magic Leap 2 Controllers Have Onboard Inside-Out Tracking

An image shared on Twitter of the upcoming Magic Leap 2 shows cameras on the controllers, used for inside-out tracking.

In January we reported on Magic Leap 2’s specs – or at least some of them – being shared at SPIE Photonics West 2022. But as it turns out, we missed that the company also revealed that the controller itself uses inside-out tracking. It wasn’t clear at the time what exactly that meant, but the image shared this week by entrepreneur Peter Diamandis shows two front-facing cameras.

Controllers in almost all AR and VR systems available today are either tracked by the headset or rely on external base stations. Meta’s Quest 2 for example tracks a pattern of infrared LEDs underneath the plastic ring of its controllers, while Valve’s Index controllers determine their position relative to SteamVR “Lighthouse” base stations placed in the corner of your room.

Relying on the headset for tracking has a flaw: if the controller moves out of view of the sensors or if any part of your body gets in the way, tracking will temporarily break. This isn’t a problem for many use cases, but does limit intricate two handed interactions and scenarios like looking left while shooting right. Using external base stations can alleviate most of these issues, but that increases setup time and severely limits portability – and the path from controllers to base stations can still be occluded.

Magic Leap 1 and Pico Neo 2 used magnetic tracking. Unlike visible light, the magnetic field can pass through the human body so occlusion isn’t an issue. But magnetic tracking isn’t as precise as optical tracking systems can be, and adds significant weight and cost to the hardware.

Controllers with onboard cameras promise to solve the occlusion problem while maintaining high precision by tracking themselves in the same way inside-out headsets do – using a type of algorithm called Simultaneous Location And Mapping (SLAM). SLAM essentially works by comparing the acceleration (from an accelerometer) and rotation (from a gyroscope) to how high contrast features in your room are moving relative to the cameras. Initial SLAM algorithms were hand crafted, but most today use at least some machine learning.

The potential downsides of this approach are the cost of a chip powerful enough to run the tracking algorithm, the reduction in battery life due to the power that chip would draw, and the need to have a well-lit environment with high contrast features such as posters – though that limitation applies to inside-out headsets too. Some have suggested tracking quality may be reduced in fast movements due to motion blur, but this shouldn’t be any more of an issue than tracking fast moving LEDs – a global shutter sensor with a low exposure time should make this a non-issue.

Meta is seemingly also planning to use controllers with onboard inside-out tracking in its upcoming Project Cambria headset. Images of Quest-like controllers with cameras instead of an LED ring first leaked in September, and the rings aren’t present in the official reveal trailer either.

Both Magic Leap 2 and Project Cambria are slated to release this year, though neither has a specific release window. They’re very different products – ML2 is a transparent AR headset designed for enterprise while Cambria is an opaque headset for VR and mixed reality – but whichever launches first will be the first AR or VR system to use this new approach to controller tracking.

Magic Leap 2 Controller May Use On-board Inside-out Tracking, an Industry-first

A new photo of Magic Leap 2 appears to show the device’s controller equipped with cameras for inside-out tracking which would be the first time we’ve seen the approach employed in a commercial XR headset.

Though we learned plenty of interesting details about the forthcoming Magic Leap 2 AR headset back in January, it looks like there’s still some secrets left to uncover.

Image courtesy Peter H. Diamandis

A recent photo of Magic Leap 2 posted by Peter H. Diamandis is, as far as we know, the first time we’ve gotten a clear look at the front of the Magic Leap 2 controller. The photo clearly shows what appear to be two camera sensors on the controller, indicating a high likelihood it will have on-board inside-out tracking.

Image courtesy Peter H. Diamandis

The original Magic Leap 1 also had a motion controller, but it used magnetic tracking. This was the reason for the curious square sticking out of the headset’s right side (it contained a receiver that sensed the magnetic field emitted from the controller).

A square dangling off the side of Magic Leap 1 senses a magnetic field created by the controller | Image courtesy Magic Leap

Magic Leap 2 has ditched the square and appears to be moving to entirely on-board inside-out tracking for its controller. To our knowledge this will be the first time a commercial XR headset makes use of the approach; that is, assuming Magic Leap 2 beats Meta’s Project Cambria to market (the latter is also expected to use on-board inside-out tracking for its controllers, based on some leaked details, though it hasn’t been confirmed yet).

Other standalone XR headsets, like Quest 2, typically use headset-based inside-out tracking to track their controllers (or the user’s hands). That is: cameras on the headset look for the controllers (typically arrayed with IR LEDs) and use their location to map their movement relative to the headset.

Image courtesy Oculus

While this approach has proven effective, it only works when the controllers are in view of the headset’s cameras. That means it’s possible for the headset to lose track of the controllers if they spend too much time outside of the camera’s view (like if you held them too low, too high, or behind your back). Putting cameras on the controllers themselves would enable inside-out tracking that, in theory, has coverage no matter where the user holds it.

Image courtesy Oculus

Beyond ‘anywhere’ tracking coverage, putting inside-out tracking directly on the controller means the headset wouldn’t need to be covered in so many cameras (Quest 2 uses four cameras while Rift S tops that at five), and it means the elimination of the ‘tracking rings’ (seen on most standalone headset controllers) making them sleeker and perhaps less prone to breakage.

There’s more potential benefits too. Giving controllers their own inside-out tracking could make it easier to use a combination of input methods, like a controller in one hand and controllerless hand-tracking in the other. Currently that’s a challenge because the cameras on the headsets tend to use different exposure settings for tracking controllers compared to tracking hands. Furthermore, decoupling controller tracking from the headset has the potential to reduce controller tracking latency.

But, as they say, there is no free lunch. Giving controllers on-board inside out tracking likely means putting a dedicated processor inside with enough power to crunch the incoming images and compute a position, which we’d expect to result in higher costs and more battery drain compared to having simple IR LEDs on-board.

There’s also the issue of motion blur for the on-board cameras. While inside-out tracking has been shown to work well for headsets, controllers can move considerably faster, especially during intense games—so fast, in fact, that it prompted Valve to update its SteamVR Tracking tech to account for the speed of top Beat Saber players.

As you can imagine, swinging a camera around that fast is likely to induce motion blur across the image sensor, especially in darker scenes where the exposure time needs to be increased to gather more light.

Of course, Magic Leap 2 isn’t intended for gamers, so it’s possible that this wouldn’t be an issue for the headset’s enterprise-focused use-cases. Or maybe the image sensors on the controllers are fast enough to avoid motion blur even during quick movements?

Perhaps most likely the sensors aren’t above average, but the controller will simply lean primarily on IMU-based tracking until the controller slows down enough to get a proper position (this is the same approach that existing standalone headsets use to deal with controllers that occasionally leave the headset’s field-of-view).

In any case, we’ll know more as Magic Leap 2 approaches commercial availability. The headset is expected to launch this year but a specific release date hasn’t been announced yet. In the tweet which included the controller photo, Peter H. Diamandis said he would be hosting Magic Leap CEO Peggy Johnson at his Abundance 360 event at the end of April which could signal the next time the company will divulge official details on the headset.


Editor’s note: Before someone in the comments says ‘SteamVR Tracking tracking controllers have been doing inside-out tracking for years!’ the industry vernacular does not consider systems using artificial markers as ‘inside-out tracking’.

The post Magic Leap 2 Controller May Use On-board Inside-out Tracking, an Industry-first appeared first on Road to VR.

Magic Leap 2 Specs Suggest A Best-In-Class Seethrough AR Headset

Magic Leap 2’s specs – at least some of them – were revealed this week in a presentation at SPIE Photonics West 2022.

While Microsoft HoloLens came out first targeted toward businesses, the original Magic Leap One launched in 2018 as the first augmented reality headset available to consumers, priced at $2300. After reportedly selling just 6000 units in the first six months, the company pivoted to targeting enterprise customers instead in 2019.

Magic Leap 2 was first teased back in late 2019 with a launch target of 2021, though no details were given. In October 2021 the company shared the first image and announced it will launch this year, claiming it will have the largest field of view of any transparent optics headset.

 

At Photonics West, Magic Leap’s VP of Optical Engineering Kevin Curtis revealed some key specs for Magic Leap 2 (ML2).

The headset apparently weighs 248 grams, down from Magic Leap 1’s 316 grams.

However, Magic Leap headsets use a tethered compute box attached to your waist rather than housing the battery & processor in the headset itself. Curtis says ML2′ new compute box is more than twice as powerful as ML1’s with “more memory and storage” too. While ML1 used an NVIDIA Tegra chip, Magic Leap announced a partnership with AMD in December.

ML1 has two variants to accommodate narrower and wider interpupillary distances (IPDs). Curtis claims ML2’s eyebox is twice as large meaning this is no longer necessary. The eyebox refers to the horizontal and vertical distance from the center of the lens your eyes can be and still get an acceptable image.

While ML1 uniquely had two focal planes so near and far virtual objects were focused at different distances, there was no mention of the same technology in the ML2 spec presentation.

ML2 seems to have its own unique optical technology though; a new feature called Dynamic Dimming. A major problem with see-through AR headsets is the inability to display the color black, since their optical systems are additive – they superimpose color onto a transparent lens, but black is the absence of color. Curtis claims dynamic dimming can vary the lens from letting through 22% of real world light to letting through just 0.3%. At 22% the real world will be visible even in dark rooms, 0.3% would let virtual objects remain visible even in bright outdoor conditions.

ML1 had one eye tracking camera per eye, but ML2 has two per eye, which Curtis says “improves image quality, minimizes render errors, and enables “segmented dimming”. The later use case wasn’t elaborated on, but may suggest the headset could vary the Dynamic Dimming level based on whether you’re looking at darker or lighter virtual objects.

Notably, Curtis did not reveal the resolution or the exact field of view. But CEO Peggy Johnson revealed it in November at Web Summit as approximately 70 degrees diagonal, up from 50 degrees in the original.

If we assume the aspect ratio shared in the October tease is accurate, that would mean a horizontal field of view of roughly 45 degrees and vertical field of view of roughly 55 degrees. This is significantly narrower than opaque passthrough headsets like LYNX R1, but much taller than competing seethrough headsets like HoloLens 2.

Magic Leap 1 is targeted toward enterprise but still available to individuals who want one. It’s unclear what sales path Magic Leap 2 will take, and no price or specific release date has yet been revealed.

Tons of New Magic Leap 2 Details Shed Light on Dynamic Dimming & More

Although it’s expected to launch this year, there’s still no firm release date on Magic Leap 2. However, the company has begun sharing details on the headset which suggests the launch is approaching.

This week at the SPIE Photonics West 2022 conference, Magic Leap’s VP of Optical Engineering, Kevin Curtis, took to the stage to share a bevy of new details on the headset. Attendee Nataliya Kosmyna shared portions of the presentation alongside some portions which cropped up over at the AR XR MR subreddit.

During the presentation Curtis detailed Magic Leap 2’s bevy of sensors, optical stack, Android foundation, and more.

The most interesting details to come from the presentation are perhaps about the headset’s dynamic dimming capability, which is a first among commercial AR headsets.

Dynamic Dimming Lenses

Image courtesy AR XR MR

Curtis shared that Magic Leap 2 can adjust the light transmission of its lenses from 22% to 0.3%. The former being something like sunglasses and the latter being closer to welding goggles. This wide range ought to make the headset usable even in very bright outdoor environments (though it will of course come at the cost of dimming the world around the user as well). Dynamic dimming is paired with a brightness range from 20–2,000 nits; combined, these capabilities should make the headset significantly more flexible than its predecessor, and similar headsets, when it comes to varied lighting conditions.

Also noted in the presentation, the dimming capability can refresh at 120Hz, and is “segmented” as well. The slides state this means that Magic Leap 2 lenses can “enable black,” presumably by selectively dimming only the part of the lens where black is needed in the image. On traditional transparent AR headsets it’s impossible to have ‘black’ as a color because black is the absence of light but the lenses have no way to stop light from passing through. Without access to the entire contents of Curtis’ talk, we don’t know how precisely the dimming capability can be segmented so it’s difficult to know if this will be a comparatively groundbreaking capability, or something more limited.

Curiously, dropping to the minimum 0.3% light transmission might even make Magic Leap 2 useful for fully immersive VR experiences where the real world is largely dimmed to make way for entirely virtual content. It remains to be seen if this is a use case the company is actively aiming for.

The Headset

About the headset itself, Curtis shared that Magic Leap 2 will come in just one size—a change from Magic Leap 1 which had a ‘large’ and ‘small’ variant. The reasoning behind having two sizes for ML1 appears to have been driven largely by a small eyebox and the lack of IPD adjustment, requiring two different sizes of the headset to try to cover a suitable range of the IPD spectrum. For Magic Leap 2, Curtis says the eyebox was doubled in size, apparently making it large enough for the company to move to a single headset size.

According to Curtis, Magic Leap 2 weighs just 248 grams (0.5 pounds). That’s a nearly 22% reduction over the original headset’s 316 grams (0.7 pounds), while furthering its lead in weight over HoloLens 2 which comes in at a much heftier 566 grams (1.2 pounds). Granted, Magic Leap 2 still relies on a tethered connection to a ‘Compute Pack’ which gives it a big advantage in the weight department over fully self-contained headsets.

ML2 will also include eye-tracking, with two cameras per-eye. As far as we know, that’s up from one camera per-eye on ML1, which could mean greater accuracy. Eye illumination is provided by six tiny LEDs which can be seen embedded in each lens.

Image courtesy Nataliya Kosmyna

It isn’t clear yet if Magic Leap 2 will have the same varifocal capabilities as ML1. Given the diagram shared by Curtis (further above)—which appears to show one waveguide per red, green, and blue color (instead of two per color as with ML1)—the feature may have been scrapped.

The headset will include a 12MP RGB camera for user-facing photo capabilities, like taking pictures & videos, scanning barcodes, and streaming video for ‘see-what-I-see’ use-cases. On-board audio is also confirmed.

Image courtesy Alessio Grancini

Two key things we don’t know yet are the resolution and field-of-view of Magic Leap 2. According to Curtis, Magic Leap 2 has “double” the field-of-view of ML1 (which is 50° diagonal), though we expect this means double the area, not double any of the linear dimensions. The company has previously shared this comparison of the ML2 field-of-view vs. ML1 in which we can see most of the gain comes in the vertical direction.

Image courtesy Magic Leap

Compute Pack

As for performance, Curtis indicates the Magic Leap 2 ‘Compute Pack’ will have 2–3 times the GPU & CPU performance of Magic Leap 1, including the addition of a dedicated co-processor for handling computer-vision operations, which he referred to as the CVPU (computer-vision processing unit).

Curtis didn’t specify Magic Leap 2’s processor, but the company has strongly hinted that it comes from AMD. Interestingly, Magic Leap 1 was based on Nvidia’s Tegra chipset, which was fairly novel for this kind of device.

AMD is also a somewhat novel choice for Magic Leap 2 as most devices in this category use chips from Qualcomm, including Magic Leap’s main competition, HoloLens 2. You may know AMD as a creator of desktop & laptop processors as well as GPUs, but the company also has a significant foothold in the console market as the longstanding provider of chips in Xbox and PlayStation consoles. Magic Leap 2 could represent AMD’s first significant entry into the XR space.

Image courtesy Nataliya Kosmyna

Magic Leap 2 also touts “more memory, storage, and battery life vs. competitors,” but we don’t have many specifics at this time. From the materials we have we know that ML2 will have USB-C charging, Bluetooth 5.1, and WiFi 802.11AX (AKA WiFi 6).

Continue on Page 2: Controller, Embracing Android »

The post Tons of New Magic Leap 2 Details Shed Light on Dynamic Dimming & More appeared first on Road to VR.

The Virtual Arena: Immersive Theater Breaks New Ground

The Virtual Arena

The application of immersive technology into the attractions and amusement landscape is covered by industry specialist Kevin Williams. In his latest Virtual Arena column – we visit the test project for a new kind of Immersive Theater – employing the latest technology, including Magic Leap AR headsets, making its debut in live performance.

Lost Origin
Image credit: Seamus Ryan

The diversity of location-based experiences is constantly growing, we have already covered in this column some of the related immersive presentations in the arts. And recently the team behind a new project invited the media to be the first to be immersed in a new audience experience. Called Lost Origin Experience – the endeavour has been self-styled as a boundary-breaking piece, combing performance, mixed reality to offer an “Immersive Theatre”. A fusing of technologies, including a partnership with Magic Leap to deploy their headsets as part of the performance. Allowing the audience to interact with both the physical and digital worlds.

The experience was developed by studio Factory 42, presented in partnership with the Almeida Theater and Sky. The work is a UK government-funded research and development project, part of the Innovate UK to push boundaries in immersive experiences (the Industrial Strategy Challenge Fund’s Audience of the Future initiative). Along with the whole unique aspect of this immersive theatre, is the careful attention to detail cemented using the full gambit of mixed reality (MR) applications. This is stated as being the first-ever large-scale visitor experience deployed with Magic Leap headsets. The whole project is a limited-time test run of the concept, being operational only for a one-month window, in London.

Having booked a slot, the theatre experience sees the guest recruited as a member of the organization called “Wing 7”, planning to carry out an investigation, codenamed “Operation Origin” – directed to arrive at the field base at Hoxton Docks, in London. The experience starts before arriving at the secret venue, as guests receive a mysterious video emailed to them before they arrive setting the scene, from the operations director. Upon arrival at the field base, the guest is taken into a briefing and introduced to the team and key players. Actors set the scene of a story of dark-web auctions, and secret activities unfold, and then it’s time to enter the adjoining premises and start the search for clues, and more!

Operation Origin
Image credit: Seamus Ryan

Without going into too much detail and revealing the compelling storyline and experience, we can reveal that the adventure takes the group through several rooms’ settings, though the experience is fundamentally broken into four key acts but is much more nuanced. The first offers an immersive puzzle section, then we move into an area of wonder and mystery, then a chance to wear the Magic Leap AR headsets and interact with the environment. And then finally the denouement, where the group get to decide the outcome.

As stated, Lost Origin Experience has played with all the toys in the toybox of immersive experiences. Essentially, we have at the front the use of LARP’ing. Live-action role-playing (LARP) has grown in popularity since the early murder mystery experiences, and more recently with the Secret Cinema kind of events. As we reported in our coverage of ‘The War of the Worlds’ VR experience, the use of theatrical production to drive the audience immersion and steer them through the narrative has grown in popularity combined with immersive entertainment. The Lost Origin offers a great cast, who worked hard to drive the experience for all the guests.

Lost Origin
Image credit: Seamus Ryan

Regarding the other elements, the surprising use of projection-mapping was cleverly and subtly achieved, with guests solving the puzzles and then being transported into a dream-like state. Alongside the projection mapping, the use of motion tracking allows the small audience to drive the story interacting with the narrative being revealed. The cast was ably supported by the live performances, masterfully steering the guests.

But it was the use of AR in this first of its kind immersive theatre performance that was the main area of interest. The developers had elected to use the Magic Leap One Creator Edition headsets for the performance. The group of guests on the third act of the experience are helped to put on the systems, and then navigate around a unique location, and given glimpses of spirits and even transported back in time. The Magic Leap systems were able to offer a competent AR representation, though they were limited by their performance, and it was not a seamless experience. But the developers of the AR app had managed to squeeze as much as they could out of the hardware, and it did work with the narrative presented.

Magic Leap
Image credit: Seamus Ryan

For Magic Leap, the company has pivoted from consumer-facing towards wholly commercial (enterprise) development. Having even announced their plans for a Magic Leap Two, a new interpretation of their headset, with redesigned elements, for some time in 2022. The company has had their original hardware deployed in other pop-up attractions, most notably the deployment in AT&T flagship stores in America, running an experience based on HBO’s ‘Game of Thrones’ universe. Following troubling financial conditions for Magic Leap, and the exodus of senior management, a new CEO has repositioned the company, and secured new investment, to hopefully allow them to grow once again. The team behind Lost Origin worked with Magic Leap as far back as 2018, at the time as one of the only systems able to acquire for the research project.

Regarding the use of AR in such “Immersive Theater” and “Artainment” – several developers have attempted to harness this technology to that end. The most ambitious of these and one of the first mainstream applications was in ‘The Unreal Garden’, which launched as part of the ill-fated Onedome facility in 2018. Employing Microsoft HoloLens AR hardware. The experience proved so compelling that it has been re-launched now as a standalone experience. ‘The Unreal Garden 2.0’ has opened in San Francisco, continuing to expand the use of physical elements and digital illusion – with updated hardware (using the HoloLens 2) and new content.

Returning to London, and Lost Origin Experience – in conclusion, this was a great example of the development in immersive performance, and the strength in bringing strangers together to experience a narrative. A mixture of immersive escape room, with mixed reality experience and live-action performance – the whole thing lasted over 60-minutes and did not drag, seamlessly orchestrated. The experience will only be open for a short period, from 21st November till the 4th December, and will cost £30.00 (and £18.00 for 14–16-year-olds) all bookings online.

This latest example of Immersive Theater offered a glimpse of how tech can play its part in the grand illusion, and we look forward to seeing this kind of application evolve and grow.      

Magic Leap Won’t Make a Consumer Headset but May License Tech to Someone That Will

Magic Leap just gave us the first glimpse of its Magic Leap 2 AR headset earlier this week. Despite a consumer-focused start, the company has firmly pivoted into the enterprise segment. Comments from the CEO suggest there will be no consumer headset from Magic Leap in the near-term, but the company says its open to licensing its tech for the consumer space.

Despite nearly going bust last year, Magic Leap secured its near-term future with the announcement this week that it has raised an additional $500 million, alongside giving the first glimpse at the new and improved Magic Leap 2 AR headset which is due to ship next year. The company is making it clear that the device is designed (and will be priced) for the enterprise segment.

Image courtesy Magic Leap

In a Magic Leap blog post this week CEO Peggy Johnson outlined the company’s activities during her first year as CEO, and affirmed a long-term emphasis on the enterprise space. But she also said the company is open to licensing its tech to anyone building in the consumer sphere.

“While our core business objectives remain focused on enterprise solutions, there continues to be intense interest in the application of Magic Leap’s technology in the consumer space,” Johnson wrote. “In fact, we have received several requests to license our technology and will actively pursue these opportunities if they enhance our position and ability to innovate in the enterprise market.”

The last part is particularly telling… that the company will only consider lending its tech to the consumer space if it benefits its position in enterprise. It’s an interesting admission that both affirms the company’s enterprise focus while suggesting that it has no near-term plans to build products for consumers; that also sounds a lot like saying ‘we don’t want to compete with Facebook or Apple’.

Johnson, a former Microsoft executive vice president who took over as CEO of Magic Leap in 2020, writes that Magic Leap has “one of the most robust IP portfolios I’ve seen for a company of this scale,” and is clearly interested in leveraging its patented tech into an ongoing revenue stream.

The post Magic Leap Won’t Make a Consumer Headset but May License Tech to Someone That Will appeared first on Road to VR.

Official Magic Leap 2 Details Released, $500m New Funding Raised

Magic Leap 2

It certainly seems to be hardware season where virtual reality (VR) and augmented reality (AR) is concerned. HTC Vive has a special event planned this week, Lynx-R1 launched a Kickstarter, Canon EOS VR was unveiled and now the first proper look at Magic Leap’s next device. Not only that, the company has managed to raise a further $500 million USD in funding.

Magic Leap 2

Magic Leap CEO Peggy Johnson initially teased the first image on Monday before an interview with CNBC. This has been followed up with further imagery of a much sleeker looking device. In a similar arrangement to the original model, the Magic Leap 2 has a pair of central cameras but this time there are two additional sensors just below them. There’s an additional lens on the corner that looks tilted outwards by around 45-degrees, presumably for a wider capture field.

Actual specifications regarding the Magic Leap 2 haven’t been released just yet, Johnson has mentioned that the: “headset boasts critical updates that make it more immersive and even more comfortable,” increasing its field of view (FoV) – as seen in the image above – vertically rather than horizontally. It’ll also come with a dimming feature that the CEO says is: “a first-to-market innovation that enables the headset to be used in brightly lit settings.”

Johnson is also keen to point out that the Magic Leap 2 aims to achieve the company’s goal of a device suitable for “all day, everyday use”. “All day” would be quite the achievement considering the Magic Leap 1 was good for 3.5 hours of continuous use. That could indicate a much larger battery, improved power consumption or hot-swappable battery for users.

Magic Leap 2

To help bring the Magic Leap 2 to market, Magic Leap has managed to raise an additional $500 million on top of the billions previously raised.

“This investment is an important step in advancing Magic Leap’s mission to transform the way we work,” said Peggy Johnson in a blog post. “With ongoing support from our existing investors, Magic Leap will have greater financial flexibility and the resources needed to continue our growth trajectory as we expand on our industry-leading AR technology.”

Magic Leap 2 is already in select enterprise customer hands via an early access program. Sales of the headset will begin at some point in 2022. For continued updates, keep reading VRFocus.

Magic Leap 2 Teased For 2022 With Taller Field Of View

Magic Leap teased the first images of its next generation AR headset, Magic Leap 2.

A blog post by Magic Leap CEO Peggy Johnson features an image, pictured below, comparing the field of view of the first and second generation AR headsets. While Magic Leap 2 seems to have small gains in horizontal field of view, vertically the augmentation of your vision should be far more significant with the new device. The company is said to have raised another $500 million to roll-out the second generation product focused toward business markets in 2022. “Select customers” are “already leveraging its capabilities through an early access program,” according to the company.

.

We can also see in the images of the new device that it apparently keeps its wired design. The original Magic Leap One headset shipped starting in August 2018 priced at $2,295 with a single handheld controller and wired computing puck accompanying the lightweight glasses.

magic leap 2

Here’s the first generation device for comparison:

Apple, Facebook, and Microsoft are just a few of the companies working to develop next-generation AR headsets geared toward different use cases. A new generation of VR headsets are also likely to have advanced AR passthrough modes likely to overlap with the feature sets of systems like Magic Leap 2. We’ll be curious to see, then, what price Magic Leap’s second generation system arrives at when it launches, and how it holds up against other products available at the time it ships.

“Magic Leap 2 will be the industry’s smallest and lightest device built for enterprise adoption,” Johnson wrote. “This more advanced headset boasts critical updates that make it more immersive and even more comfortable, with leading optics, the largest field of view in the industry, and dimming – a first-to-market innovation that enables the headset to be used in brightly lit settings, in addition to a significantly smaller and lighter form factor. These updated features lend themselves to achieving our goal of all day, everyday use, which is what the enterprise market has been asking for – a device that you can put on your head in the morning and wear all day long.”

Magic Leap appointed Johnson as CEO in July 2020 after former CEO Rony Abovitz stepped down, citing a need for the company to pivot to a new ‘focused’ direction.

CEO Shares First Details on Magic Leap 2, Announces $500 Million in New Funding

Magic Leap today announced that it has raised $500 million in new capital at a $2 billion valuation. This comes ahead of the launch of its upcoming AR headset, Magic Leap 2, which it promises will be smaller, lighter, and tuned to be an “all day” device.

New Capital

Magic Leap CEO Peggy Johnson took to CNBC today during the channel’s Power Lunch show to reveal that the company has raised a $500 million investment at a $2 billion valuation. The company didn’t disclose who participated in the funding round.

Magic Leap had previously raised some $3 billion for its hyped AR headset which didn’t see nearly as much traction as the company hoped for. It nearly fell apart last year, and had gone as far as announcing significant layoffs, before a last minute investment of $350 million allowed it to restructure. Shortly thereafter, Peggy Johnson took over as CEO, replacing founder Rony Abovitz, and began to pivot the company more heavily toward the enterprise sector.

The First Details on Magic Leap 2

Magic Leap 2 will be the first new product from the company since Johnson took the reins. In addition to announcing the new investment today on CNBC’s Power Lunch, Johnson also teased more about the new AR headset.

Most interestingly, perhaps, she said Magic Leap 2 will be an “all day, every day” device, thanks to a more compact and comfortable form factor. This is intriguing because—if “all day” is to be believed—it suggests the headset will have significantly more battery life than the three or so hours of the original Magic Leap headset.

“These updated features lend themselves to achieving our goal of all day, everyday use, which is what the enterprise market has been asking for—a device that you can put on your head in the morning and wear all day long,” Johnson wrote today in a post on the company’s official blog.

It remains to be seen how the company plans to achieve this however. A truly ‘all day’ AR headset would be a breakthrough in the industry, as it would allow persistent and seamless augmentation of the real world, rather than donning a bulky headset for select use-cases. However, Johnson may merely be alluding to the headset being comfortable enough to wear all day, but only if it remains powered off until specifically needed. Alternatively the new headset could now include a swappable battery pack.

But bulk and battery life isn’t the only barrier to true practical ‘all day’ use. In an image of Magic Leap 2 released today we can see that the headset will still bring a notable penalty to one’s own field-of-view, similar to the original Magic Leap headset which significantly truncated the real-world FOV.

Image courtesy Magic Leap

Johnson also claimed Magic Leap 2 will include a new “segmented dimming” technology which she says will allow the headset to be practical in brighter environments, like an operating room. She didn’t elaborate on how it worked.

Magic Leap 2 will also feature improved “color fidelity,” “text legibility,” and “image quality,” according to Johnson, as well as “double the field-of-view.” We take this to mean ‘double the area‘ which is less significant than doubling the diagonal field-of-view, but it would be an improvement none-the-less, likely bringing Magic Leap 2’s field-of-view on par with HoloLens 2.

Image courtesy Magic Leap

It looks like most of this increase comes, oddly, in the vertical direction, according to a depiction shared by the company, which Johnson claims is the “largest field of view in the industry.”

Magic Leap says it plans to launch Magic Leap 2 in 2022, though it says “select customers” are already using the headset through an early access program.

The post CEO Shares First Details on Magic Leap 2, Announces $500 Million in New Funding appeared first on Road to VR.

First Image of Next Magic Leap Headset Revealed

Magic Leap

After much hype augmented reality (AR) reality company Magic Leap launched its first device – the Magic Leap 1 – back in 2018. It didn’t quite set the tech world on fire, with the following years seeing plenty of upheaval including new CEO Peggy Johnson appointed last year. Today, Johnson has teased the first image of what’s likely to be Magic Leap 2.

Magic Leap enterprise

Johnson shared a post on Linkedin with a very cropped image of the new device saying that she’d be sharing further details on CNBC’s PowerLunch programme today. While the singular image doesn’t reveal a great deal, the new device certainly looks smaller and more stylish than Magic Leap’s previous generation AR headset. The form factor seems to be more in line with other AR hardware manufacturers, going for a more fashionable smart glasses approach to help widen its appeal.

Whilst it might not be the Magic Leap 2, information up to this point would suggest it is the follow-up device. The Microsoft and Qualcomm veteran joined Magic Leap back in 2020, announcing earlier this year that the initial rollout of Magic Leap 2 would take place by the end of 2021. At the time she said: “we’ve made the product half the size, about 20% lighter,” which would fit with this image.

Those in Magic Leap’s early adopter program will be given first access, slated to be in Q4, with general availability taking place in Q1 2022. Hopefully, today will see the company finalise some of those details and maybe even release a price for its next device.

Magic Leap
Magic Leap 1

Don’t expect it to be coming in at a consumer price point though. Magic Leap is still firmly focused on the enterprise market, encouraging businesses to utilise AR, whether that’s for training, collaboration, design or any other use case.

Most of the news out of Magic Leap in 2021 has concerned partnerships, from integrating NVIDIA’s CloudXR tech to teaming up with AMD. Most recently, last week saw Magic Leap and VMware announce Workspace ONE XR Hub integration on Magic Leap 2. As further details arise, VRFocus will keep you updated.