Watch What Developers Are Making With Snapchat’s AR Glasses

Snap shared a compilation of what developers have been building with its Spectacles AR glasses.

Spectacles was revealed almost a year ago. It’s a standalone device powered by Qualcomm’s XR1 chip featuring two cameras to perform spatial tracking of the world as well as hand tracking and video capture. A touchpad on the side can be used for precise input, and there are dedicated buttons for area scan & clip capture.

The displays have an impressive 2000 nits of brightness – 4x brighter than HoloLens 2 and 10x brighter than Magic Leap One – making Spectacles one of the only AR devices usable outdoors. However, the field of view is a tiny 26.3 degrees diagonal and the battery lasts just 30 minutes.

Spectacles aren’t a general purpose computer – you don’t build apps for them in a game engine. Instead they integrate directly with Snap’s existing AR platform, which has hundreds of millions of active users on smartphones. Developers build ‘Lenses’ – AR experiences – for both Spectacles & the Snapchat app using the company’s Lens Studio.

Over the past year Lens Studio has added new features, including speech recognition, 3D hand tracking, and (arguably) most importantly colocation- multiple Spectacles users in the same physical space seeing the same virtual objects in the same place, enabling multiplayer. Snap calls this Connected Lenses.

Spectacles is still only available to select developers – it isn’t yet a product consumers can buy. You can apply for Spectacles as a prospective developer on Snap’s website.

Snap Acquires Brain-Computer Interface Startup NextMind

Snap announced it’s acquired neurotech startup NextMind, a Paris-based company known for creating a $400 pint-sized brain-computer interface (BCI).

In a blog post, Snap says NextMind will help drive “long-term augmented reality research efforts within Snap Lab,” the company’s hardware team that’s currently building AR devices.

“Snap Lab’s programs explore possibilities for the future of the Snap Camera, including Spectacles. Spectacles are an evolving, iterative research and development project, and the latest generation is designed to support developers as they explore the technical bounds of augmented reality.”

Snap hasn’t detailed the terms or price of the NextMind acquisition, saying only that the team will continue to operate out of Paris, France. According to The Verge, NextMind will also be discontinuing production of its BCI.

Photo captured by Road to VR

Despite increasingly accurate and reliable hand and eye-tracking hardware, input methods for AR headsets still isn’t really a solved problem. It’s not certain whether NextMind’s tech, which is based on electroencephalogram (EEG), was the complete solution either.

NextMind’s BCI is non-invasive and slim enough to integrate into the strap of an XR headset, something that creators like Valve have been interested in for years. It’s also

Granted, there’s a scalp, connective tissue, and a skull to read through, which limits the kit’s imaging resolution, which allowed NextMind to do some basic inputs like simple UI interaction—very far off from the sort of ‘read/write’ capabilities that Elon Musk’s Neuralink is aiming for with its invasive brain implant.

Snap has been collecting more companies to help build out its next pair of AR glasses. In addition to NextMind, Snap acquired AR waveguide startup WaveOptics for over $500 million last May, and LCOS maker Compound Photonics in January.

Snap is getting close too. Its most recent Spectacles (fourth gen) include displays for real-time AR in addition to integrated voice recognition, optical hand tracking, and a side-mounted touchpad for UI selection.

The post Snap Acquires Brain-Computer Interface Startup NextMind appeared first on Road to VR.

The VR Job Hub: Bithell Games, Warpin Media, Gizmodo, Mozilla & More

Every weekend VRFocus gathers together vacancies from across the virtual reality (VR), augmented reality (AR) and mixed reality (MR) industry, in locations around the globe to help make finding that ideal job easier. Below is a selection of roles that are currently accepting applications across a number of disciplines, all within departments and companies that focus on immersive entertainment.

Location Company Role Link
Remote/UK-based Bithell Games Lead Artist Click Here to Apply
Remote/UK-based Bithell Games 3D Character Artist Click Here to Apply
Remote/UK-based Bithell Games Character Concept Artist Click Here to Apply
Remote/UK-based Bithell Games Environmental Concept Artist Click Here to Apply
Remote/UK-based Bithell Games Senior Animator Click Here to Apply
Remote/UK-based Bithell Games Designer Click Here to Apply
Remote/UK-based Bithell Games Marketing Manager Click Here to Apply
Remote/UK-based Bithell Games Senior Programmer Click Here to Apply
Remote/UK-based Bithell Games Console Programmer Click Here to Apply
Stockholm, Sweden Warpin Media Senior XR Developer Click Here to Apply
Stockholm, Sweden Warpin Media 3D Artist Click Here to Apply
Stockholm, Sweden Warpin Media UX/UI Designer Click Here to Apply
New York, Gizmodo Staff Reporter (VR) Click Here to Apply
Remote US, Remote Canada Mozilla Hubs Community Manager Click Here to Apply
Remote US, Remote Canada Mozilla Hubs Lead Frontend Software Engineer Click Here to Apply
Los Angeles, CA/ New York, NY Snap Inc. Snap Lab Product Designer, Wearable Experiences Click Here to Apply
Toronto, ON, Canada Dark Slope Studios 3D Modeller Click Here to Apply

Don’t forget, if there wasn’t anything that took your fancy this week there’s always last week’s listings on The VR Job Hub to check as well.

If you are an employer looking for someone to fill an immersive technology related role – regardless of the industry – don’t forget you can send us the lowdown on the position and we’ll be sure to feature it in that following week’s feature. Details should be sent to Peter Graham (pgraham@vrfocus.com).

We’ll see you next week on VRFocus at the usual time of 3PM (UK) for another selection of jobs from around the world.

Snap Acquires AR Display Startup WaveOptics for Over $500M

Snap Inc is making some definite strides into augmented reality territory as of late. It not only announced yesterday that its next-gen version of Spectacles will be a AR device, but it’s now come to light that the company is acquiring WaveOptics, the startup behind the AR optics within the Spectacles themselves.

As confirmed by The Verge, Snap has agreed to acquire the UK-based startup. The reported sum is “over $500 million.”

WaveOptics, which is said to employ 125 people, is reportedly now working under Snap’s hardware division. The Verge reports that Snap is providing half of the acquisition price in stocks, and is reserving the option to either pay in cash or stocks after two years.

Founded in 2014, WaveOptics makes waveguide optics, micro projectors, and full AR modules. Its waveguide tech can be found in many AR headsets such as Rokid’s Project Aurora headset, which includes WaveOptics chassis and optical modules.

4th Generation Spectacles | Image courtesy Snap

More recently, WaveOptics showed off prescription waveguide lenses built in partnership with Luxexcel, a UK-based 3D printing company focused on transparent materials.

A Snap spokesperson confirmed that WaveOptics will both continue operations to supply other companies with its tech whilst working with Snap on custom AR optics.

The 4th-generation Spectacles are being shipped out in relatively low numbers to developers. A reported 1,000 units are supposedly going out to interested devs, so there’s still a long ways to go before Snap starts pitching AR to consumers.

The dev kit has also made some clear compromises to reach a lightweight form-factor; it has a 26.3° diagonal field-of-view—much smaller than HoloLens 2’s diagonal field-of-view of 52°—and only has a 30-minute battery life. Obvious areas in need of improvement aside, the acquisition of WaveOptics is a flag in the sand for Snap. It’s setting itself up to be in direct competition with Google and Facebook as those companies reveal further working on their own respective consumer AR headsets.

The post Snap Acquires AR Display Startup WaveOptics for Over $500M appeared first on Road to VR.

Snap Is Acquiring WaveOptics, Its AR Display Supplier

Snap is buying WaveOptics for more than $500 million, The Verge reports.

WaveOptics is a UK-based company founded in 2014. It supplies transparent optical waveguides and accompanying projectors.

Snap, the company behind Snapchat, revealed its first AR glasses yesterday, with WaveOptics displays onboard. While the field of view is much narrower than headsets like HoloLens & Magic Leap, the display is much brighter so can be practically used outdoors.

Spectacles

The Verge report claims the roughly 125 person team at WaveOptics will now report to Snap’s hardware vision, but will continue to supply other companies while working to build custom optics for Spectacles.

Back in 2018 Apple acquired Akonia Holographics, a startup working on holographic waveguides. Facebook has spoken of developing custom waveguides, and last year acquired a key microLED display supplier. Microsoft works closely with MicroVision for its HoloLens range. All three have spoken of plans to ship consumer AR in coming years.

As the specs of Spectacles show, AR is still a very early technology. There are still huge technical hurdles to overcome to appeal to a broad consumer market – hurdles that could take the better part of this decade overcome. Companies like Snap are preparing now to shape this new landscape – or at least to not be left behind.

Snapchat’s 4th-generation Spectacles Are Its First to Support AR

Snap Inc, the company behind Snapchat, today announced its 4th generation Spectacles glasses. While the prior generations included only cameras for capturing first-person footage, the 4th generation Spectacles are the company’s first to include a display for real-time AR.

Also unlike previous versions of Spectacles, the 4th-generation is not currently available for sale. Snap is positioning this version of the AR glasses as a development kit for creators to begin experimenting with building AR experiences for the device.

Unlike Microsoft or Magic Leap’s approach—which have traded some bulkiness for greater capabilities—Snap is taking a form-over-function approach by starting with a form-factor that consumers would find reasonable, even if that means paring down some of its capabilities. Here’s a look at the 4th-gen Spectacles’ specs (including which critical info we don’t yet know):

Snap Spectacles (4th-gen) Specs
Resolution Unknown
Refresh Rate Unknown
Lenses Unknown waveguide (2,000 nits)
Field-of-view 26.3° diagonal
Optical Adjustments Unknown
IPD Adjustment Range Unknown
Processor Snapdragon XR1
RAM Unknown
Storage Unknown
Connectors USB-C
Battery Life 30 minutes (case holds up to four charges)
Tracking Inside-out (no external beacons)
On-board cameras 2x RGB
Input Touchpad, voice, hand-tracking
Audio Internal speakers
Microphone Yes (4x)
Weight 134g

As you can see, the compromises to reach this lightweight form-factor were not inconsequential. Notable is the miniscule 26.3° diagonal field-of-view. To put that into perspective, a small field-of-view is among the chief complaints levied at HoloLens 2—and it has a 52° diagonal field-of-view.

But hey, props to Snap for making an effort to show how limited the field-of-view is in its promotional materials. In the reveal video above, the company very intentionally showed six individual shots illustrating both a limited field of view and an approximation of the  transparency that you’d see through the glasses. Respect.

Image courtesy Snap

It’ll be a serious challenge for developers to squeeze meaningful applications into that tight field-of-view without making the user feel like they need to hunt around the scene just to spot the content through the tiny window.

The other big point in the specs is the 30 minute battery life, which will make them feel more like a dedicated-use device than something you use because you just happen to be wearing it. The battery-case, which can hold up to four charges, offsets that pain a bit (hey, you don’t wear sunglasses all day anyway). Even as battery life improves in the future, the battery-case is a smart idea that I wouldn’t be surprised to see in the cases of other AR glasses going forward.

Clearly these are both major reasons why Snap isn’t ready to sell these AR glasses to the public, as it has done with its prior Spectacles. In time we’ll see these capabilities grow and eventually make future Spectacles practical for end-users.

As for actually building content for the 4th-gen Spectacles, Snap is of course relying on its Lens Studio software which has long allowed developers to build AR experiences for use with phones on Snapchat.

According to a piece by Wired, Snap plans to send out around 1,000 of its AR glasses to developers. If you’re interested, you can apply to get your own at the bottom of the official 4th-gen Spectacles website.

The post Snapchat’s 4th-generation Spectacles Are Its First to Support AR appeared first on Road to VR.

Snap’s Lens Studio Now Supports Custom ML-powered Snapchat Lenses

Over the past few years, Snapchat’s growing collection of Lenses have been some of the best examples of smartphone-powered augmented reality, enabling users to effortlessly add facial modificationsenvironmental effects, and location-specific filters to their photos. Now parent company Snap is enabling creators to use self-provided machine learning models in Lenses, and hoping the initiative will inspire partnerships between ML developers and creatives.

The latest key change is an update to Lens Studio, the free desktop development app used to create most of Snapchat’s AR filters. A new feature called SnapML — unrelated to IBM’s same-named training tool — will let developers import machine learning models to power lenses, expanding the range of real world objects and body parts Snapchat will be able to instantly identify. As an example of the technology, Lens Studio will include a new foot tracking ML model developed by Wannaby, enabling developers to craft Lenses for feet.

Beyond Wannaby, developers including CV2020, visual filter maker Prisma, and several unnamed Lens creators are also working on SnapML-based filters. Lens Studio has also added new hand gesture templates, as well as Face Landmarks and Face Expressions that should improve facial tracking for specific situations. Additionally, the user-facing Snapchat app will be expanding its Scan feature with the abilities to recognize 90% of all known plants and trees, nearly 400 breeds of dogs, packaged food labels, and Louis Vuitton’s logo, plus SoundHound integration to let users find pertinent Lenses using only voice commands.

Snap is also previewing a new feature, Local Lenses, which will “soon” let users share persistent augmented reality content within neighborhoods. Local Lenses promises to create large-scale point clouds to recognize multiple buildings within an area — an expansion of the company’s prior Landmarking feature — to map entire city blocks, the same vision pursued by companies such as Immersal and Scape (now owned by Facebook). Unlike rivals, which have focused primarily on mapping and marketing applications, Snap plans to let users change the look of neighborhoods with digital content.

While the technology behind the feature is fascinating, the way Snap is promoting it today feels somewhat awkward given current social unrest over the Black Lives Matter movement. The company says Snapchat users will be able to “decorate nearby buildings with colorful paint” that will be visible to friends. Though its sample video is far more like Nintendo’s Splatoon than Sega’s Jet Set Radio, using large splashes of color rather than written words, we’ll have to see whether Local Lenses are used solely for positive purposes, or are steps towards AR graffiti similar to what’s currently appearing in real cities as protests continue.

This post by Jeremy Horwitz originally appeared on Venturebeat. 

The post Snap’s Lens Studio Now Supports Custom ML-powered Snapchat Lenses appeared first on UploadVR.

Snappables Brings Multiplayer AR Games To Snapchat

Snappables Brings Multiplayer AR Games To Snapchat

Snapchat users can now play AR games, with friends,  using the platform’s powerful lens and filter features. The update will roll out to users gradually over the course of this week. Some games will have a high score leaderboard, while others let you invite friends to play games directly together.

In the quick teaser below you can see lots of people making funny faces at their phones because that’s the world we live in now:

According to the blog post from this week, users can expect to see games that let them “fight aliens, start a rock band, play basketball, and more — together with your friends, no matter where you are,” with new games releasing each and every week. As someone that hasn’t used Snapchat in months due to the prevalence of Instagram and Facebook now featuring similar mechanics, this is something that would absolutely bring me back to the platform as a gamer that loves using mixed reality.

To play Snappables games all you have to do is click on the background of a photo or video, just like you’re about to use a Lens, but these will be on the left of the camera instead of the right.

Let us know what you think of the idea of AR gaming with Snapchat down in the comments below!

Tagged with: , , ,

Report: Snap Acquires Browser-Based Game Engine PlayCanvas

Report: Snap Acquires Browser-Based Game Engine PlayCanvas

Snapchat’s parent company Snap’s latest acquisition could mean big things for AR content on the popular app.

Business Insider reports that Snap last year acquired PlayCanvas, a London-based startup with its own game development engine. Interestingly, though, the middleware runs entirely from the web using WebGL, allowing developers to configure 3D assets and entire game worlds without having to download anything. I actually remember seeing the system at work back in 2015 and being impressed by its versatility. The value of the deal has not been revealed.

Obviously, developers aren’t building full games for Snapchat, but the app has been placing increased focus on third-party assets for use in AR of late with the launch of its Lens Studio system (which has been used by groups like We Rate Dogs).

While PlayCanvas’ website doesn’t mention Snap, it does claim that the engine provides the “easiest way to build web-based AR and VR experiences.” Companies like Zynga, King and Nickelodeon have all used the platform in the past.

Tagged with: , ,