A new app called Brushwork VR offers a way for users to simulate painting on a canvas in VR with any headset that supports immersive WebXR browser experiences.
The experience can be launched from your headset at BrushworkVR.com and should work on any WebXR-support headset browser, including Quest 2 and many PC VR headsets. It’s entirely free to use, quite comprehensive and offers a fair amount of customization and options.
In terms of canvases and paint brushes, there’s a variety of sizes of both to choose from. As you would hope, the paint from the brush seems to react fairly realistically when dragged along the canvas. You can pick up and hold brushes at any angle, and put them into two modes — one adds a new layer of paint on top and another allows you to mix between colors. You’re equipped with a palette to your left, which you can use to mix colors together and find the exact right shade to go onto the canvas.
Your paintings can be saved and resumed later on, as well as shared with others via a code that can be entered into the Brushwork VR website. You can also upload a reference image via the website when on the same network as your headset, which will be loaded into the app for you take work alongside.
The developers at Sunset Division say that more than 25,000 paintings have been completed using the app since launch 2 months ago. More recently, the developers say that they’re seeing people working on more than 1,000 paintings a day.
Diego Marcos is one of the most important figures in WebXR’s story so far.
At Mozilla he helped kickstart the WebVR standard, which then became WebXR.
He co-created A-Frame, an open source library to create VR experiences on the web, and remains its lead developer, maintainer, community manager. Marcos now works at Supermedium, a company he co-founded in 2018, developing WebXR showcases and a new kind of browser for VR headsets.
We sat down with Diego in our virtual studio to talk about all of the above, and the future of WebXR as an approach to immersive content in general:
https://youtu.be/wLNpec9gnhc
“I’m Diego Marcos main maintainer of A-frame, a framework to develop VR experiences on the web. So anyone that has any web development knowledge, the idea is that they can pick it up and start developing VR and AR content in the same way that they are used to developing web applications.
I used to work at Mozilla. I was part of the team that started the WebVR initiative. For those that don’t know, what is called now WebXR used to be called WebVR. That was the first API and standard that we developed at Mozilla. When we released it, other companies jumped in and joined the initiative like Samsung and Microsoft and Oculus and the scope of the API grew to incorporate AR use cases also.
WebXR is this set of APIs that the browsers implement in order to add VR and AR capabilities to the websites. Within that team I was working more on the front end and tools part of it and an A-frame was/is one of those initiatives to enable and to empower all web developers out there to start developing AR and VR content.“
Talk us through that year where WebVR came out of Mozilla. What was the initial feeling there and how did that progress to browsers?
“It was early 2014. I was working on FirefoxOS. If you remember, FirefoxOS was an operating system for smartphones that was built on web technologies – everything from the developer APIs to the front end of the browser, all the first party applications.
I was part of the mindset of that time: so we have this cool stack of technologies, what other spaces can we apply the same philosophy of openness, not walled gardens, like open ecosystems and open standards? At the time I was very interested in VR in my spare time. I had that first DK1 and then a DK2, and one of the very first kind of Vive developer kits. And I was tinkering on the side with VR. With a couple of colleagues – Josh Carpenter, Kevin Ngo, Casey Yee – we had matching interests and we decided to start prototyping some things and to sell the idea within Mozilla and the idea got momentum and then we formed the team, to fully focus on VR. And one of the things that came up from that was the first draft of the WebVR API.“
FirefoxOS on smartphones – an OS that’s built up from the ground for web content – some people have said this idea would seem like it would work quite well in VR. Do you see that happening? Have you heard of anything in that sense, sort of going away from installing apps and having all these fragmented systems into a headset that you boot into WebXR and you browse around and an open web?
“So there’s several, several schools of thoughts in that space. One is that the web always has a space in any platform – it doesn’t compete, but complements native. The web is very well suited for that kind of bite-sized content. The kind of content that you would actually have a hard time convincing someone to install an app, because it’s got fast consumption. Let’s say you want to read a quick article about something and it comes with some VR piece of content that illustrates the information. So you will then install an app to consume just one article? So WebXR is for those use cases. You can just share that article via a link. You just click a link and immediately without downloading anything you are inside the experience, consuming that information.
On the other hand, the FirefoxOS approach was like more of a holistic approach. It’s like, OK we have these very set of cool standards and APIs: we could actually build the whole system and platform using web technologies. So far we haven’t seen that in the VR and AR space, but I think there’s potential for someone to offer a different approach. Instead of building another kind of closed ecosystem, walled garden, they could approach building a headset based on standards and open technologies.
The first approach, the web complementing the native, ecosystem is materializing already because in the Oculus Quest we have an amazing browser. The Oculus folks are doing an excellent job at pushing the web forward and have a top implementation of the APIs and a top browser for people to access that content.
The holistic approach we haven’t seen it yet, and I would love someone to tackle it.“
If we look at the VR ecosystem today, WebXR seems to still be stuck in that kind of bite-sized content showcase. Why do you think that is? And what do you think needs to happen until we start seeing some of the most popular VR experiences be built on WebXR?
“That’s a question that doesn’t have a single answer. It’s complex. First of all, WebXR is still very young. We’ve been talking for many years about it, but it was not until early 2020 that actual browsers started to ship the final API. So it’s still very, very young. And since VR and AR has been focused on games, there’s a lot of inertia and the industry is built on certain workflows and certain tools that people learn over the years. When you develop for the web, it requires some retraining. People have to retrain and learn new tools and new patterns to develop content.
The second thing is monetization. The gaming focus of VR also implies the way to make money – you develop your video game, you put it on a store and you charge some money for that piece of content. This doesn’t apply as well on the web. If you see the way that people make money on the web today, either you have advertisements or you have some sort of subscription model – those are not that common in the video game space.
What I’m convinced is that it’s not that technology problem anymore. Because we have the standard, the final WebXR standard shipping in browsers. So all the technology pieces are there, it’s more of a problem of educating and for people to learn how to take advantage of the potential of the web. I think it’s going to happen, but as always in technology, things always take a bit longer. Especially if you’re an early adopter and you feel ‘I’ve been here for five years’, but when you see things at a global scale, people are starting to learn. Most people are still surprised that you can actually consume AR & VR through the browser. Most people are still not aware of that.“
That monetization issue is something we’ve certainly heard from developers when asking them their thoughts on this. Do you think the Web Payments API is going to change that? What I’ve always wondered and hoped for is that we’d see the Oculus Browser adopt that API, such that if I go to purchase something in the Oculus browser, it’ll bring up that same pin code as when I’m purchasing a native app.
“Yep. They are in a position to actually solve it because they have control of the platform underneath and also the browser – they could tie at both ends. I guess in those ecosystems, like Android or iOS or Oculus Quest, there’s always this tension between native and web, what cases would prioritize the web over native, or the other way around. I imagine there’s tons of internal discussions around it.“
It feels like there are parallels to when modern smartphones launched. At the start of the iPhone you had this native SDK and there was kind of lip service to support for web apps, but often Apple prioritized bringing features to native first and made web apps second-class citizens. Do you worry that Facebook will go down the same path, in that they have a financial disincentive to make the web work when they’re making all this money from the native store?
“This is just my guesses, I don’t have any internal knowledge: Apple, their roots are full control of everything right? From the bottom to the top, like from the hardware to the software. For them, the web feels like something foreign. They don’t speak the web language. But I have high hopes about Facebook because Facebook is the epitome of web success, right?
So Facebook truly understands, it has the web in its DNA. And hopefully they will be able to figure out and introspect: oh, actually, do I be awesome, right!?“
Do you think WebXR needs Unity and Unreal to add WebXR export, or do you think that the existing web development tools are sufficient, that they can create this ecosystem without support of these big engines?
“People that are involved in native development with Unity and Unreal, those people are in their own kind of bubble and they don’t care that much about the web. It’s mostly people that are already on the web that see the potential in those new technologies, like WebGL and WebXR and say: now I have this whole new world for me to create new stuff, right. It was not possible before.
This is our goal with A-frame, the goal was not that much as convincing people that do native to come to the web, but enabling people that are already on the web, know the value of the web and know how to use the web, enabling these people to create VR and AR content.
The support of native engines would be super welcome, and that would be very easy for some people that don’t participate in the web to enter the space, but I don’t think is required.“
Can you talk about, both from a development perspective and an end-user perspective, some of the advantages for VR apps that are on the web rather than native apps?
“The advantage of the web is immediacy, right? You can just share a piece of content via a link and you click and immediately you are consuming that piece of content. That’s an advantage from the user’s point of view, that immediacy and not having to install the content in order to consume it.
From the developer’s point of view, it’s that full control of your own work. So you don’t have to ask for permission and you don’t have to pass a curation process or approval process to get your application out there. And you can just publish and based on its own merit, users will tell if your content is good or not.
That’s really needed because we don’t know yet what the killer app of VR and AR is yet. Oculus doesn’t know, people that curate the store don’t know. I don’t know. When the web was born, we didn’t know. No-one anticipated Twitter or Facebook or anything. We need as many people as possible developing stuff, trying out ideas and see what happens.
Also from the point of view of developers, you don’t have a gateway , as I mentioned before, to make money, that’s the downside. But on the upside, it’s your business. Nobody is going to take 30% or 20% or 15% of your revenue. And things will last forever, right? You can visit websites made in the ’90s that still work. If I publish an app today on iOS, in three years if I don’t update that app it won’t work anymore. So it has this property of archival, because web standards, once they ship the browsers don’t remove APIs. So anything that works today is going to work in 10 years.“
That’s a really great point because we’ve already seen so many in the industry notice that this Oculus Go and Gear VR and Daydream content, is already lost to history. And that was only just a few years ago. What may make WebXR the preferred way to make VR apps is that you have this kind of separation of the content and the engine. The browser is the engine that is a living thing. If someone releases a native VR app they’re using the version of Unity or Unreal that was in their day and 10 years later, the fundamental technology of it will be outdated.
“Even experiments I was doing in 2014, I can just grab the code. Obviously there was a bit of churn there, WebVR was not still standard, but with a few tweaks here and there I can make it work in an afternoon. It has a ton of value!“
You talked about one of the big challenges here being bringing developers on board. What do you think is missing in the current web and WebXR development ecosystem? What tools or frameworks or ideas or tutorials do you think are the missing pieces that we really need to move into the next phase of the WebXR ecosystem?
“That’s a good question. With A-frame we are trying to solve that issue. There’s millions of web developers out there that don’t have the skillsets, or are not even aware that they can develop AR and VR content. And our goal is to educate and provide tools to these people that resonate with their workflow. Our background is also as web developers so we understand that mindset. We understand those ways of doing things and it’s much needed.
If we want this space to flourish, we need to onboard as many web developers as possible. So we need more and more tools that resonate with them, not trying to convince as much native developers, because they already have a workflow that works for them and they love their tools. And those are amazing. This is a matter of enabling existing people that already love the web that are not aware or don’t know how to develop VR and AR content. If we only convince like 5% of that audience of millions of developers, the space will bloom!“
In the longer term do you think native developers could be brought in too as the advantages of this decoupling of the engine and the content is becomes more apparent over time?I don’t think the general audience are going to enjoy downloading apps to join their friends and an experience, and I think if people can deliver these kinds of rich experiences where getting to your friend and an entirely different experience is just one tap away… do you see that displacing native engines in the long-term?
“Indeed as there’s the potential to displace native engines. I would love native developers to come to the web. It was like a more a practical way of approaching because it’s much easier. With A-frame I go and talk to a web developer. It’s like, oh you like to use Node or Webpack or React or Angular. You like all those tools so I can give you an engine to develop VR and AR content, it can integrate with the tools that you already know. It’s a much easier path to onboard those people versus going to native developers and saying, okay leave all your toolsets on the side. I’m going to teach you these all new things.
It’s a much harder task to convince native developers, but eventually if, WebXR flourishes, the value of it will become obvious for them. And I’m convinced they will see the value as we make progress.“
Over time, do you see A-Frame focusing in on this just-above-WebXR level in the stack functionality, or do you see higher level things over time that do more and more for the developer?
“Yeah I think we need both. We see this less and less now, but at the beginning most of the web developers jumping into AR wanted to do a video on 360° photos. That was the main use case. And they were demanding, all I want to do is do like a tour of 360° video or pictures. And for these people it would have been very convenient to have these high level tools. Visually oh I have all these 360° pictures bonded together and link those pictures in this way and add a little bit of text here and there and having high-level tools for them to build those tours would have been very useful and convenient for them.
It’s a bit premature because those categories of content are still not super defined in VR. Sometimes the value of the experience is in the nuances of the interaction model. In those cases you want to have a lot of control, and to have a lot of control you need tools that allow you to customize those interactions in a very detailed way. So you will also need category of low level tools that allow you to open the box and customize the way you want. With A-Frame we’re trying to tackle this middle ground. So it’s very approachable and you can get something going in a minute, like put like a 360° video or a 360° panorama, you can do it in a minute and you can publish that in a minute and share it with your friends via Twitter in a simple link. But at the same time, you can actually open the box and look inside and deepen your knowledge.“
Did you see that kind of ability to modify and change bring all these different frameworks together being a really important in WebXR’s future?
“So I learned how to develop and program using the web. And I think most people started in the same way, right? You see a website you like, you wonder: oh, how is this made? And in the web you always had the ability to open the developer tools that come built-in with a browser.
I know this is a CSS property that changes the color of this button, and you can also inspect the JavaScript and figure things out, how things are built. And there’s a lot of value in learning from others. And you have some ability to access the insides and learn how it’s built. It’s not a black box as an engine can be.“
How important do you think it is that any WebXR application by its nature has access to the existing web of 2D content. We always hear people wondering where the metaverse is, and there’s this kind of core assumption that it’s going to be this one native app that provides everything in one. But isn’t it arguable that the web already is this and that the metaverse will simply be the extension of the web into these new platforms – and as long as you have multitasking in WebXR, an environment where I can bring up a 2D browser tab here and Discord there, isn’t that the metaverse? Do you see that as the metaverse it itself?
“The web is already the metaverse, we just have to make it 3D. That is what we used to say at Mozilla.
VR and AR is another kind of media, and the web already does text and does images and does video and audio. But now I can do also VR and AR. So yeah, it’s a multimedia environment and it’s up to the browser. This is why we started Supermedium, the company, that was our goal. OK, we have 2D browsers it’s clear what a 2D browser is, we settle on those UI patterns. We have a window with a URL bar on the top and maybe some tabs, and you can switch between different open websites.
But we don’t know if that pattern translates to VR. And if we get rid of the frame on the window, how can we access the web and different pieces of the web, in VR and AR? We haven’t discovered how it’s going to happen. But yeah, what you were saying is the technology is already there, it’s a matter of someone to put those pieces together in a way that makes sense.
And I think native applications, they will have far much harder time to replicate all that functionality because they will have to reinvent the wheel, right? They will have to figure out all the things that the world has figured out already over 30 years, they will have to reinvent not only those pieces, but also convince developers and content producers to adopt this new way of doing things and convince them that this is better than the actual web.
In the WebXR experiences I’ve tried performance is equal to native apps, but there is this perception out there that WebXR is still slow. How do you fight that perception? What do you think the path forward there is to get sort of consumer and developer trust in the performance of the web?
At Mozilla we always struggled with that kind of perception that in many cases is a myth. Once the opinion has settled in people’s head it’s very hard to convince them otherwise to change their minds. There’s tons of metrics and statistics and profiling of browsers and applications showing them all actually works.
But at some point we decided we are wasting our time. The better way to convince people is to show. If you’re able to show a piece of content that performs well and users enjoy, that’s undeniable, right? That was our goal with Moon Rider – try to get the most beloved piece of content out there, Beat Saber, and try to replicate this piece of content with web technologies, just as a proof, as a tangible proof that the web is ready to deliver compelling content. If you are willing to put some time to profile, to tune the performance in the same way that you see in the apps that are published on the store.
You don’t see the experimentations that people do on native because they are very hard to share. Those are hidden. So you don’t see all the things that don’t perform. You don’t see the things that are full of bugs back because people don’t share them, but those things are exposed on the web. Because as soon as you feel some pride of something, when it’s something you made, you’re going to tweet about it and people are going to click on it and they are going to see.
Moon Rider was out there for 18 months and it has like three or four thousand daily active users and more than 16 minutes average session – people love it and people use it.“
What are your thoughts on the future of WebXR, A-Frame, and and the entire web ecosystem going into the spatial computing age?
“I’m super excited. A couple of years ago I was getting impatient, because it seemed like we started the first version of the standard in 2014 and we were in late 2019 and I was thinking: oh it’s been five years and the standard has not yet shipped. I was kind of getting a bit antsy.
But once the standard shipped, everything fell into place. We have this done there. We saw Quest and the Oculus folks that are doing amazing with the browser also shipping the new standard and everything kind of clicked. And you see new headsets that like Magic Leap also has had a very nice good effort trying to push the web to develop content. And you have the HoloLens folks doing an excellent job also incorporating the WebXR APIs in their browser. Everything is clicking right now and it’s a matter of volume. As more headsets and devices get released and as more people get onboard using VR and AR headsets, I think the web is ready. It’s just waiting for someone to take advantage of it, and for the potential to manifest for everybody.
I’m super super optimistic. And this only happened like since 12, 15 months ago. Because I truly think like I used to say, you have to wait till we finish the standard. You have to wait till all the browsers ship. But those things are done already, and it’s there. The web is your oyster now. So I’m super, super happy and super pumped about what’s coming.
Now the next frontier is AR. The Google folks, they are doing an excellent job at incorporating AR features into the WebXR standard. And we see some initial moves and some interest from Apple in the standard, and also some rumors that maybe they might enter the space. I’m super pumped about what’s going to happen there too.“
Do you think the industry needs Apple to really support WebXR in full, or do you think it’s fine if Apple remains with its stance of native-first?
“I think Apple entering this space is going to grow the pie, both for native and the web. This is going to make people to really take seriously AR and VR and is going to raise all the boats, right? Like both native and web. And for those companies that are invested or are investing in VR and WebXR right now, but it’s more like an experiment, may justify going full on once Apple enters the space and matures the industry. I think the web is gonna flourish with it regardless of how seriously Apple takes it.
People criticize Apple a lot, how Apple approaches the web. I’m mostly a Windows user, but when I’m using Mac I’m always surprised how good Safari on desktop is compared to alternatives. You cannot claim that Apple doesn’t care about the web. They kind of always take different paths or put the web on a second plane, because the way they make money doesn’t align that much with the web, but eventually they always come around and they put something out there that is really, really good.“
Diego, it was an honor to have you in the studio. The future of WebXR seems bright.
A new streaming technology, Hyperplane, allows traditional games to be broadcast in 3D to virtual arenas, where VR users can watch traditional matches play out around them in 3D, as if they were really there.
Hyperplane was founded by an ex-Oculus and an ex-Google employee, with Y Combinator providing funding as part of its latest W21 batch.
The technology is a proprietary 3D live streaming pipeline, which includes a custom file format, a player and recording software. The developers compared it to a 2D livestream running through OBS, but for 3D broadcasts. This allows VR users to watch a game in its native virtual environment from multiple angles. It is similar to watching a football match at an arena, but with video games and in VR. A couple years ago Vreal raised big money for a similar idea that was tied to tethered PC VR headsets and a handful of games before the startup ran out of cash in 2019. Hyperplane is banking on the idea that now the timing is right, with the growing popularity of standalone VR systems like Oculus Quest, for live-streaming technology that can show any 3D game on any Internet-connected device.
Hyperplane is designed for livestreams, however you can check out this pre-recorded demo of a Super Smash Bros Melee match as an example of what the technology can do. The demo can be opened in any VR headset using WebXR, allowing you to spectate the game from within VR as if you’re actually in the environment. Do remember it’s an early look at the tech – rendering is incomplete and so characters appear as ghostly silhouettes and there wasn’t any sound when we tried it.
Being broadcast in 3D allows you to move around the action and view everything from different angles. This is in stark contrast to many other 2D livestreams in VR, such as NBA matches in Oculus Venues, which are broadcast onto a large screen in a virtual environment.
It’s still a work in progress, as pictured in the screenshot above, but it does give a sense of where it’s headed. Eventually, you can imagine how multiple people could all watch a live esports match in 3D using VR, with multiple viewing angles and full effects and textures from the game.
To experience Hyperplane yourself, you can join the Discord server or keep an eye on Twitter for when a stream is live. The next stream is scheduled for Monday the 29th of March.
For now, support will be limited to traditional, non-VR games. However, Hyperplane told UploadVR that there are plans to eventually support VR games as well, citing Ironlights and Swords of Gurrah as the type of VR game that would work well with the 3D viewing environment.
The focus is on hosting Super Smash Bros tournaments for now, with intent to support other fighting games and MOBAs later in the year. It’s currently in closed alpha and the developers say there’s another 2 months worth of development before any public release.
There are a multitude of ways you can build virtual and augmented reality (VR/AR) content, with engines like Unity, Amazon Sumerian or Unreal some of the most popular. But if you want to avoid curated app stores and utilise WebXR then Wonderland Engine caters for that exact scenario. Today, the platform is dropping its subscription model, moving to a royalty-based license model so creators can download it for free.
Wonderland Engine is entirely focused on web-based VR and AR applications, making it easy for creators to publish online without needing to support a particular headset. When the platform launched in 2020 it offered a 30-day trial after which it charged users a monthly fee. This system has now been changed after customer feedback.
In a blog post, Wonderland Engine CEO Jonathan Hale wrote: “the feedback we got was that 30 days is not enough to learn a new development platform, let alone prove its value. And that the cost of learning the engine together with the cost of the license after those 30 days was too high for many.” With the free model, Wonderland Engine will now be more accessible to those wishing to delve into WebXR. Once they’ve launched a product a 10% royalty on revenue will be charged, similar to other videogame development engines.
The platform is based around the Wonderland Editor, a WebAssembly based runtime that runs in a browser. You can import GLTF, FBX and other files into scenes, add text, animations and JavaScript components, whilst offering <1 second packaging time with automatic Browser reloading.
Wonderland Engine is still in early development itself, with v0.8.0. releasing last month adding new features like physics-based on Nvidia PhysX 4.1 and experimental WebAssembly SIMD support. If you already happen to be a subscriber then you’ll receive a refund for any uncompleted months. The team does note that if the royalty model doesn’t suit your particular needs then custom terms can be negotiated.
As Wonderland Engine continues to roll out further updates, VRFocus will let you know.
Google stopped active development on Tilt Brush late last month, but also made the VR creation suite open source so anyone could get under the hood. We’ve seen a number of clones already, but this is the first port we’ve seen that lets you access directly from a WebXR browser.
Dubbed Silk Brush by developer Daniel Adams of msub2, the app is a near 1:1 port of the original, replete with all default brushes, the ability to save and load sketches, take snapshots, and even export to .glb.
To poke around in Silk Brush, simply open this page on a WebXR-compatible browser and hit the ‘VR’ button. If you’re on Oculus Quest, simply use the default Oculus Browser in-headset. If you’re on a Windows PC, you can fire up the included Chromium-based Edge browser which natively supports WebXR.
One neat feature is the ability to download your sketches, models, and snapshots in your local storage. You can do this by heading to this page and choosing which item to directly download.
Granted, performance, even on the beefier Quest 2 is still a bit shaky, although it’s completely playable. As predicted, it’s much more stable on a VR-ready PC, either played through a dedicated PC VR headset or Oculus Link.
Google’s VR art creation app Tilt Brush isn’t free, but the company made it open source a few days ago after announcing it has stopped active development, so it was only a matter of time before independent developers got under the hood to publish their own Tilt Brush-derived apps. Now you can play around with the first batch on PC VR and Oculus Quest.
Open Brush – PC VR
Developer Icosa Gallery has published its own fork of the Tilt Brush software, dubbed Open Brush. Although there’s a few missing features for now, notably the ability to use the eraser, Open Brush is already enabling some of the hidden brushes that Google never released before shelving the project.
You can download the experimental build of Open Brush over at Itch.io for free, and get painting through SteamVR-compatible headsets right now.
Icosa Gallery says there’s also a Quest version in the works, however it’s not ready just yet.
SideSketch – Quest
If you own an Oculus Quest or Quest 2, you can also test out the latest third-party clone from developer Shane Harris, called SideSketch.
Image courtesy Shane Harris
For now it appears to be a direct clone without any added features, albeit free of charge. Like Open Brush on PC, SideSketch is missing the eraser function.
To get SideSketch, you’ll need to set up SideQuest on your Quest headset, the unofficial app store for all things Quest. Check out our simple guide of how (and why) to use SideQuest to get up and running with SideSketch and a plethora of free and paid apps.
Tilt Brush for WebXR
The amazing thing about WebXR is that all you need is a URL, a compatible web browser and a PC VR or Quest headset to start playing and connecting in virtual spaces.
WebXR applications are notably smaller than apps that require a direct download and installation, and it seems a WebXR Tilt Brush derivative from developer Douglas Adams of msub2, called Silk Brush, is still brewing as a result.
At the moment, Adams says its still only capable of basic drawing, as he’s still working on integrating the wand’s complete set of functions—not a simple task since it needs to be light enough to run in-browser.
Seeing Tilt Brush as a potential WebXR application is really exciting though. Not only will users be able to pop in and create things quickly, but the hypothetical addition of multiplayer could make it a great place to quickly connect with others for everything from product ideation to collaborative art. Adams hasn’t mentioned that bit yet, although it was buried in the code as a ‘to-do’ by Google before they stopped active development.
Know of any apps making use of Tilt Brush code? Let us know in the comments below!
The Sundance Film Festival and its New Frontier program offers a venue for cutting edge artists to showcase their work and start conversations that can lead to rewarding careers.
Even in normal years, though, there’s not a lot of capacity spread around Salt Lake City, Utah. Plus, in 2021, there’s the pandemic to consider. Organizers of the 2021 event partnered with Active Theory to produce a WebXR-enabled festival that works across a wide range of devices, including the standalone Oculus Quest, in hopes of fostering those same types of conversations in the complete safety of physical social isolation. According to organizers, Facebook donated Quest headsets to the artists in the event who will be wearing gold sashes — making them easy to identify for folks who might want to initiate those conversations.
“We hope this platform will allow people to meet each other, and bond inside a space of art,” said Shari Frilot, chief curator of the festival’s New Frontier program. “We’re hoping to put them in rooms with the buyers, sellers, other filmmakers…we’re hoping they will be able to have those conversations with people who will help them launch their career.”
A $25 Explorer Pass grants access to New Frontier with several spaces that can be explored as an avatar, and some only viewable in VR. There’s the New Frontier Gallery with a range of works including AR and VR projects to be shown 24 hours a day during the festival, with social functionality active from 11 am to midnight Mountain Time as well as Film Party with six screens available in an interactive bar-type setting. There’s also the Cinema House with short films being shown with the following schedule:
1/29 8 pm Mountain Time:
This Is the Way We Rise
My Own Landscapes
Tears Teacher
The Fourfold
A Concerto Is A Conversation
1/31 3 p.m. MT
Station to Station
2/1 7 pm MT
Users (2021 US Doc Competition) – 2/1 7 p.m. MT
2/2 5 pm MT
Mother of George
You can purchase a pass here and be sure to check out the trailer for a sense of what the experience will be like:
The event represents a very notable test of WebXR as a technology and a potential preview of how more conferences and festivals will look in the future. For those unfamiliar, WebXR turns a page more literally into a site you visit. For Web developers, the technology offers a path to VR content creation while freeing them from store-based distribution. For users, a well-implemented site that is WebXR-enabled could enable viewers to access content on their phones, PCs, and VR headsets with no pre-downloading required.
The Sundance Film Festival runs from January 28 to February 3, 2021. We’ll be visiting the festival to check it all out and hope to see you there.
The latest incarnation of Frank Herbert’s Dune was knocked out of its 2020 release window like so many other projects, but you can still have a taste of the enormity of the sandworms in that story by riding one in a VR headset.
The WebXR experience can be found at https://tyrovr.com/dust-devil/ and if you visit that site in a headset with a VR-capable Web browser you should be able to ride a sandworm. The footage below was captured on an Oculus Quest 2 running that website in the Oculus Browser. The Oculus Touch controllers can be used to pull the reigns and steer the sandworm in different directions, or slow it down. There are other sandworms of varying size roaming the vast desert and you can ride up alongside them to marvel at their scale.
We’ve recommended new Oculus Quest 2 owners check out Web-based VR experiences like Moonrider.xyz on the headset for free experiences that explore some of the headset’s capabilities. Dust Devil might get added to the list as another thing to check out because it is so simple and cool. You’re unlikely to spend more than a few minutes with it but it still offers an impressive sense of scale and wish fulfillment that VR is so good at delivering.
There are a couple other WebXR experiences available at TyroVR.com including a real-time strategy game and a shooter.
Firefox Reality, Mozilla’s made-for-VR web browser, has been available on standalone devices for some time now, featuring support for Oculus Quest, Oculus Go, HTC Vive Focus, and Pico standalones. Now Mozilla has brought its WebXR-capable browser to PC VR headsets with its new PC Preview version.
Like with its standalone headset variant, Firefox Reality PC Preview supports standard 2D web browsing, 360 video, and immersive content.
Alongside native support for WebXR and WebVR content, Mozilla says the browser also contains “the same privacy and security that underpin regular Firefox on the desktop.”
If you’re viewing this article using Firefox Reality (download link below), you’ll be able to do some pretty cool stuff like chat with people in social VR through Mozilla Hubs, explore the nearly endless 3D objects hosted on Sketchfab, and take a tour of a host of immersive content through the Hello WebXR! app. Just click the links, pop on your VR headset (if you’re not already using it) and jump in.
Firefox Reality PC Preview is available for download via Viveport, which includes support for SteamVR headsets such as Oculus Rift, HTC Vive Cosmos, and Valve Index. Last year Mozilla mentioned it was working with Valve to bring a version to Steam.
The company says in a blog post that it has plans to both expand to other VR platforms as well as deliver updates that add more functionality and stability.
Oculus Browser has rolled out support for experimental hand-tracking API support with WebXR, and some demos are already available to try out.
In a tweet last week, Oculus Browser Product Manager Jacob Rossi announced that WebXR in Oculus Browser now supports the hand tracking API for Oculus Quest. This allows developers to create WebXR experiences where users only have to use their hands while in VR, and can forgo Touch controllers in a similar manner to select games and apps available on the Oculus Store.
Oculus Browser already supported hand tracking as an input method while browsing the web, however this update add support for developers who want to integrate hand tracking into a proper WebXR experience in the browser. Some developers have already created some proof of concept experiences as well, such as this demo developed by Marlon Lückert that is available to try online now if you have an Oculus Quest.
As you can see from the video, this implementation is pretty basic but is also just meant to show off that the support exists and works.
If you want to try the demo out for yourself, just head over to webxr-handtracking.vercel.app on your Quest browser. However, you are going to need to perform a few one-time setup steps, as outlined when you visit the address. It essentially boils down to going to chrome://flags/ on your Quest browser and enablingWebXR experiences with joints tracking and disabling WebXR experiences with hands tracking. You’ve also got to make sure that automatic switching between hands and controllers is enabled in your Quest settings.
This is just the beginning of hand tracking implementation in WebXR — we expect to see a lot more uses of the feature in the future.
