Category: OpenBCI

Posted on

Varjo’s Enthusiast Grade VR Headset is Getting a Brain-computer Interface

Varjo, maker of high-end XR headsets, and OpenBCI, a company creating open source brain-computer interface solutions, today announced a new partnership that’s bringing OpenBCI’s long-awaited neural interface ‘Galea‘ to Varjo’s latest Aero VR headset, something the companies say will provide “a deeper understanding to augment the human mind.”

OpenBCI initially announced Galea back in late 2020, a hardware and software platform that’s designed to merge its brain-computer interface tech with XR headsets.

It’s an area of research that many companies are looking towards (such as Valve) in the hopes that such non-invasive devices could provide a host of new data. Knowing how a person reacts in real-time to virtual stimulus could give developers in the future more ways of serving up dynamic content.

Since then, the Brooklyn, New York-based company says it’s attracted beta applicants spanning consumer technology, healthcare, research, training, and gaming & interactive media. Now Finnish XR headset creator Varjo, known for its exceptionally high-resolution headsets primarily meant for enterprise, is shipping out its Aero mixed reality headset with Galea’s beta system, neatly packed into headset’s strap.

Image courtesy Varjo, OpenBCI

Galea is said to include a suite of sensors including electroencephalogram (EEG), electrooculography (EOG) electromyography (EMG), electrodermal activity (EDA), and photoplethysmography (PPG) sensors, which are intended to measure data from the user’s brain, eyes, heart, skin, and muscles.

Varjo Aero is a pared down version of the company’s latest headset which offers industry-leading fidelity and advanced features for a cheaper (re: not cheap) price that makes the company’s offering more attractive to medium-sized businesses and wealthy VR enthusiasts. Without Galea, Aero is priced at $2,000 and features no annual fee—a far cry from the company’s previous enterprise headsets that range from $3,200–$5,500 (plus an $800–$1,500 annual fee).

OpenBCI and Varjo are opening pre-orders starting today, May 31st, specifically appealing to companies, developers, and researchers who have already applied to the Galea Beta Program. The headset-BCI combo is said include SDKs with ready-to-use building blocks for accessing the sensor data inside of Unity, Python, and several other common development environments.

Provided there are any units left after pre-orders, the companies will open up sale to the general public on July 1st, 2022. It’s not certain what price the companies intend to levy on the BCI-capable Aero though.

Read our review of Varjo Aero here and check out the full specs below:

Varjo Aero Specs
Resolution 2,880 x 2,720 (7.8MP) per-eye, mini-LED LCD (2x)
Refresh Rate 90Hz
Lenses Aspheric
Field-of-view (claimed) 134° diagonal, 115° horizontal (at 12mm eye-relief)
Optical Adjustments IPD (automatic motor driven)
IPD Adjustment Range 57–73mm
Connectors USB-C → breakout box (USB-A 3.0, DisplayPort 1.4)
Cable Length 5m
Tracking SteamVR Tracking 1.0 or 2.0 (external beacons)
On-board cameras 2x eye-tracking
Input None included (supports SteamVR controllers)
Audio 3.5mm aux port
Microphone None (supports external mic through aux port)
Pass-through view No
Weight 487g + 230g headstrap with counterweight

The post Varjo’s Enthusiast Grade VR Headset is Getting a Brain-computer Interface appeared first on Road to VR.

Posted on

Tobii, Valve & OpenBCI Collaborate on ‘Galea’ VR Brain-Computer Interface

OpenBCI - Galea

When it comes to interfacing with virtual reality (VR) worlds currently you really only have the option of physical controllers or very basic hand tracking unless you have the cash to buy expensive gloves. The future could very well be in brain-computer interface’s (BCI) like the one Valve, Tobii, and OpenBCI are currently collaborating on, Galea, with a beta programme slated to launch early next year.

Valve Index

Brooklyn-based neurotechnology company OpenBCI its Galea hardware and software platform last year, a combination of mixed reality (MR) headset with state-of-the-art biosensing and brain-computer interfacing (BCI) tech. The device features a wealth of sensors including electroencephalogram (EEG), electrooculography (EOG) electromyography (EMG), electrodermal activity (EDA), and photoplethysmography (PPG) to detect human emotions.

The project jumped into the spotlight last month thanks to New Zealand’s 1 NEWS interview with Valve’s Gabe Newell confirming the company had been working with OpenBCI. “If you’re a software developer in 2022 who doesn’t have one of these in your test lab, you’re making a silly mistake,” Newell said.

The latest news on the project sees Tobii as another partner, so alongside all the kit above built into a headset with elements from the Valve Index, it’ll also include eye-tracking.  

Valve Brain Interface
Image credit: Mike Ambinder/Valve Corporation

“We are excited to work with Valve and OpenBCI to explore the future of immersive gaming by combining the power of Tobii eye tracking and OpenBCI’s advanced brain computer interface technology,” said Anand Srivatsa, Division CEO of Tobii Tech in a statement.   

BCI could well be built into all future headsets to see when people are happy, sad, surprised or bored because as Newell himself puts: “simply because there’s too much useful data.”

If you’re a developer interested in how neurotechnology can transform VR experiences then head over to OpenBCI’s Galea beta project website to register. Limited quantities of developer units will be shipped to beta program participants in early 2022. For further updates, keep reading VRFocus.

Posted on

Valve arbeitet mit OpenBCI an besserer Immersion und weniger Übelkeit

Tower Tag auf Steam

In einem Interview mit 1 News bestätigt Gabe Newell die Zusammenarbeit mit OpenBCI. Gemeinsam arbeite man an einer erhöhten Immersion und der Reduzierung von Motion Sickness.

Valve arbeitet mit OpenBCI

OpenBCI entwickelt eine Brain-Computer-Interface-Technologie (BCI), d.h. Hardware, die in der Lage ist, sich direkt mit Ihren Gehirnsignalen zu verbinden, um emotionale Reaktionen, Gefühle und mehr zu erkennen. Erst im November des letzten Jahres stellte das Team eine Lösung vor VR- Und AR-Brillen vor.

Wie der Name des Projektes bereits verrät, handelt es sich um eine Open Source-Lösung. Newell bestätigt zudem im Interview, dass dadurch die Technologie zukünftig in vielen unterschiedlichen VR-Brillen zum Einsatz kommen könne.

“Wenn Sie ein Softwareentwickler im Jahr 2022 sind, der so etwas nicht in seinem Testlabor hat, dann machen Sie einen dummen Fehler.” [1 News]

Ein wichtiger Vorteil der Technologie sei laut Newell die Erkennung der Stimmung bzw. der Gefühle und eine automatische Anpassung des Spiels and den Spielenden oder die Spielende. Außerdem könne mit der Technologie Motion Sickness reduziert werden. Wie dies genau funktioniert, verrät Newell jedoch nicht.

(Quelle: Upload VR)

Der Beitrag Valve arbeitet mit OpenBCI an besserer Immersion und weniger Übelkeit zuerst gesehen auf VR∙Nerds. VR·Nerds am Werk!

Posted on

Valve Is Working With OpenBCI To Solve VR Motion Sickness And Increase Immersion

In a recent interview with1 News Valve CEO Gabe Newell discussed a partnership with OpenBCI to improve VR headsets, enhance immersion, and solve for VR motion sickness.

The vast majority of the interview focuses on forward-looking predictions for brain computer interface technology (BCIs) which is hardware that is able to interface directly with your brain signals to detect emotional responses, feelings, and more.

“We’re working on an open source project so that everybody can have high-resolution [brain signal] read technologies built into headsets, in a bunch of different modalities,” Newell said. “If you’re a software developer in 2022 who doesn’t have one of these in your test lab, you’re making a silly mistake…software developers for interactive experience[s] — you’ll be absolutely using one of these modified VR head straps to be doing that routinely — simply because there’s too much useful data.”

There are two specific benefits that VR would have from this discussed by Newell. For starters, it could significantly enhance immersion, such as increasing difficulty dynamically if a player is getting bored or feeling unchallenged. Or perhaps in a procedural game if the BCI notices when a randomized layout is something you dislike or particularly enjoy.

Newell then goes on to explain that in the future, BCIs will enable the creation of virtual worlds that far exceed our perceptions of reality, stating that, “the real world will stop being the metric that we apply to the best possible visual fidelity.”

Near the end there is also a discussion of how BCIs in VR can essentially solve for VR motion sickness, or that feeling of vertigo that makes some users nauseous during particular types of artificial movement. The feeling can already be suppressed artificially. “It’s more of a certification issue than it is a scientific issue,” explains Newell.

Perhaps this is why Valve has been so quiet about their plans post-Valve Index — they’re hard at work on what’s coming for the next-generation of interacting with computers.

Let us know what you think down in the comments below!

Posted on

Valve, OpenBCI & Tobii to Launch VR Brain-computer Interface ‘Galea’ in Early 2022

Valve co-founder Gabe Newell previously revealed Valve was working on a brain-computer interface (BCI) with OpenBCI, the minds behind open source BCI software and hardware solutions. Now Tobii, the eye-tracking firm, announced it’s also a partner on the project and that developer kits incorporating eye-tracking and “design elements” of Valve Index are expected to first ship sometime early next year.

Update (February 5th, 2021): Newell’s interview, which is referenced below in the original article, didn’t reveal whether OpenBCI project ‘Galea’ was the subject of the partnership, however now Tobii has confirmed that it is indeed the case along with a few other details.

Tobii will be lending its eye-tracking technology to Galea, which it says will incorporate design elements from Valve Index. Developer kits for early beta access partners will ship in early 2022, the companies say.

Reading between the lines somewhat, it appears Galea will not only include the sensors-packed strap, but also an eye-tracking enabled, possibly modified Valve Index headset.

Original Article (January 28th, 2021): Newell hasn’t been secretive about his thoughts on BCI, and how it could be an “extinction-level event for every entertainment form.” His message to software developers: start thinking about how to use BCI now, because it’s going to be important to all aspects of the entertainment industry fairly soon.

How soon? Newell says in a talk with News 1 that by 2022, studios should have them in their test labs “simply because there’s too much useful data.”

Gabe Newell (right), psychologist Mike Ambinder (left) | Image courtesy Valve

Newell speaks about BCI through a patently consumer-tinted lens—understandable coming from a prominent mind behind Steam, the largest digital distribution platform for PC gaming, and not to mention an ardent pioneer of consumer VR as we know it today.

To Newell, BCI will allow developers to one day create experiences that completely bypass the traditional “meat-peripherals” of old in function—eyes, ears, arms and legs—giving users access to richer experiences than today’s reality is capable of providing.

“You’re used to experiencing the world through eyes, but eyes were created by this low-cost bidder that didn’t care about failure rates and RMAs, and if it got broken there was no way to repair anything effectively, which totally makes sense from an evolutionary perspective, but is not at all reflective of consumer preferences. So the visual experience, the visual fidelity we’ll be able to create — the real world will stop being the metric that we apply to the best possible visual fidelity.”

On the road to that more immersive, highly-adaptive future, Newell revealed Valve is taking some important first steps, namely its newly revealed partnership with OpenBCI, the neurotech company behind a fleet of open-source, non-invasive BCI devices.

Newell says the partnership is working to provide a way so “everybody can have high-resolution [brain signal] read technologies built into headsets, in a bunch of different modalities.”

Back in November, OpenBCI announced it was making a BCI specifically for VR/AR headsets, called Galea, which sounded very similar to how Valve’s Principal Experimental Psychologist Dr. Mike Ambinder described in his GDC 2019 vision for VR headsets fitted with electroencephalogram (EEG) devices.

OpenBCI hardware | Image courtesy OpenBCI

Although Newell doesn’t go into detail about the partnership, he says that BCIs are set to play a fundamental role in game design in the very near future.

“If you’re a software developer in 2022 who doesn’t have one of these in your test lab, you’re making a silly mistake,” Newell tells 1 News. “Software developers for interactive experiences — you’ll be absolutely using one of these modified VR head straps to be doing that routinely — simply because there’s too much useful data.”

There’s a veritable laundry list of things BCI could do in the future by giving software developers access to the brain, and letting them ‘edit’ the human experience. Newell has already talked about this at length; outside of the hypotheticals, Newell says near-term research in the field is so fast-paced, that he’s hesitant to commercialize anything for the fear of slowing down.

“The rate at which we’re learning stuff is so fast that you don’t want to prematurely say, ‘OK, let’s just lock everything down and build a product and go through all the approval processes, when six months from now, we’ll have something that would have enabled a bunch of other features.”

It’s not certain whether Galea is the subject of the partnership, however its purported capabilities seem to line up fairly well with what Newell says is coming down the road. Gelea is reportedly packed with sensors, which not only includes EEG, but also sensors capable of electrooculography (EOG) electromyography (EMG), electrodermal activity (EDA), and photoplethysmography (PPG).

OpenBCI says Galea gives researchers and developers a way to measure “human emotions and facial expressions” which includes happiness, anxiety, depression, attention span, and interest level—many of the data points that could inform game developers on how to create better, more immersive games.

Provided such a high-tech VR headstrap could non-invasively ‘read’ emotional states, it would represent a big step in a new direction for gaming. And it’s one Valve clearly intends on leveraging as it continues to both create (and sell) the most immersive gaming experiences possible.

Interested in watching the whole interview? Catch the video directly on 1 News.

The post Valve, OpenBCI & Tobii to Launch VR Brain-computer Interface ‘Galea’ in Early 2022 appeared first on Road to VR.

Posted on

OpenBCI Announces Brain-Computer Interface Designed Specifically for VR/AR Headsets

OpenBCI, the neurotech company behind the eponymous open-source brain-computer interface (BCI), are making a new hardware and software platform specifically for immersive headsets.

Called Galea, the company says its new hardware is designed to attach to both AR and VR headsets, arriving with a multiple sensors designed to monitor biometric data streams in real time.

Galea is said to include a bevy of sensors, such as electroencephalogram (EEG), electrooculography (EOG) electromyography (EMG), electrodermal activity (EDA), and photoplethysmography (PPG) sensors, which are intended to measure data from the brain, eyes, heart, skin, and muscles.

OpenBCI hardware | Image courtesy OpenBCI

The company says Galea will allow researchers and developers to measure “human emotions and facial expressions” including happiness, anxiety, depression, attention span, and interest level—and use it to create more immersive content tailored to the individual. The idea is very similar to what we heard from Valve’s resident experimental psychologist Dr. Mike Ambinder during last year’s GDC talk on how BCI will change the nature of game design.

OpenBCI says it will provide researchers and developers early access to Galea, intended for commercial and research applications. Galea will also include SDKs to bring its stream of biometric data into “common development environments,” the company says.

“I believe that head-mounted computers integrated with human consciousness will drive the next major technology paradigm shift,” said Conor Russomanno, CEO of OpenBCI. “Galea is the realization of six years of research and development. We are providing the world with a playground for experimentation and development using multi-modal biometric data in tandem with next generation wearable displays.”

Founded on the back of a successful Kickstarter campaign in late 2013, OpenBCI creates consumer-grade biosensing systems built with open-source software and hardware. Today, the company’s hardware is used by researchers, academic labs, artists, and developers across 89 countries.

The post OpenBCI Announces Brain-Computer Interface Designed Specifically for VR/AR Headsets appeared first on Road to VR.