This Humanoid Robot Offers Telepresence With VR And Motion Controllers

Meet Reachy, the humanoid robot that’s controlled via VR with motion controllers to offer telepresence to users from around the globe.

Reachy is a robot in development by Pollen Robotics that can be controlled by a remote user wearing a VR headset and holding motion-tracked controllers. This means that the user’s head movements are mapped to the robot and the user’s hand movements are also 1:1 matched by the robot. We’ve already seen hints of this technology popping up across various industries, including for space flight and surgeries, so it’s great to see it slowly seeping out into more areas.

Going beyond the real-time movement mapping, you could theoretically “teach” a robot how to perform tasks using this method as well. In the video above we see the robot using fine motor skills to place blocks in a bucket based on shape, input time on a microwave, and more.

This type of technology is important because, once the tracking gets really, really good, it functionally allows people to “teleport” their “presence” (ie telepresence) across the world and potentially even into space at some point. In terms of potential, that would allow a top surgeon in the USA to perform an operation on an injured soldier on the front line, or to a robot stationed in a hospital in another country. That’s likely very far away from becoming a reality, but this is one step closer to that.

Uses extend far beyond just medical as well, as there are already experiments to get humanoid-style robots into space craft to help simulate effects on the human body, perform simple tasks, and help alleviate deep space isolation effects.

Reachy from Pollen Robotics is an open-source robotics platform available for research and prototyping, starting at $17,000. 

VR Therapy Specialist Oxford VR Secures $12.5 Million Investment for US Expansion

When it comes to virtual reality (VR) applications some of the most interesting work is being conducted in the healthcare field. Oxford VR is a company developing immersive therapy for a range of conditions and to help in this process has recently announced the completion of a new investment round totalling $12.5 million USD. 

Oxford VR
Pictured Barnaby Perks, Founding CEO, Oxford VR and Ash Patel, Principal, Optum Ventures. Image credit: Oxford VR

The Series A funding round was led by Optum Ventures and supported by Luminous Ventures with existing investors such as Oxford Sciences Innovation, Oxford University Innovation and GT Healthcare Capital Partners also participating. Oxford VR will use the funds to accelerate US expansion of its scalable automated VR therapy solutions for behavioural health issues. Additionally, Oxford VR will continue expanding work into conditions such as anxiety, depression and post-traumatic stress disorder.

“We are tremendously excited to close this investment round and to be working with Optum Ventures to drive our next level of growth. We would not be at this exciting tipping point without the collective efforts of the team at OVR, in particular Katie Bedborough, our CFO & COO,” said Oxford VR CEO Barnaby Perks in a statement. “Together with Optum Ventures and Luminous Ventures, and with the continued support from our existing investors, we can expand our clinical leadership footprint and accelerate our pipeline of automated VR therapy treatments.”

Figures from Mental Health America 2020 indicate over 26 million Americans with a behavioural health issue go untreated, so solutions like Oxford VR’s could have a significant impact. The company has already conducted its first clinical trial for fear of heights, which was published in The Lancet Psychiatry, is working with the NHS-funded gameChange project in the UK and partnered with AXA Hong Kong and The Chinese University of Hong Kong (CUHK) on several clinically-validated trials.

Oxford VR screenshot“Oxford VR has taken a technology-led approach to create evidence-based solutions that will make treatment more accessible to patients who need it,” said Ash Patel, Principal at Optum Ventures, who is joining the Oxford VR Board of Directors. “We believe Oxford VR’s solutions will benefit those who need access to high quality, effective cognitive behavioural therapy.”

As Oxford VR continues to expand its behavioural health solutions as well as the industry as a whole, VRFocus will keep you updated.

Vuzix Blade Smart Glasses App Wins Health Award

Though Vuzix has primarily become a name associated with providing augmented reality (AR) smart glasses technology to businesses and industry, the company is also working for various applications in medicine and healthcare, such as seeCOLe or ‘see Clinical data on Lens’, which has just won an award at the Cerner Corporation Code App Challenge.

The Cerner Corporation Code App Challenge was held during the 2018 Cerner Health Conference in Kansas City. Cerner Corporation is devoted towards health technology and innovation that assists medical personnel in making care decisions and managing health of populations.

Vuzix Blade medical

Cerner brings thousands of medical professionals together each year for its annual Cerner Health Conference, which this year hosted the Code app Challenge, which gave third-party developers the opportunity to create, develop and pitch innovative solutions that can help improve health outcomes.

The app produces, titled seeCOLe is an AR health app that allows clinicians to navigate and document information into an electronic record system using smart glasses. While using the app, the clinicians can use verbal commands to interact with the electronic record, which can show data from a patient’s chart and display it on the Vuzix Blade smart glasses. Once the data is accessed, the seeCOLe application can be navigated using voice or touch features.

The app means that a clinician can access a patient record wirelessly and keep the hands free, thus also improving patient-doctor interaction, which can have a positive result on patient outcomes.

“The overall form factor, wearability and performance of the Vuzix Blade Smart Glasses has drawn rave reviews from B2C customers, who see a tremendous opportunity to disrupt the existing market and build hands-free solutions around the Vuzix Blade platform,” said Paul Travers, Vuzix President and Chief Executive Officer. “Innovative health applications like seeCOLe, delivered through a see-through display on the Vuzix Blade Smart Glasses, can not only help clinicians provide improved care, but also increase their interaction with patients.”

Vuzix Blade 3000

For future coverage on Vuzix and other AR hardware and applications, keep checking back with VRFocus.

Novarad AR System for HoloLens Cleared by FDA for Medical Use

There have already been a number of applications for immersive technology in the medical and healthcare sector, from teaching new doctors to helping people overcome addictions and phobias. Now The OpenSight augmented reality (AR) system has become the first medical AR solution for the Microsoft HoloLens to be cleared by the Food and Drug Administration (FDA) in the US.

The OpenSight AR system from Novarad has been given 510(k) clearance fr use in pre-operatove surgical planning. The system renders 2D and 3D images of patients interactively, while accurately overlaying them on to the patients body.

“This is transformative technology that will unite preoperative imaging with augmented reality to improve the precision, speed and safety of medical procedures,” stated Dr. Wendell Gibby, Novarad CEO and co-creator of OpenSight. “This internal visualization can now be achieved without the surgeon ever making an incision, improving outcomes in a world of more precise medicine.”

While VR systems have been used in pre-operative planning before, the OpenSight system lets surgeons see the 3D patient images and the patient themselves at the same time, avoiding the possible disconnect that can happen when using VR systems.

The OpenSight system lets medical personnel get a better understand of the relevant anatomical relationships, or highlight certain specific areas to avoid or concentrate ob. Multiplate headsets can be used so those present can see the same thing, allowing for the training of less experienced personnel.

Novarad have also developed a teaching version of the software that lets medical students perform virtual dissections on medical cadavers.

The company has been working in medical imaging for many years, providing a customisable workflow and imaging solutions, which it hopes to continue into the new frontier of immersive technology. Further information can be found on the Novarad website.

For future coverage of VR and AR in healthcare, keep checking back with VRFocus.

Augmenteum Reveals Thorassist: An AR Education And Training Tool For Learning Pulmonary Anatomy

One of the topics that always generates a lot of interest on VRFocus, and for myself personally are any developments that involve virtual reality (VR) – or any form of immersive technology for that matter – in the field of healthcare or medical technology (medtech).

AugmentumIn fact, now that the technology has been readily available for a good couple of years, we’re seeing an uptick in the number of stories and updates specifically related to matters of health. As studies and other experiments begun months ago now begin to come to fruition.

The latest development comes out of the US and is actually realted to augmented reality (AR). A presentation is being made today at the American College of Chest Physicians’ (CHEST) annual meeting that will feature Thorassist – a multi-user AR education and training experience created by the company Augmenteum. Thorassist is a learning tool that will assist in teaching of the anatomy of the lungs using AR to display a digital image reconstructed from real-life imagery. It will also allow medical students to visualise bronchoscopic anatomy procedures a physician would perform.

“Thorassist is an exciting new tool to help educate doctors in the complex field of interventional pulmonology,” explains creator Carla Lamb, M.D. “Knowledge of the anatomy and the experience of procedures is challenging for new specialists to understand and retain. Thorassist provides an environment in which I can help students understand the anatomy and learn procedures using detailed models, at much lower cost than other technologies such as virtual reality.”

Augmenteum - Logo

Classroom [the template utilised by Augmenteum in which users use iPads to see and interact with digital 3D models] begins to realize our vision of delivering AR experiences for everyone, everywhere,” Explains David Palacios, Augmenteum’s Founder and Chief Technical Officer. “It shows the tremendous potential of an AR experience shared by many simultaneous users. We will create additional shared multi-user experiences that bring AR to many different applications, from the workplace to home.”

“Thorassist is an outstanding implementation of our Classroom experience,” adds CEO Andrew O’Brien. “It utilizes AR to visualize 3D models to improve end users’ understanding of very complex content and procedures. It leverages Augmenteum’s ability to deliver shared AR experiences for many simultaneous users, as well as provide a “take-home” experience for individuals to use on their own.”

You can find out more about Augmentum’s work on their website. VRFocus will bring you more news about developments in VR, AR and beyond throughout the week.

University Of Waterloo To Have First VR Optometry Lab In Canada

The University of Waterloo‘s School of Optometry and Vision Science have announced a new virtual reality (VR) training lab, which will help Canada’s next generation of optometrists learn how to diagnose vision problems and eye diseases more quickly and accurately. This new lab will accelerate the development of essential clinical skills for optometrists by simulate a patient’s eye in an immersive and authentic manner.

University of Waterloo

At a total cost of $1.5 million (CAD) the lab has been funded by an $800,000 investment by national eye care provider FYidoctors, and will be the first of its kind in Canada. The FYidoctors Simulation Lab will ensure the school at the University of Waterloo remains at the forefront in optometrist education in North America. The VR experience provides students with an opportunity to use the technology to practice on many cases that range from wellness through to diseases such as macular degeneration and diabetes, in a safe and controlled environment.

“With the simulators, optometry students will now take the time they need to practice and master skills as they progress through increasingly complex training modules,” said Stanley Woo, Director of the School of Optometry and Vision Science at Waterloo. “During valuable lab time, the foundational skills will be better established enabling our faculty to take the students more efficiently from good to great.”

FYidoctors Simulation Lab

The simulation equipment will supplement real-life training, which is limited. It will also provide hundreds of real patient cases to practice binocular indirect ophthalmoscopy (BIO), which will enable students to recognize, identify and diagnose eye and systemic disease with more speed and confidants.

“When we formed FYidoctors 10 years ago, we created it with a vision to enhance the lives of people, in our communities, and across the world. Investing in students, and in their clinical education, will ultimately enhance patient care in the communities in which we serve, and keep Canada at the forefront of optometry and vision science,” said Dr. Al Ulsifer, CEO and Chairman of FYidoctors and Waterloo alumnus. “Simulation technology is the future of healthcare learning and is directly aligned with FYidoctors spirit of harnessing innovation to help our patients lead more fulfilling lives.”

This follows the recent news that researchers at the University of Waterloo had developed a system that would allow them to predict motion sickness and counteract the effects of it for VR users.

For more on the work of the University of Waterloo in the future, along with all things VR, keep reading VRFocus.

Lenovo Mirage Solo VR Experience Offered to Starlight Children’s Foundation

For children who are hospitalised, or who have to undergo regular medical treatment, it can be a frightening and isolating experience. Virtual reality (VR) can offer an escape from the clinical environment, and has also been shown to reduce pain and anxiety. SOTI, a provider of mobile and IoT devices solutions have partnered with Lenovo to work with the Starlight Children’s Foundation to offer children in hospitals access to VR experiences on the Lenovo Mirage Solo.

The specially created ‘Starlight Xperience’ runs on the Lenovo Mirage Solo, which is powered by Google’s Daydream platform. The custom program has been designed to entertain, educate and inspire hospitalised children.

Lenovo Mirage Solo with Daydream

The VR experience will be delivered to Starlight’s network of over 800 paediatric partners by using its 360-degree program distribution program. The VR Starlight Xperience offers equipment and content which has been designed for the entertainment and distraction of children, with the hope that it will become a standard VR solution for paediatric care providers.

“We are very excited to work with Lenovo and the Starlight Project,” said Larry Klimczyk, vice president, Strategic Alliances at SOTI. “Our latest integration with the Lenovo Mirage Solo will bring countless innovations to the healthcare and education sectors.”

“By partnering with SOTI, Lenovo can combine VR technology with SOTI solutions, ensuring our device is securely managed and successfully implemented. We look forward to expanding the use of VR and delighting both consumers and the enterprise alike,” said Gunjan Shah, general manager for North America Smart Devices at Lenovo.

The Lenovo Mirage Solo is a stand-alone headset device, which is advantageous in a clinical setting. The device uses Google’s ‘WorldSense’ technology which allows for inside-out tracking without the need for external sensors.

For future coverage on how VR is used in healthcare and medicine, keep checking back with VRFocus.

Vifor Pharma Wins Award for Augmented Reality System

The Pharma 4.0 Awards was created to recognise outstanding innovation and implementation of manufacturing systems in the pharmaceutical industry. This year’s award has gone to Vifor Pharma Group and its partner Goodly Innovations for the creation of a team-based augmented reality (AR) system.

The AR system was created in order to improve efficiency in the pharmaceutical manufacturing and packaging process. These processes are known to be complex, and the operators need to run through many detailed checklists to ensure no errors occur. The implementation of AR means that operators have detailed instructions for each step in the process.

By using AR, workflows can be adapted to real-life operations and operators can tick off each task as it is completed, and by using AR smart-glasses, operators hands can be free to complete other tasks.

“Applying augmented reality in our operations allowed us to improve the changeover process and increase productivity by up to 50% at our packaging plant,” said Dr. Benno Bischof, Head of Product Group, Technical Operations, in St. Gallen. “We have clearly demonstrated the potential of augmented reality by using it to create a dynamic teamwork system, unprecedented in our industry. This is the kind of innovative technology that we strive to use to improve our operations.”

“We set out to reduce the format change time by 30%, which at the time of our first prototype seemed like a bold objective. Now that we have real-life data from multiple installations, we are blown away by the results. Improving overall equipment effectiveness by 15 percentage points exceeded our expectations. It was also amazing to see error rates drop to virtually zero or on-boarding times become vastly accelerated,” said Robert Hoffmeister, CEO of Goodly Innovations. “We are very grateful for the trust and constructive feedback we got from the supportive teams at Vifor Pharma during this important early phase. Now we are just as excited to see the interest in OptiworX grow so rapidly in the industry.”

For future coverage of new and innovative uses of AR technology, keep checking back with VRFocus.

VRHealth Working With Oculus For Health and Wellness Solutions

As the potential for virtual reality (VR) use in healthcare has become apparent, a number of companies have been formed with the aim of exploring this developing technology. One of these is VRHealth, a company which provides specialised VR technology solutions and data analysis for healthcare. VRHealth have announced that it is working with Oculus to develop new health and wellness solutions using Oculus VR technology.

VRHealth will be using both Oculus Go and Oculus Rift to provide VR technology solutions for various areas in healthcare, including pain management for cancer patients during chemotherapy or alleviating patient anxiety before and after surgery.

The aim of VRHealth is to provide non-invasive medical tools, which use technology such as artificial intelligence (AI) and cloud computing algorithms to provide valuable data analytics. VRHealth has provided its tools to various medical facilities and hospitals, and has reported positive results from places such as Stanford Sports Medicine, Spaulding Rehabilitation Network, Hoag Hospital Network, and Mass General Hospital’s Sports Medicine Center.

“Virtual reality has the power to ease the pain of chemotherapy treatment, create a seamless environment for physical therapy exercises, and train children with ADHD to focus their attention,” VRHealth CEO Eran Orr says. “It used to be that when people thought of virtual reality – entertainment and games were the first application that came to mind but we see that applying the effects of VR to the healthcare industry has the potential to improve many lives and aid doctors in providing personalized and comfortable experiences for their patients.”

Data collected from patients is updated in real-time, allowing medical professionals to quickly adapt a patient’s treatment plan. The company believes this technology has great potential benefits for both patients and medical professionals.

For future coverage on immersive technology in healthcare, keep checking back with VRFocus.

Magic Leap Seeks To Improve Medical Sector In Partnership with Brainlab

As has previously been reported on VRFocus, there are a number of application for virtual reality (VR) and mixed reality (MR) in the medical and healthcare sector. One of the more interesting areas involves the use of MR technology for medical imaging. Magic Leap are aiming to become involved in this area by partnering with German medical technology company Brainlab.

The partnership aims to allow surgeons and other clinicians visualise and access medical imaging data. Magic Leap and Brainlab will create an operating system that combines Brainlab’s data management, cloud computing, visualisation and data pre-processing with Magic Leap’s spatial computing and experiential platforms.

The first release will be for planning and simulation of medical procedures in an office setting, so that medical personnel can meet and discuss the interventional procedures. This will then be expanded upon to allow surgeons and other clinicians to combine virtual imaging with the physical environment of an operating room, radiotherapy treatment room, intensive care unit and radiology suite.

Magic Leap said on the official website regarding the partnership: “Advancements made in medical technology are quite possibly the most important advances that affect humans on a global scale. Whether this means new medication that fights rare diseases or a new surgical entry point that helps alleviate pain or downtime, medical professionals can almost unanimously agree that putting patients first is their ultimate priority. By helping patients better see and understand their diagnosis, and allowing doctors to explore details of the human body like never before, we hope to revolutionize how medicine is practiced.”

Magic Leap have recently begun roll-out of its first physical product, the Magic Leap One Creator Edition mixed reality headset, along with its accompanying computer pack. The firm have also secured several partnerships with leading companies and brands, including Sennheiser and European band Sigur Rós.

Magic Leap One Lightwear 2

For future coverage on Magic Leap and other upcoming VR, AR and MR projects, keep checking back with VRFocus.