News | Advanced Visualization | February 25, 2019

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Collaboration combines Philips Azurion image-guided therapy platform with Microsoft HoloLens 2 mixed reality computing platform as a concept for the operating room of the future

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field. Virtual reality in the cath lab, interventional lab, hybrid OR, or cardiovascular lab.

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field. 

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms of anatomy and view things like hemodynamic data.

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms of anatomy and view things like hemodynamic data.

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field.

Philips and Microsoft have partnered to develop an augmented reality system to help imporve workflow and procedural navigation in the cath lab. Physicians wearing visors can view and interact with true 3-D holograms above the patient on the table and manipulate the image with voice and hand motion commands to avoid breaking the sterile field. 

February 25, 2019 — Philips will unveil a new mixed reality concept developed together with Microsoft that the company says is designed for the operating room of the future. Based on Philips’ Azurion image-guided therapy platform and Microsoft’s HoloLens 2 holographic computing platform, the companies will showcase novel augmented reality applications for image-guided minimally invasive therapies. The technology will debut at Mobile World Congress (MWC) Barcelona, Feb. 25-28 in Barcelona, Spain.

In contrast to open surgery, minimally invasive therapies only require a small incision. Dedicated instruments such as catheters are inserted through the incision and guided to the treatment area, which can include the heart, blood vessels, brain, liver and other major organs. During minimally invasive procedures, physicians cannot directly see and touch the treatment area. Instead they rely on advanced medical imaging technologies such as ultra-low dose X-ray imaging and ultrasound, as well as other navigation technologies, to see inside the patient and guide their actions.

The Philips and Microsoft augmented reality concept, built for HoloLens 2, brings live imaging and other sources of vital data currently displayed on large 2-D screens into a 3-D holographic augmented reality environment that can be ergonomically, easily and intuitively controlled by the physician. The concept is being used to gather further clinical insights to support the development of future commercially-available augmented reality solutions for use in image-guided procedures.

Watch the VIDEO: Editor's Choice of the Most Innovative New Imaging Technology at RSNA 2017 to see the technology in action.

Microsoft unveiled HoloLens 2 at MWC Barcelona. It is a self-contained holographic computer that enables hands-free, heads-up interaction with three-dimensional digital objects. HoloLens 2 builds on the technology of HoloLens and is even more immersive, more comfortable and delivers more value right out of the box, according to Microsoft. The device is complemented by existing and new Azure cloud services, and features built-in artificial intelligence (AI).

Philips launched the Azurion platform globally in February 2017, powered by ConnectOS that allows the integration of advanced digital innovations.

Since its global launch in February 2017, over half a million patients have been treated in more than 80 countries using the Azurion platform, which is powered by Philips’ proprietary ConnectOS and combines technical innovations in both software and hardware. ConnectOS allows the integration of advanced digital innovations on the Azurion platform.

For more information: www.usa.philips.com/healthcare

 

Related VR and AR Content:

VIDEO: Using Virtual and Augmented Reality to Examine Brain Anatomy and Pathology at MD Anderson

Virtual Reality Boosts Revenues and Patient Understanding

Augmented Reality is Taking Over Radiology Training

VIDEO: Augmented Reality for Surgical Planning Example

Philips and Microsoft Showcase Augmented Reality for Image-Guided Minimally Invasive Therapies

Reimagining Brain Surgery 

VR in the OR 

Radiologist Uses Virtual Reality as Interventional Radiology Teaching Tool 

Related Content

DrChrono and 3D4Medical Partner to Bring 3-D Interactive Modeling to Physician Practices
News | Advanced Visualization | March 18, 2019
DrChrono Inc. and 3D4Medical have teamed up so practices across the United States can access 3-D interactive modeling...
Videos | Advanced Visualization | March 05, 2019
Augmented reality (AR) and virtual reality (VR) are starting to be adopted for physician training, patient education
Philips Introduces IntelliSpace Portal 11 at ECR 2019
Technology | Advanced Visualization | February 27, 2019
Philips announced the launch of IntelliSpace Portal 11, the latest release of the company’s comprehensive, advanced...
Medivis Launches SurgicalAR Augmented Reality Platform
Technology | Advanced Visualization | February 14, 2019
Medical imaging and visualization company Medivis officially unveiled SurgicalAR, its augmented reality (AR) technology...
Videos | Advanced Visualization | December 12, 2018
This is an example of the FDA-cleared OpenSight augmented reality (AR) system for surgical planning from NovaRad at t
Nihon Kohden Launches Augmented Reality Electrophysiology Training App at HIMSS18
Technology | Advanced Visualization | March 06, 2018
Nihon Kohden announced the launch of the Nihon Kohden Dimensions Augmented Reality (AR) App to complement the Clinical...
NIH Issues $2.2 Million Grant for Augmented Reality Cardiac Hologram Research
News | Advanced Visualization | February 15, 2018
February 15, 2018 — The National Institutes of Health (NIH) awarded a $2.2 million research grant to healthcare techn
EchoPixel Showcases Next-Generation Surgical Planning With True 3-D Interactive Mixed Reality Software
News | Advanced Visualization | January 08, 2018
EchoPixel showcased the latest version of True 3D, its interactive, mixed reality software solution at the 103rd Annual...
Videos | Advanced Visualization | December 07, 2017
Dianna Bardo M.D., director of body MR and co-director of the 3-D Innovation Lab at Phoenix Children's Hospital, disc
Vital Unveils Newest Vitrea Advanced Visualization Release at RSNA 2017
Technology | Advanced Visualization | December 04, 2017
December 4, 2017 — Vital Images unveiled the newest version of Vitrea...
Overlay Init