Feature | Artificial Intelligence | July 17, 2017| Oksana Bandura

Use of Artificial Intelligence to Locate Standard Echo Heart Views

Machine learning algorthms in medical image analysis software can help locate standard heart views swiftly and accurately 

Automated medical imaging views using deep learning, artificial intelligence, Philips Epiq

GE, Siemens and Philips are among the echocardiography vendors that incorporate deep learning algorithms into its echo software to help automatically extract standard imaging views from 3-D ultrasound datasets. This is an example of the Philips Epiq system, which uses the vendor's Anatomical Intelligence software to define the anatomical structures and automatically display standard diagnostic views of the anatomy without human intervention. This can greatly speed workflow and reduce inter-operator variability. 

Medical image analysis based on artificial intelligence (AI) employ convolutional neural networks, support vector machines, fuzzy logic systems and other machine learning methods to extract meaning from medical images. State-of-the-art computer vision software gives evidence-based tips to diagnosticians, dispels their possible doubts and ensures diagnostic consistency.

Standard view location is a crucial step in echocardiography, as these frames contain essential diagnostic data. Automatic capturing of standard planes from an ultrasound examination can speed up scanning and make it more accurate. A close look at the research in this area will prove this is not a speculation. Computer-aided detection of standard views constantly supports clinicians.

How Computers See Images

Medical image analysis is a practical application of computer vision – a branch of computer science dealing with object and feature recognition in digital images, including digital video frames. Computer vision algorithms analyze images through a range of processes, similar to those performed by the human visual system. After initial preprocessing, which includes de-noising, filtering and feature enhancement, software breaks an image down into meaningful regions in a process called image segmentation. Then the algorithm extracts important features and classifies objects in the image based on these features. Besides, medical image analysis algorithms often perform image registration — mapping of two and more images of the same anatomical structures to detect any difference or change.

Based on machine learning, classification is the most sophisticated function of medical image analysis software. Every AI system uses machine-learning methods as its “brain.” These algorithms allow computers to remember loads of information and use it to analyze similar information after their learning has finished. That is why this approach is so widely used in computer vision — trained on image datasets (e.g., a dataset of ultrasound images), the software then recognizes familiar features in real-world images (e.g., in a real-time ultrasound scan) and makes relevant conclusions based on them.

The accuracy of such systems rises with the number of data fed into them. Starting with hundreds of images, they show decent results, and after processing thousands of images and more, their accuracy approaches 100 percent. Of course, it also depends on the architecture used, and with the development of machine learning methods, algorithms used for medical image analysis show ever better results.

Applying Computer Vision to Echocardiography

Cardiac echo has a number of challenges that medical image analysis can solve. For example, researchers suggest the use of computer vision for automatic segmentation of anatomical structures, detection and classification of congenital heart defects, real-time catheter location, etc. Standard view acquisition, the most basic task in cardiac ultrasound, also can be accomplished by medical image analysis.


Standard View Acquisition

To locate standard heart views, software should select appropriate 2-D planes from a multitude of frames taken during an ultrasound scanning. Here, different challenges arise, such as analyzing 2-D frames, 3-D volumes, 2-D temporal sequences, or 4-D spatio-temporal image correlation (STIC) volumes.  

The latter issue has been addressed by an international collaboration, suggesting the use of a scale-invariant feature transform (SIFT), a state-of-the-art feature detection algorithm and a support vector machine (SVM), a supervised machine-learning method. This approach has been tested on a dataset containing both normal and abnormal cases. The software was to locate three standard planes: four-chamber section (A4C), three-vessel view (TVV) and transverse abdominal section (TAS). 

The method has shown great results on synthetic data, that is, it has detected standard heart views among randomly selected planes with an accuracy of 87-100 percent. However, on real volume data, the performance was moderate, with an accuracy of 33-53 percent. Still, on both datasets the method has shown greater results than previous approaches. In the future, the researchers plan to improve accuracy by applying a deep convolutional neural network (CNN), which is the most promising machine learning method used for image analysis. Another collaboration suggested a similar approach: they have applied a fused deep learning framework based on two CNNs to locate eight standard heart views in 3-D echo, and achieved the accuracy of 92.1 percent. When locating only three primary planes, the accuracy was as high as 98 percent.

It is worth noting that both studies used a relatively small amount of data to train their systems: they fed their SVM and CNN systems with data corresponding to several hundred ultrasound plane images. This might be enough to test a system’s performance, but after serious training on big datasets, machine learning software shows even better results.

State-Of-The-Art and Expectations

Today, CNNs are considered the most powerful classification technique in machine learning. Specifically designed to analyze images, they show spectacular image classification accuracy. In some tasks, they have already outperformed humans, as an annual ImageNet visual recognition challenge has shown. The winning ImageNet research team had millions of labeled images to train their convolutional neural network with. So, with the amount of medical image data growing, we can expect that medical image analysis software will soon become an essential part of ultrasound systems.


Related AI Content

Read about how convolutional neural networks (CNNs) are being applied to ECG arrhythmia detection “iRhythm and Stanford Researchers Develop Deep Learning-Based Cardiac Arrhthymia Detection Algorithm.”

Watch the VIDEO “Ultrasound's Integration of Artificial Intelligence and Robotic Echo,” an interview with Partho Sengupta, M.D., at ASE 2017.

Read the article “A Glimpse Into the Future of Cardiac Ultrasound - Artificial Intelligence to Aid Reproducibility.”

Read the article “How Artificial Intelligence Will Change Medical Imaging.”

Watch the VIDEO "Expanding Role for Artificial Intelligence in Medical Imaging," from HIMSS 2017


Related Content

CZT SPECT camera detectors offered by GE.

A display of CZT SPECT gamma camera detectors at RSNA 2016. These detectors are more sensitive than those used in older cameras, allowing for faster scans or lower radiation dose. 

Feature | Nuclear Imaging| September 19, 2017 | Dave Fornell
Cardiac nuclear myocardial perfusion imaging (MPI) has been a mature area of imaging for years, but has recently star
Philips Launches CardioMD IV Cardiac SPECT Solution at ASNC 2017
Technology | SPECT Imaging| September 15, 2017
September 15, 2017 — Philips highlighted its newest solution for...
Mississippi Surgical and Vascular Center Uses Toshiba Ultimax-i FPD to Save Patients' Limbs
News | Angiography| September 14, 2017
The southern U.S. sees some of the highest numbers of chronic medical conditions, such as peripheral artery disease...
Philips Showcases Integrated Vascular Solutions at VIVA 2017
News | Peripheral Artery Disease (PAD)| September 13, 2017
Philips announced its presence at the Vascular Interventional Advances (VIVA 17) Annual Conference in Las Vegas from...
Vascular screening for abdominal aortic aneurysm, peripheral artery disease and hypertension during the VIVA Study in Denmark

Vascular screening for abdominal aortic aneurysm, peripheral artery disease and hypertension during the VIVA Study. Photo credit: Lisbeth Hasager Justesen, Viborg Hospital.

News | Cardiac Diagnostics| September 12, 2017
September 12, 2017 — A new screening program for vascular disease saves one life for every 169 men assessed, accordin
Orange County, Calif. Hospital Adopts Siemens Somatom Force CT for Cardiac Imaging
News | Computed Tomography (CT)| September 12, 2017
Hoag Memorial Hospital Presbyterian recently became the first hospital in Orange County, Calif., to install the Siemens...
Siemens Healthineers Receives FDA Clearance for TrueFusion Structural Heart Disease Feature
Technology | Cardiovascular Ultrasound| September 06, 2017
The U.S. Food and Drug Administration (FDA) has cleared TrueFusion, a new cardiovascular application from Siemens...
Advances in FFR, FFR-CT, was the most popular cardiology story in August 2017.

The most popular article in August was about advances in fractional flow reserve (FFR) technologies. The image shows Philips' new version of its iFR system that displays hemodynamic pressure drop points in an overlay on live angiographic images, matching up the iFR readings with corresponding lesions.

Feature | September 01, 2017 | Dave Fornell
September 1, 2017 — Here is the list of the most popular articles and videos on the Diagnostic and Interventional Car
GE’s blood speckle imaging (BSI) software shows the flow of blood cells’ trajectories. It is a form of blood vector flow imaging.

GE’s blood speckle imaging (BSI) software offers the ability to view a graphical representation of the blood cells’ trajectories.

News | Cardiovascular Ultrasound| September 01, 2017
Cardiologists are constantly on the lookout for new methods to examine the heart using new imaging technology advance
Overlay Init