Feature | Artificial Intelligence | July 26, 2019

How Machine Learning Is Changing Cardiac Ultrasound

Artificial intelligence can speed workflow, take over time-consuming tasks, improve reproducibility and allow more time for patient care

An example of AI-assisted automation developed by TomTec, where a deep learning algorithm automatically marks the myocardial borders and performs auto quantification This removes time consuming tasks to free up the operator to spend more time with patients and helps make exams more reproducible.

Intelligent software solutions (aka deep learning, artifical intelligence, AI, machine learning), this seems to be certain, will not replace cardiologists. They will, however, replace processes in cardiology that are ubiquitous today, but suboptimal due to the limitations of the tools. And it will be the cardiologists who will benefit from these developments. Here are some ways AI will improve echocardiography based on what is being developed by several innovative health information technology (IT) companies to better understand the processes that will be affected, the tasks software will take over and what machine learning has got to do with all this.

From an IT point of view, the crucial question concerns the role machine learning will play for enhancing the quality of processes and the quality of care. The answer to this question explains the characteristics of intelligent software — the way bits and bytes are trained to recognize patterns and make decisions. The logical next question is “How do we measure the results of AI?”


AI Is About Understanding, Not About Learning by Heart

Very often validity of the data is considered the only quality criterion of neural networks for machine learning. Valid data by itself however does not make a machine learning system. Here artificial intelligence works just like natural intelligence: a not so clever student who simply learns the cases by heart without understanding the underlying principles will never be a good physician, no matter how "valid" the data might be. Really intelligent software is based on networks that learn to understand the principles. Consequently, above and beyond the case data, contingencies have to be culled from and trained for each clinical case in order to be able to identify trade-offs and correct errors.

Absolute truths are very rare in medicine. Three cardiologists will arrive at three different measuring results and interpret the very same ultrasound image in three different ways. The software has to be able to handle these kind of variances. Its crucial feature is the fact that unlike the human brain, AI does not produce statistical abnormalities. Thus the network has to be fed with many interpretations of a given exam in order to be able to arrive by itself at the majority opinion. And it has to be in constant competition with human intelligence. In software development, the clinical partners are not only case delivery services, they are permanent sparring partners.

Whoever entrusts the human heart to the bits and bytes of cardiac software should have a very close look at the underlying machine learning methodology – because this methodology separates average from very good software.

AI Can Eliminate Routine Duties and Allow More Time for Complex Patients

An important field of application for any well-trained AI software is conducting routine cardiac ultrasound exams and preparing the results for human reading, for instance follow-up exams. When cardiac performance is regularly tested using echocardiography, as might be the case with cancer patients, good software can automatically perform all necessary measurements. It uses prior exams, chooses suitable images from the image pool and measures in the appropriate planes. Furthermore, it compares the measurement results with the reference values from similar studies. For the subsequent human reading the software offers the physician a selection based on relevant, maybe even critical content and/or a simple standard finding. To finalize the exam the physician will be guided through a control process to confirm the findings and release them. In clinical routine such automation saves a lot of time and enhances the reporting quality.

Automation Enables True Mobility

Mobile ultrasound machines are handy, but without the ability to measure and evaluate the data generated on the go, the potential of mobility is not fully realized. The automation capabilities of an intelligent software package close the gap between generating and evaluating data as they render obsolete the many workflow steps that have to be performed manually on a (small) touchscreen, be it the selection of the appropriate image series, zooming or setting the measurement points.

Another important aspect in this context is transferring the data to the correct storage location, either in the cloud or on a server. The storage space of mobile devices is often too small for long-term storage of complex exams. Not to mention the fact that measurements require enormous amounts of energy and computing power, which would make both battery and processors go up in smoke. Thus, outsourcing data processing is a technical necessity.

However, there are process arguments in favor of mobile use. In healthcare networks, the results of measurements conducted on mobile devices are available across the facility in real-time. This allows quick decision making among physicians and across departments and ensures seamless diagnostic processes. This allows for faster diagnoses, even in decentralized structures. A hospital does not have a cardiology department or requires the knowhow of an external partner? No problem, since this third party has easy access to all relevant images via a mobile device or the browser – any time and any place, with the images being presorted and measured. Another scenario is the emergency physician transmitting the ultrasound images from the site of the accident directly to a central storage space, and by the time the ambulance arrives at the hospital the cardiologist on call has already reviewed all relevant images, measurement results and findings.

Artificial Intelligence Can Aid Quality Assurance and Reproducibility

Automated processes, particularly in routine tasks, improve quality assurance since they make sure echo exams are always performed and documented according to a pre-defined pattern. This is not always the case with exams performed by humans. Lack of time or experience can frequently lead to very different results with regard to both diagnosis and documentation, which my compromise the quality of care. Automated processes iron out quality differences for example by pointing out missing image series or by consistently using identical measurement criteria. Thus intelligent software can ensure that within a given facility or network binding standards are established which facilitates compliance with certain treatment paths.

This is good news for the hospital management, which relies on impeccable quality assurance (QA) and documentation in the communication with insurers or lawyers in case of litigation.

Even today a number of cardiac ultrasound measurements can be automated and they already improve diagnostic quality, e.g. ventricular measurements or flow measurements. Future software generations will be able to use neuronal networks to arrive at decisions faster, in a more comprehensible, reproducible and scientifically sound manner. And they will relieve
cardiology staff from drudge work so they can focus on their core competency, they can focus more time on caring for the patients.


Editor's note: This article was written by the OEM medical imaging software vendor TomTec, which is in the process of developing AI-based solutions. To date, the company has not received FDA or CE certification, nor approval for patient use.


Related Deep Learning in Cardiology Content:

Applications for Artificial Intelligence in Cardiovascular Imaging

How Artificial Intelligence Will Change Medical Imaging

How Will Artificial Intelligence Impact Healthcare?

VIDEO: Use of Artificial Intelligence To Speed Cardiac Clinical Research — James Januzzi, M.D.,

VIDEO: Artificial Intelligence for Echocardiography at Mass General — Interview with Judy Hung, M.D.

VIDEO: Example of Artificial Intelligence Integrated Into Cardiac Ultrasound.

Combatting the No. 1 Cause of Death With the Help of Artificial Intelligence and Advanced Technology

VIDEO: Overview of Artificial Intelligence and its Use in Cardiology — Interview with Anthony Chang, M.D.

VIDEO: ACC Efforts to Advance Evidence-based Implementation of AI in Cardiovascular Care — Interview with John Rumsfeld, M.D.

VIDEO: Artificial Intelligence Applications for Cardiology — Interview with Anthony Chang, M.D.

PODCAST: Fitting Artificial Intelligence Into Cardiology — Interview with Anthony Chang, M.D.

VIDEO: How Hospitals Should Prepare for Artificial Intelligence Implementation — Interview with Paul Chang, M.D.

Technology Report: Artificial Intelligence 

Related Content

TeraRecon will accelerate innovation in its advanced visualization and AI platforms for image-related decision support to clinical specialists

TeraRecon's End-to-End AI Ecosystem

News | Artificial Intelligence | March 04, 2020
March 4, 2020 — SymphonyAI Group, an operating group of lea
The FDA granted marketing authorization of the Caption Guidance software to Caption Health Inc. in February 2020. It uses artificial intelligence to guide users to get optimal cardiac ultrasound images in a point of care ultrasound (POCUS) setting.

The Caption Guidance software uses artificial intelligence to guide users to get optimal cardiac ultrasound images in a point of care ultrasound (POCUS) setting.

News | Artificial Intelligence | February 13, 2020
February 13, 2020 — The U.S.

GE Healthcare partnered with the AI developer Dia to provide an artificial intelligence algorithm to auto contour and calculate cardiac ejection fraction (EF). The app is now available on the GE Vscan pocket, point-of-care ultrasound (POCUS) system, as seen here displayed at RSNA 2019. Watch a VIDEO demo from RSNA.

Feature | Artificial Intelligence | February 11, 2020 | Sanjay Parekh, Ph.D. 
February 7, 2020 – At the 2019 Radiological Society...
A new technology for detecting low glucose levels via electrocardiogram (ECG) using a non-invasive wearable sensor, which with the latest artificial intelligence (AI) can detect hypoglycemic events from raw ECG signals has been made by researchers from the University of Warwick.

A new technology for detecting low glucose levels via electrocardiogram (ECG) using a non-invasive wearable sensor, which with the latest artificial intelligence (AI) can detect hypoglycemic events from raw ECG signals has been made by researchers from the University of Warwick.


News | Artificial Intelligence | January 13, 2020
A new technology for detecting low glucose levels via electrocardiogram (ECG) using a non-invasive wearable sensor,...
Videos | Artificial Intelligence | November 07, 2019
Piotr Slomka explains how his team at Cedars-Sinai is working on intelligent patient risk prediction algorithms...
AI Could Use EKG Data to Measure Patient's Overall Health Status

Image courtesy of iStock

News | Artificial Intelligence | August 29, 2019
In the near future, doctors may be able to apply artificial intelligence (AI) to electrocardiogram data in order to...
Half of Hospital Decision Makers Plan to Invest in AI by 2021
News | Artificial Intelligence | August 08, 2019
A recent study conducted by Olive AI explores how hospital leaders are responding to the imperative to drive efficiency...
Artificial Intelligence Solution Improves Clinical Trial Recruitment

A nurse examines a patient in the Emergency Department of Cincinnati Children’s, where researchers successfully tested artificial intelligence-based technology to improve patient recruitment for clinical trials. Researchers report test results in the journal JMIR Medical Informatics. Image courtesy of Cincinnati Children’s.

News | Artificial Intelligence | July 31, 2019
Clinical trials are a critical tool for getting new treatments to people who need them, but research shows that...
Overlay Init