Copyright American Heart Association
November 16, 2023 — A smartphone app using artificial intelligence technology to detect changes in the voice of a person with heart failure predicted more than 75% of hospitalizations about three weeks before they happened, according to late-breaking science presented today at the American Heart Association’s Scientific Sessions 2023. The meeting, Nov. 11-13, in Philadelphia, is a premier global exchange of the latest scientific advancements, research and evidence-based clinical practice updates in cardiovascular science.
“Speech analysis is novel technology that may be a useful tool in remote monitoring of heart failure patients, providing early warning of worsening heart failure that frequently results in hospitalization,” said lead study author William T. Abraham, M.D., FAHA, a professor of medicine, physiology and cell biology; and a College of Medicine Distinguished Professor in the division of cardiovascular medicine at The Ohio State University Wexner Medical Center in Columbus. “This technology has the potential to improve patient outcomes, keeping patients well and out of the hospital, through the implementation of proactive, outpatient care in response to voice changes.”
Heart failure occurs when the heart muscle can't pump enough blood to meet the body’s needs for blood and oxygen. This can result in fatigue, fluid retention, shortness of breath and sometimes excessive coughing.
This study evaluated the effectiveness of the artificial intelligence-driven mobile app to predict worsening heart failure in advance of any need for hospitalization and /or intravenous treatment among people diagnosed with heart failure. The mobile phone app was designed to detect changes in speech measures in patients over time. The voice changes could indicate early increases of lung fluid, which is a sign of progressing heart failure.
The study was conducted from March 2018 through April 2023 and enrolled 416 adults living in Israel diagnosed with heart failure. Study participants recorded five sentences in their native language — Hebrew, Russian, Arabic or English — into the phone app daily. In a training phase of the study, distinct speech measures from 263 participants were used to develop the AI algorithm. Then, the algorithm was used in the remaining 153 participants to validate the tool’s effectiveness.
The analysis found:
In the training phase of the study, the app accurately predicted 76% of worsening heart failure (44 of the 58 heart failure events) on average 24 days before hospitalization or the need for IV fluids occurred. The app generated an average of three unnecessary alerts per patient, per year.
In the validation phase, the app was 71% accurate in detecting heart failure events about 3 weeks in advance (detecting 10 of 14 events). There were about three unexplained alerts per patient per year in this group as well.
Researchers conclude that the technology detects future worsening heart failure episodes accurately, with a low unnecessary notification rate. This high rate of accuracy and early notification of worsening heart failure validate the AI tool as a potentially effective way to reduce hospitalization and improve patient outcomes.
Study background:
The technology used in this study was the Cordio HearO® system, a remote monitoring system comprised of a smartphone-based mobile speech application.
About 75% of the participants were men, and their average age was 68 years.
The 263 patients in the training phase, made recordings on 83% of days between March 27, 2018 - November 30, 2021 and were followed for up to 44 months. The test group of 153 patients made recordings on 81% of days between February 1,2020 - April 30, 2023 and followed for up to 31 months.
The distinct speech measures included pitch, volume, dynamics, and other characteristics.
While statistically valid, the number of participants in the study was small, which is a limitation of the study. An ongoing U.S.-based study will add to the experience in further training and validating the technology, Abraham said.
Co-authors, disclosures and funding sources are listed in the abstract.
Statements and conclusions of studies that are presented at the American Heart Association’s scientific meetings are solely those of the study authors and do not necessarily reflect the Association’s policy or position. The Association makes no representation or guarantee as to their accuracy or reliability. Abstracts presented at the Association’s scientific meetings are not peer-reviewed, rather, they are curated by independent review panels and are considered based on the potential to add to the diversity of scientific issues and views discussed at the meeting. The findings are considered preliminary until published as a full manuscript in a peer-reviewed scientific journal.
The Association receives funding primarily from individuals; foundations and corporations (including pharmaceutical, device manufacturers and other companies) also make donations and fund specific Association programs and events. The Association has strict policies to prevent these relationships from influencing the science content. Revenues from pharmaceutical and biotech companies, device manufacturers and health insurance providers and the Association’s overall financial information are available here.
For more information: www.heart.org
May 12, 2025 
