News | Artificial Intelligence | April 02, 2019| Jeff Zagoudis, Associate Editor

FDA Proposes New Review Framework for AI-based Medical Devices

Discussion paper describes need to regulate artificial intelligence that continuously learns

FDA Proposes New Review Framework for AI-based Medical Devices

April 2, 2019 — U.S. Food and Drug Administration (FDA) Commissioner Scott Gottlieb, M.D., announced Tuesday the agency is pursuing a new framework in which to review artificial intelligence (AI)-based medical software and devices to ensure ongoing effectiveness and patient safety. The agency released a 20-page discussion paper explaining the need for a new framework, the tenets of a total product lifecycle (TPLC) approach to certification, and examples of potential real-world AI software modifications that may or may not be permitted under the proposed framework. The FDA is asking for comments and feedback from all parties to inform future decisions.

Locked Versus Adaptive AI

To date, only two AI-based technologies have received full FDA approval and are in clinical use — IDx-DR, a software that detects diabetic retinopathy, and the Viz.AI Contact application that analyzes computed tomography (CT) images for potential signs of stroke. Gottlieb noted that both of these technologies can be considered “locked” algorithms. This means that the base algorithms can only be modified by the manufacturer, and must be manually verified and validated by them as well. Other AI algorithms are considered “adaptive” or “continuously learning,” and these learn from new user data acquired through real-world use.

In the statement, Gottlieb acknowledged the vast potential of such adaptive algorithms, but also insisted that these more open technologies must still adhere to the FDA’s safety and effectiveness standards.

Total Product Lifecycle Regulatory Approach

The discussion paper describes how the current 510(k) approval pathway takes a risk-based approach, requiring new premarket submissions for some software modifications. Categories of software modifications that may require a premarket submission include:

  • A change that introduces a new risk or modifies an existing risk that could result in significant harm;
  • A change to risk controls to prevent significant harm; and
  • A change that significantly affects clinical functionality or performance specifications of the device.

For today’s AI-based technologies, the discussion paper notes these considerations must be balanced with the ability for the software to “continue to learn and evolve over time to improve patient care.”

To satisfy all of these requirements, the discussion paper explores the potential of a total product lifecycle (TPLC)-based approach to certification. In this model, the FDA would “assess the culture of quality and organizational excellence of a particular company, and have reasonable assurance of the high quality of their software development, testing and performance monitoring of their products.”

One of the key elements considered in the TPLC approach will be a software’s predetermined change control plan. This plan would provide detailed information about the types of anticipated modifications based on the algorithm’s re-training and update strategy, and the associated methodology being used to implement those changes in a controlled manner that manages risks to patients. According to Gottlieb, the goal of a revised framework would to assure that ongoing algorithm changes:

  • Follow pre-specified performance objectives and change control plans;
  • Use a validation process that ensures improvements to the performance, safety and effectiveness of the AI software; and
  • Include real-world monitoring of performance once the device is on the market to ensure safety and effectiveness are maintained.

The agency is taking public comment on the contents of the discussion paper through June 3, 2019. The full discussion paper can be read here. Comments can be submitted here.

For more information: www.fda.gov

Related Content

Selfied might be used with AI to identify patients with heart disease. Getty Images

Getty Images

News | Artificial Intelligence | August 24, 2020
August 24, 2020 — Sending a photo selfie to the doctor could be a cheap and simple way of detecting heart disease usi
aption Health a leader in medical AI technology, has received U.S. Food and Drug Administration (FDA) 510(k) clearance for an updated version of Caption Interpretation, which uses artificial intelligence (AI) to enable clinicians to obtain quick, easy and accurate measurements of cardiac ejection fraction (EF) at the point of care.

Caption Health a leader in medical AI technology, has received U.S. Food and Drug Administration (FDA) 510(k) clearance for an updated version of Caption Interpretation, which uses artificial intelligence (AI) to enable clinicians to obtain quick, easy and accurate measurements of cardiac ejection fraction (EF) at the point of care.

News | Artificial Intelligence | August 19, 2020
August 19, 2020 — Caption Health a leader in medical AI technology, has received U.S.
In February 2020, the U.S. Food and Drug Administration (FDA) cleared artificial intelligence software to assist in the acquisition of cardiac ultrasound images. The Caption Guidance software from Caption Health is an accessory to compatible diagnostic ultrasound systems and uses artificial intelligence to help the user capture images of a patient’s heart that are of acceptable diagnostic quality. It is aimed at point of care ultrasound (POCUS) exams, where users may not be regular sonographers.

In February 2020, the U.S. Food and Drug Administration (FDA) cleared artificial intelligence software to assist in the acquisition of cardiac ultrasound images. The Caption Guidance software from Caption Health is an accessory to compatible diagnostic ultrasound systems and uses artificial intelligence to help the user capture images of a patient’s heart that are of acceptable diagnostic quality. It is aimed at point of care ultrasound (POCUS) exams, where users may not be regular sonographers.

Feature | Artificial Intelligence | August 18, 2020 | Dave Fornell, Editor
The No.
An example of DiA'a automated ejection fraction AI software on the GE vScan POCUS system at RSNA 2019.

An example of DiA'a automated ejection fraction AI software on the GE vScan POCUS system at RSNA 2019.

News | Artificial Intelligence | May 26, 2020
May 26, 2020 — DiA Imaging Analysis, a provider of AI based ultrasound analysis solutions, said it received a governm
A list of all the abnormalities the AI model classifies. This illustration only shows three representative leads (DII, V1 and V6).Fig. This is Figure 1 from the Nature Communications article.

A list of all the abnormalities the AI model classifies. This illustration only shows three representative leads (DII, V1 and V6).Fig. This is Figure 1 from the Nature Communications article.

News | Artificial Intelligence | May 19, 2020
May 19, 2020 — Artificial inte...
TeraRecon will accelerate innovation in its advanced visualization and AI platforms for image-related decision support to clinical specialists

TeraRecon's End-to-End AI Ecosystem

News | Artificial Intelligence | March 04, 2020
March 4, 2020 — SymphonyAI Group, an operating group of lea
The FDA granted marketing authorization of the Caption Guidance software to Caption Health Inc. in February 2020. It uses artificial intelligence to guide users to get optimal cardiac ultrasound images in a point of care ultrasound (POCUS) setting.

The Caption Guidance software uses artificial intelligence to guide users to get optimal cardiac ultrasound images in a point of care ultrasound (POCUS) setting.

News | Artificial Intelligence | February 13, 2020
February 13, 2020 — The U.S.

GE Healthcare partnered with the AI developer Dia to provide an artificial intelligence algorithm to auto contour and calculate cardiac ejection fraction (EF). The app is now available on the GE Vscan pocket, point-of-care ultrasound (POCUS) system, as seen here displayed at RSNA 2019. Watch a VIDEO demo from RSNA.

Feature | Artificial Intelligence | February 11, 2020 | Sanjay Parekh, Ph.D. 
February 7, 2020 – At the 2019 Radiological Society...