News | Artificial Intelligence | May 01, 2024

ChatGPT Extracts Data for Ischaemic Stroke Almost Perfectly

Bonn researchers find hardly any differences between expert and AI in data transmission from thrombectomy reports

Dr Nils Lehnen, Senior Physician at the Clinic for Diagnostic and Interventional Neuroradiology and Paediatric Neuroradiology at the UKB

Dr Nils Lehnen, Senior Physician at the Clinic for Diagnostic and Interventional Neuroradiology and Paediatric Neuroradiology at the UKB. Image courtesy of University Hospital Bonn (UKB) / R. Müller


May 1, 2024 — In an ischemic stroke, an artery in the brain is blocked by blood clots and the brain cells can no longer be supplied with blood as a result. Doctors must therefore act quickly and unblock the artery with the help of catheters. During the so-called mechanical thrombectomy, a lot of data has to be recorded and then transferred to various registers. Dr. Nils Lehnen, senior physician at the Clinic for Diagnostic and Interventional Neuroradiology and Pediatric Neuroradiology at the University Hospital Bonn (UKB), has now discovered in a study that ChatGPT could be a great help in this data transfer. The results have now been published in the specialist journal Radiology.

When did the patient arrive, when was a CT scan performed, when was the first puncture, when could the blood flow be restored,... During mechanical thrombectomy, a range of data must be recorded in the patient report and then manually transferred to various registers for the clinical outcome and for prospective studies. "This is a labor-intensive task that is also prone to transcription errors," says Dr Nils Lehnen, who also conducts research at the University of Bonn. "We therefore asked ourselves whether an AI such as ChatGPT could perform this transfer faster and possibly even more reliably."

In radiology, ChatGPT is already being tested in various procedures - for example, in the simplification of reports or in answering patient questions on breast cancer screening. However, whether ChatGPT can correctly extract data from free-text reports of a mechanical thrombectomy for a database and simultaneously generate clinical data was previously unexplored and was the research objective of this new study.

Dr Lehnen's research group first created a German prompt for ChatGPT and tested it on 20 reports in order to identify errors and subsequently adapt the prompt. After the correction, the data extraction using ChatGPT was tested on 100 internal reports from the UKB. For optimal comparison, an experienced neuroradiologist also compiled the results without seeing the ChatGPT evaluation. The researchers then compared the results and found that ChatGPT had correctly extracted 94 per cent of data entries and no post-processing was required. The researchers only considered the ChatGPT data entries that exactly matched that of the expert to be correct. Any deviations, such as additional symbols, punctuation marks or synonyms, were categorized as incorrect.

To validate these results, the researchers tested a further 30 external reports with the same prompt. ChatGPT achieved 90 per cent correct data entries.

"This suggests that ChatGPT could be an alternative to manually retrieving this data," says Dr Lehnen. "However, the reports and the prompt were only created by us in German, so the results of our study may need to be confirmed for other languages. In addition, we still observed poor results for certain data points, which shows that human supervision is still needed. However, we expect that further optimization of the prompt will further improve the results and that ChatGPT can make work easier in this area in the future."

For more information: https://www.ukbonn.de/


Related Content

News | Computed Tomography (CT)

July 16, 2024 — Arineta, a leader in advancing cardiovascular imaging solutions through cutting-edge technology, proudly ...

Home July 16, 2024
Home
News | Computed Tomography (CT)

May 1, 2024 —In this 3-stage study, 3 cohorts were used for diagnostic performance, and prognostic performance ...

Home May 01, 2024
Home
News | Computed Tomography (CT)

April 22, 2024 — A new study showed that a non-invasive imaging test can help identify patients with coronary artery ...

Home April 22, 2024
Home
Feature | Computed Tomography (CT) | By Alberto Morales, MD

Cardiac CT scans, recommended by the American College of Cardiology (ACC) and the American Heart Association (AHA) as ...

Home March 20, 2024
Home
News | Computed Tomography (CT)

February 20, 2024 — Ultrahigh-spatial-resolution photon-counting detector CT improved assessment of coronary artery ...

Home February 20, 2024
Home
News | Computed Tomography (CT)

HeartFlow is offering a free webinar based on a recent study that measured the ability of the of its roadmap analysis to ...

Home January 15, 2024
Home
News | Computed Tomography (CT)

December 19, 2023 — Siemens Healthineers announced the Food and Drug Administration (FDA) clearance of the Somatom Pro ...

Home December 19, 2023
Home
Feature | Computed Tomography (CT) | By Andrew Michalski, PhD and Rohit Sood MD, PhD

Coronary artery disease (CAD), also known as ischemic heart disease, is the most common heart disease with a prevalence ...

Home December 05, 2023
Home
News | Computed Tomography (CT)

October 26, 2023 — HeartFlow, Inc., a leader in non-invasive integrated artificial intelligence (AI) heart care ...

Home October 26, 2023
Home
News | Computed Tomography (CT)

October 13, 2023 — Arineta Cardiac Imaging is excited to announce the FDA 510(k) clearance of the SpotLight and ...

Home October 13, 2023
Home
Subscribe Now