In the journal Radiology researchers from Radboudumc, Bernhoven Hospital and Jeroen Bosch Hospital described the evaluation of a newly developed artificial intelligence (AI) system, CAD4COVID-XRay, for the detection of COVID-19 characteristics on chest X-ray (CXR).
The system is developed by Thirona and is available cost-free to any institution upon request. The system was trained on 24,678 CXR images and tested on a set of 454 images from an independent center (223 patients tested positive for COVID-19, the remaining 231 tested negative). The CXR images were also examined and scored by 6 radiologists independently. Analysis was performed by calculation of the receiver operating characteristic curve (ROC). In the task of identifying COVID-19 positive patients the AI system performed at a level comparable to all six radiologists and had an area under the ROC of 0.81. The system may be useful as part of a triage process for symptomatic subjects, particularly in low-resource settings where radiological expertise is not available.
Background Chest radiography (CXR) may play an important role in triage for COVID-19, particularly in low-resource settings. Purpose To evaluate the performance of an artificial intelligence (AI) system for detection of COVID-19 pneumonia on chest radiographs. Methods An AI system (CAD4COVID-Xray) was trained on 24,678 CXR images including 1,540 used only for validation while training. The test set consisted of a set of continuously acquired CXR images (n=454) obtained in patients suspected for COVID-19 pneumonia between March 4th and April 6th 2020 in a single center (223 RT-PCR positive subjects, 231 RT-PCR negative subjects). The radiographs were independently analyzed by six readers and by the AI system. Diagnostic performance was performed by receiver operating characteristic curve analysis. Results For the test set, the mean age of the patients was 67.3 (+/-14.4) years (56% male). Using RT-PCR test results as the reference standard, the AI system correctly classified CXR images as COVID-19 pneumonia with an AUC of 0.81. The system significantly outperforms each reader (p < 0.001 using McNemar test) at their highest possible sensitivities. At their lowest sensitivities, only one reader can significantly outperform the AI system (p=0.04). Conclusions An AI system for detection of COVID-19 on chest radiographs was comparable to six independent readers.
COVID-19 on the Chest Radiograph: A Multi-Reader Evaluation of an AI System.
Murphy K, Smits H, Knoops AJG, Korst MBJM, Samson T, Scholten ET, Schalekamp S, Schaefer-Prokop CM, Philipsen RHHM, Meijers A, Melendez J, van Ginneken B, Rutten M.
Related news items
Vulnerable Nijmegen citizens less likely to visit GP physically due to corona23 February 2021
The COVID-19 pandemic in 2020 in Nijmegen and the surrounding area led to a substantial decrease in GP consultations for patients with chronic physical health problems.read more
New Physical, Mental, and Cognitive Problems 1-year Post-ICU18 February 2021
Half of the Intensive Care Unit (ICU) survivors suffer from new physical, mental and/or cognitive problems one year after ICU admission. This is evident from the large-scale MONITOR-IC study led by the Radboudumc.read more
Trained immunity: a tool for reducing susceptibility to and the severity of SARS-CoV-2 infection17 February 2021
In a review in Cell Mihai Netea, Frank van de Veerdonk, Reinout van Crevel and Jorge Dominguez Andres propose that induction of trained immunity by whole-microorganism vaccines may represent an important tool for reducing susceptibility to and severity of SARS-CoV-2.read more
Radboudumc and Quirem Medical sign cooperation agreement17 February 2021
Radboudumc and Quirem Medical signed an agreement for joint research. The agreement includes several existing and future projects based on small radioactive spheres. Enhanced cooperation should improve the treatment of cancer patients and stimulate research into new applications.read more
Dutch Kidney Foundation Innovation Grant for Tom Nijenhuis and Jeroen de Baaij17 February 2021
This innovation grant was awarded for their project “A sweet deal: repurposing SGLT2i for renal hypomagnesemia”.read more