In the journal Radiology researchers from Radboudumc, Bernhoven Hospital and Jeroen Bosch Hospital described the evaluation of a newly developed artificial intelligence (AI) system, CAD4COVID-XRay, for the detection of COVID-19 characteristics on chest X-ray (CXR).
The system is developed by Thirona and is available cost-free to any institution upon request. The system was trained on 24,678 CXR images and tested on a set of 454 images from an independent center (223 patients tested positive for COVID-19, the remaining 231 tested negative). The CXR images were also examined and scored by 6 radiologists independently. Analysis was performed by calculation of the receiver operating characteristic curve (ROC). In the task of identifying COVID-19 positive patients the AI system performed at a level comparable to all six radiologists and had an area under the ROC of 0.81. The system may be useful as part of a triage process for symptomatic subjects, particularly in low-resource settings where radiological expertise is not available.
Background Chest radiography (CXR) may play an important role in triage for COVID-19, particularly in low-resource settings. Purpose To evaluate the performance of an artificial intelligence (AI) system for detection of COVID-19 pneumonia on chest radiographs. Methods An AI system (CAD4COVID-Xray) was trained on 24,678 CXR images including 1,540 used only for validation while training. The test set consisted of a set of continuously acquired CXR images (n=454) obtained in patients suspected for COVID-19 pneumonia between March 4th and April 6th 2020 in a single center (223 RT-PCR positive subjects, 231 RT-PCR negative subjects). The radiographs were independently analyzed by six readers and by the AI system. Diagnostic performance was performed by receiver operating characteristic curve analysis. Results For the test set, the mean age of the patients was 67.3 (+/-14.4) years (56% male). Using RT-PCR test results as the reference standard, the AI system correctly classified CXR images as COVID-19 pneumonia with an AUC of 0.81. The system significantly outperforms each reader (p < 0.001 using McNemar test) at their highest possible sensitivities. At their lowest sensitivities, only one reader can significantly outperform the AI system (p=0.04). Conclusions An AI system for detection of COVID-19 on chest radiographs was comparable to six independent readers.
COVID-19 on the Chest Radiograph: A Multi-Reader Evaluation of an AI System.
Murphy K, Smits H, Knoops AJG, Korst MBJM, Samson T, Scholten ET, Schalekamp S, Schaefer-Prokop CM, Philipsen RHHM, Meijers A, Melendez J, van Ginneken B, Rutten M.
Related news items
650,000 Euro funding for research into the phasing out of medication for leukaemia patients30 July 2020
With a 650,000 euro funding from ZonMw, researchers from the Haematology and Pharmacy departments can develop a medication phasing out strategy for patients with chronic myeloid leukaemia. This strategy will be tested in practice.read more
Increased role of patients after bowel cancer treatment30 July 2020
Approximately 14,000 patients get colorectal cancer every year. Almost all patients are operated on and monitored afterwards (follow-up). In 2019 Radboudumc started a new approach to follow-up research after the treatment of stage II/III colorectal cancer.read more
ERC Proof of Concept grant received by Ronald van Rij30 July 2020
Ronald van Rij, theme Infectious diseases and global health, received an ERC (European Research Council) Proof of Concept grant of 150,000 euros, in order to make arbovirus vaccines even safer.read more
Hypatia fellowship Call is open30 July 2020
The Hypatia fellowship round with the deadline 31 May has been canceled. Therefore, the next available deadline will be 27 September 2020. Radboudumc researchers are invited to scout young potentials to fill the strategic gaps within the research themes imbedded in RIHS and RIMLS.read more
Mihai Netea and colleagues published two papers back-to-back in The Journal of Clinical Investigation.29 July 2020
These back-to-back articles investigated the effect of BCG vaccination on trained immunity. The first article shows that BCG vaccination inhibits systemic inflammation, depending on gender. The second article demonstrates that the circadian rhythm influences the induction of trained immunity.read more
Genetic mutation reveals how coronavirus strikes TLR7 plays essential role in disease process28 July 2020
''Does a congenital immune defect play an important role in the defense against Coronavirus?'' This was published by Cas van der Made, Frank van der Veerdonk and Alexander Hoischen.read more