Artificially intelligent computer algorithms can equal human pathologists in detecting metastases of breast cancer in lymph nodes. This was demonstrated during the CAMELYON16 challenge of Radboud university medical center. In an article to be published in JAMA (Journal of the American Medical Association) on 12 December, researchers have shown for the first time that deep learning algorithms have sufficient quality to make routine diagnoses based on images of tissue preparations. The technique can help pathologists make better and faster diagnoses.Between November 2015 and November 2016, researchers from Radboud university medical center organized the CAMELYON16 challenge. Machine learning researchers were given the opportunity to create a computer algorithm that can independently make a diagnosis based on pathology images. More specifically, this involved detecting metastases of breast cancer in lymph nodes. The challenge was accepted by 23 research groups from around the world, and the results have now been announced.
Participants in CAMELYON16 were given 270 digital images of tissue preparations, of which it was already known whether, and where, metastases could be found. Using these images, the participants developed algorithms and trained these to detect the metastases. They then received 129 new images, which they used to test the algorithm. The algorithm had to distinguish between images with and without metastases, and then locate the exact position of the metastases.
To compare the quality of the computer diagnoses with human performance, the 129 test images were also assessed by eleven experienced pathologists. They assessed the images of tissue preparations under conditions that were similar to a realistic hospital situation. In addition, one experienced pathologist was allowed to take as much time as she wanted to diagnose the images.
The participating research groups submitted a total of 32 computer algorithms. The most successful algorithms used ‘deep learning’, in which the computer learns to recognize patterns based on a large number of examples. The winning algorithm detected metastases as effectively as the pathologist who worked without time pressure. On average, this algorithm generated a false positive (a metastasis that actually did not exist) only 1.25 times per hundred images. The top algorithms performed significantly better than the pathologists who assessed the images in the realistic hospital work situation.
Better and faster
Jeroen van der Laak, researcher at the Pathology department of Radboud university medical center, coordinated the challenge: “For the first time we have seen that a computer can make this diagnosis as effectively as a pathologist. A pathologist with this algorithm is therefore better off than a pathologist without. The patient receives the result of the biopsy sooner, and the algorithm helps pathologists make better diagnoses, even under time pressure.” The researchers expect that the technique will be suitable for use in patient care within a few years, and that the computer algorithm will increasingly be capable of diagnoses.
Related news items
Ivan Zhovannik receives best presenter award at MISP25 June 2019
Ivan Zhovannik was awarded the best presenter award at the MISP 2019 (Medical Imaging Symposium for PhD students) held in Groningen.read more
Cost-effectiveness of mpMRI in active surveillance of prostate cancer25 June 2019
In European Urology Oncology Sejal Patel and colleagues evaluated the potential cost-effectiveness of including mpMRI in active surveillance for men diagnosed with low-risk prostate cancer in comparison to the standard monitoring program.read more
The gap in mortality between older and younger CRC patients has been bridged25 June 2019
In European Journal of Cancer, Nelleke Brouwer, Thea Zonneveld-Heil and colleagues showed that differences in postoperative mortality between older and younger patients with stage I-III colorectal cancer decreased. 1-year postoperative RS was almost equal for older and younger patients in 2015-2016.read more
Surgery to straighten a deviated septum improves quality of life20 June 2019
Patients with a deviated septum breathe more easily after a septoplasty and their quality of life improves. Specialists have long debated its benefits. Machteld van Egmond, Maroeska Rovers, and Niels van Heerbeek have ended the controversy with a publication in The Lancet.read more
A personal touch of Jaap ten Oever20 June 2019
In order to promote interaction amongst colleagues within RIMLS, we have a ‘personal touch’ series setting employees in the spotlight. A light-hearted manner to learn about the colleagues you know and those you don’t. This week: Jaap ten Oever.read more
Development of nationwide recommendations to support prenatal counseling in extreme prematurity20 June 2019
In Pediatrics Rosa Geurtzen et al described the development of a nationwide, evidence-based framework for prenatal counseling in extreme prematurity. It contains recommendations and tools for personalization in the domains of organization, decision-making, content, and style of prenatal counseling.read more