Artificially intelligent computer algorithms can equal human pathologists in detecting metastases of breast cancer in lymph nodes. This was demonstrated during the CAMELYON16 challenge of Radboud university medical center. In an article to be published in JAMA (Journal of the American Medical Association) on 12 December, researchers have shown for the first time that deep learning algorithms have sufficient quality to make routine diagnoses based on images of tissue preparations. The technique can help pathologists make better and faster diagnoses.Between November 2015 and November 2016, researchers from Radboud university medical center organized the CAMELYON16 challenge. Machine learning researchers were given the opportunity to create a computer algorithm that can independently make a diagnosis based on pathology images. More specifically, this involved detecting metastases of breast cancer in lymph nodes. The challenge was accepted by 23 research groups from around the world, and the results have now been announced.
Participants in CAMELYON16 were given 270 digital images of tissue preparations, of which it was already known whether, and where, metastases could be found. Using these images, the participants developed algorithms and trained these to detect the metastases. They then received 129 new images, which they used to test the algorithm. The algorithm had to distinguish between images with and without metastases, and then locate the exact position of the metastases.
To compare the quality of the computer diagnoses with human performance, the 129 test images were also assessed by eleven experienced pathologists. They assessed the images of tissue preparations under conditions that were similar to a realistic hospital situation. In addition, one experienced pathologist was allowed to take as much time as she wanted to diagnose the images.
The participating research groups submitted a total of 32 computer algorithms. The most successful algorithms used ‘deep learning’, in which the computer learns to recognize patterns based on a large number of examples. The winning algorithm detected metastases as effectively as the pathologist who worked without time pressure. On average, this algorithm generated a false positive (a metastasis that actually did not exist) only 1.25 times per hundred images. The top algorithms performed significantly better than the pathologists who assessed the images in the realistic hospital work situation.
Better and faster
Jeroen van der Laak, researcher at the Pathology department of Radboud university medical center, coordinated the challenge: “For the first time we have seen that a computer can make this diagnosis as effectively as a pathologist. A pathologist with this algorithm is therefore better off than a pathologist without. The patient receives the result of the biopsy sooner, and the algorithm helps pathologists make better diagnoses, even under time pressure.” The researchers expect that the technique will be suitable for use in patient care within a few years, and that the computer algorithm will increasingly be capable of diagnoses.
Related news items
Frank Walboomers 25-years work anniversary at Radboudumc17 September 2020
Frank Walboomers, associate professor at the research group Regenerative Biomaterials at the Dept. of Dentistry (theme Reconstructive & Regenerative Medicine), celebrated his 25th work anniversary at Radboudumc.read more
Tjitske Kleefstra appointed endowed professor of Clinical genetics and psychopathology of rare syndromes17 September 2020
Tjitske Kleefstra has been appointed endowed professor of Clinical genetics and psychopathology of rare syndromes at the department of Neurodevelopmental disorders, with effect from 1 September.read more
Annette Schenck appointed professor of Translational Genetics17 September 2020
Annette Schenck has been appointed professor of Translational Genetics at the department of Neurodevelopmental disorders, with effect from 1 August. The chair will bring together fundamental and translational research in the field of brain developmental disorders.read more
Centuries-old medicine reduces the risk of new cardiovascular disease in heart patients17 September 2020
Colchicine, an anti-inflammatory drug that has been used for gout for centuries, has been shown to prevent cardiovascular disease in patients who have had a heart attack or are suffering from narrowed coronary arteries. Results of the study are published in the New England Journal of Medicine.read more
Radboudumc does large-scale research on systemic sclerosis10 September 2020
In rare diseases, such as systemic sclerosis, it’s often difficult to conduct large-scale research. Rheumatologist Madelon Vonk has managed to follow enough patients with systemic sclerosis for years. The results of her research have been published in BMJ Annal of the Rheumatic Diseases.read more