Artificially intelligent computer algorithms can equal human pathologists in detecting metastases of breast cancer in lymph nodes. This was demonstrated during the CAMELYON16 challenge of Radboud university medical center. In an article to be published in JAMA (Journal of the American Medical Association) on 12 December, researchers have shown for the first time that deep learning algorithms have sufficient quality to make routine diagnoses based on images of tissue preparations. The technique can help pathologists make better and faster diagnoses.Between November 2015 and November 2016, researchers from Radboud university medical center organized the CAMELYON16 challenge. Machine learning researchers were given the opportunity to create a computer algorithm that can independently make a diagnosis based on pathology images. More specifically, this involved detecting metastases of breast cancer in lymph nodes. The challenge was accepted by 23 research groups from around the world, and the results have now been announced.
Participants in CAMELYON16 were given 270 digital images of tissue preparations, of which it was already known whether, and where, metastases could be found. Using these images, the participants developed algorithms and trained these to detect the metastases. They then received 129 new images, which they used to test the algorithm. The algorithm had to distinguish between images with and without metastases, and then locate the exact position of the metastases.
To compare the quality of the computer diagnoses with human performance, the 129 test images were also assessed by eleven experienced pathologists. They assessed the images of tissue preparations under conditions that were similar to a realistic hospital situation. In addition, one experienced pathologist was allowed to take as much time as she wanted to diagnose the images.
The participating research groups submitted a total of 32 computer algorithms. The most successful algorithms used ‘deep learning’, in which the computer learns to recognize patterns based on a large number of examples. The winning algorithm detected metastases as effectively as the pathologist who worked without time pressure. On average, this algorithm generated a false positive (a metastasis that actually did not exist) only 1.25 times per hundred images. The top algorithms performed significantly better than the pathologists who assessed the images in the realistic hospital work situation.
Better and faster
Jeroen van der Laak, researcher at the Pathology department of Radboud university medical center, coordinated the challenge: “For the first time we have seen that a computer can make this diagnosis as effectively as a pathologist. A pathologist with this algorithm is therefore better off than a pathologist without. The patient receives the result of the biopsy sooner, and the algorithm helps pathologists make better diagnoses, even under time pressure.” The researchers expect that the technique will be suitable for use in patient care within a few years, and that the computer algorithm will increasingly be capable of diagnoses.
Related news items
Hans van Bokhoven newly elected in Academia Europaea22 August 2019
The Academia Europaea is a functioning European Academy of Humanities, Letters and Sciences, composed of individual members.read more
Drug-induced interstitial lung disease in advanced breast cancer patients receiving everolimus22 August 2019
In Targeted Oncology, Annelieke Willemsen, Carla van Herpen and colleagues, showed that pulmonary function test with diffusion capacity of the lungs for carbon monoxide and serum biomarkers can be of aid to differentiate everolimus-related interstitial lung disease from other respiratory problems.read more
Publication in PNAS on dissecting EEC syndrome using single-cell RNA-seq22 August 2019
PhD candidates Eduardo Soares and Quan Xu in Jo Huiqing Zhou’s group in Molecular Developmental Biology, theme Reconstruction and regenerative medicine, have published a paper in PNAS on the disease mechanism of EEC syndrome using single-cell RNA-seq technology and patient-derived iPSCs.read more
Patient trust and participation in cell biological research21 August 2019
Alessandra Cambi and Gert Olthuis, discuss key ethical issues inherent in the development and the value of building trust and trustworthiness.read more
NWO grant for a tissue-generating patch to close diaphragmatic defects21 August 2019
Willeke Daamen and Toin van Kuppevelt, theme Reconstructive and regenerative medicine, were recently awarded a 690 k€ grant by NWO, domain Applied & Engineering Sciences, for the development of advanced patches for closure of diaphragmatic defects in children with congenital diaphragmatic hernia.read more
Front cover Human Mutation21 August 2019
The MetaDome web server build to interpret genetic variants based on genetic tolerance and homologous protein domains is featured on the Cover of Human Mutation. MetaDome was developed by Laurens van de Wiel, Coos Baakman, Daan Gilissen, Joris Veltman, Gert Vriend and Christian Gilissen,read more