scholarly journals Predicting tumour mutational burden from histopathological images using multiscale deep learning

2020 ◽  
Vol 2 (6) ◽  
pp. 356-362
Author(s):  
Mika S. Jain ◽  
Tarik F. Massoud
2020 ◽  
Author(s):  
Mika S Jain ◽  
Tarik F Massoud

ABSTRACTTumour mutational burden (TMB) is an important biomarker for predicting response to immunotherapy in cancer patients. Gold-standard measurement of TMB is performed using whole exome sequencing (WES), which is not available at most hospitals owing to its high cost, operational complexity, and long turnover times. We developed a machine learning algorithm, Image2TMB, which can predict TMB from readily available lung adenocarcinoma histopathological images. Image2TMB integrates the predictions of three deep learning models that operate at different resolution scales (5X, 10X, and 20X magnification) to determine if the TMB of a cancer is high or low. On a held-out set of patients, Image2TMB achieves an area under the precision recall curve of 0.92, an average precision of 0.89, and has the predictive power of a targeted sequencing panel of approximately 100 genes. This study demonstrates that it is possible to infer genomic features from histopathology images, and potentially opens avenues for exploring genotype-phenotype relationships.


Cancers ◽  
2021 ◽  
Vol 13 (10) ◽  
pp. 2419
Author(s):  
Georg Steinbuss ◽  
Mark Kriegsmann ◽  
Christiane Zgorzelski ◽  
Alexander Brobeil ◽  
Benjamin Goeppert ◽  
...  

The diagnosis and the subtyping of non-Hodgkin lymphoma (NHL) are challenging and require expert knowledge, great experience, thorough morphological analysis, and often additional expensive immunohistological and molecular methods. As these requirements are not always available, supplemental methods supporting morphological-based decision making and potentially entity subtyping are required. Deep learning methods have been shown to classify histopathological images with high accuracy, but data on NHL subtyping are limited. After annotation of histopathological whole-slide images and image patch extraction, we trained and optimized an EfficientNet convolutional neuronal network algorithm on 84,139 image patches from 629 patients and evaluated its potential to classify tumor-free reference lymph nodes, nodal small lymphocytic lymphoma/chronic lymphocytic leukemia, and nodal diffuse large B-cell lymphoma. The optimized algorithm achieved an accuracy of 95.56% on an independent test set including 16,960 image patches from 125 patients after the application of quality controls. Automatic classification of NHL is possible with high accuracy using deep learning on histopathological images and routine diagnostic applications should be pursued.


2021 ◽  
Author(s):  
Andrew Su ◽  
HoJoon Lee ◽  
Xiao Tan ◽  
Carlos J Suarez ◽  
Noemi Andor ◽  
...  

Deep learning cancer classification systems have the potential to improve cancer diagnosis. However, development of these computational approaches depends on prior annotation through a pathologist. This initial step relying on a manual, low-resolution, time-consuming process is highly variable and subject to observer variance. To address this issue, we developed a novel method, H&E Molecular neural network (HEMnet). This two-step process utilises immunohistochemistry as an initial molecular label for cancer cells on a H&E image and then we train a cancer classifier on the overlapping clinical histopathological images. Using this molecular transfer method, we show that HEMnet accurately distinguishes colorectal cancer from normal tissue at high resolution without the need for an initial manual histopathologic evaluation. Our validation study using histopathology images from TCGA samples accurately estimates tumour purity. Overall, our method provides a path towards a fully automated delineation of any type of tumor so long as there is a cancer-oriented molecular stain available for subsequent learning. Software, tutorials and interactive tools are available at: https://github.com/BiomedicalMachineLearning/HEMnet


2017 ◽  
Vol 7 (1) ◽  
Author(s):  
Zhongyi Han ◽  
Benzheng Wei ◽  
Yuanjie Zheng ◽  
Yilong Yin ◽  
Kejian Li ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document