Narrative online guides for the interpretation of digital-pathology images and tissue-atlas data

Author(s):  
Rumana Rashid ◽  
Yu-An Chen ◽  
John Hoffer ◽  
Jeremy L. Muhlich ◽  
Jia-Ren Lin ◽  
...  
Keyword(s):  
Author(s):  
Rumana Rashid ◽  
Yu-An Chen ◽  
John Hoffer ◽  
Jeremy L. Muhlich ◽  
Jia-Ren Lin ◽  
...  

ABSTRACTThe recent development of highly multiplexed tissue imaging promises to substantially accelerate research into basic biology and human disease. Concurrently, histopathology in a clinical setting is undergoing a rapid transition to digital methods. Online tissue atlases involving highly multiplexed images of research and clinical specimens will soon join genomics as a systematic source of information on the molecular basis of disease and therapeutic response. However, even with recent advances in machine learning, experience with anatomic pathology shows that there is no immediate substitute for expert visual review, annotation, and description of tissue images. In this perspective we review the ecosystem of software available for analysis of tissue images and identify a need for interactive guides or “digital docents” that allow experts to help make complex images intelligible. We illustrate this idea using Minerva software and discuss how interactive image guides are being integrated into multi-omic browsers for effective dissemination of atlas data.


Author(s):  
Liron Pantanowitz ◽  
Pamela Michelow ◽  
Scott Hazelhurst ◽  
Shivam Kalra ◽  
Charles Choi ◽  
...  

Context.— Pathologists may encounter extraneous pieces of tissue (tissue floaters) on glass slides because of specimen cross-contamination. Troubleshooting this problem, including performing molecular tests for tissue identification if available, is time consuming and often does not satisfactorily resolve the problem. Objective.— To demonstrate the feasibility of using an image search tool to resolve the tissue floater conundrum. Design.— A glass slide was produced containing 2 separate hematoxylin and eosin (H&E)-stained tissue floaters. This fabricated slide was digitized along with the 2 slides containing the original tumors used to create these floaters. These slides were then embedded into a dataset of 2325 whole slide images comprising a wide variety of H&E stained diagnostic entities. Digital slides were broken up into patches and the patch features converted into barcodes for indexing and easy retrieval. A deep learning-based image search tool was employed to extract features from patches via barcodes, hence enabling image matching to each tissue floater. Results.— There was a very high likelihood of finding a correct tumor match for the queried tissue floater when searching the digital database. Search results repeatedly yielded a correct match within the top 3 retrieved images. The retrieval accuracy improved when greater proportions of the floater were selected. The time to run a search was completed within several milliseconds. Conclusions.— Using an image search tool offers pathologists an additional method to rapidly resolve the tissue floater conundrum, especially for those laboratories that have transitioned to going fully digital for primary diagnosis.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Christian Crouzet ◽  
Gwangjin Jeong ◽  
Rachel H. Chae ◽  
Krystal T. LoPresti ◽  
Cody E. Dunn ◽  
...  

AbstractCerebral microhemorrhages (CMHs) are associated with cerebrovascular disease, cognitive impairment, and normal aging. One method to study CMHs is to analyze histological sections (5–40 μm) stained with Prussian blue. Currently, users manually and subjectively identify and quantify Prussian blue-stained regions of interest, which is prone to inter-individual variability and can lead to significant delays in data analysis. To improve this labor-intensive process, we developed and compared three digital pathology approaches to identify and quantify CMHs from Prussian blue-stained brain sections: (1) ratiometric analysis of RGB pixel values, (2) phasor analysis of RGB images, and (3) deep learning using a mask region-based convolutional neural network. We applied these approaches to a preclinical mouse model of inflammation-induced CMHs. One-hundred CMHs were imaged using a 20 × objective and RGB color camera. To determine the ground truth, four users independently annotated Prussian blue-labeled CMHs. The deep learning and ratiometric approaches performed better than the phasor analysis approach compared to the ground truth. The deep learning approach had the most precision of the three methods. The ratiometric approach has the most versatility and maintained accuracy, albeit with less precision. Our data suggest that implementing these methods to analyze CMH images can drastically increase the processing speed while maintaining precision and accuracy.


2021 ◽  
Author(s):  
Birgid Schömig-Markiefka ◽  
Alexey Pryalukhin ◽  
Wolfgang Hulla ◽  
Andrey Bychkov ◽  
Junya Fukuoka ◽  
...  

AbstractDigital pathology provides a possibility for computational analysis of histological slides and automatization of routine pathological tasks. Histological slides are very heterogeneous concerning staining, sections’ thickness, and artifacts arising during tissue processing, cutting, staining, and digitization. In this study, we digitally reproduce major types of artifacts. Using six datasets from four different institutions digitized by different scanner systems, we systematically explore artifacts’ influence on the accuracy of the pre-trained, validated, deep learning-based model for prostate cancer detection in histological slides. We provide evidence that any histological artifact dependent on severity can lead to a substantial loss in model performance. Strategies for the prevention of diagnostic model accuracy losses in the context of artifacts are warranted. Stress-testing of diagnostic models using synthetically generated artifacts might be an essential step during clinical validation of deep learning-based algorithms.


Cells ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 325
Author(s):  
Carolina Venturoli ◽  
Ilaria Piga ◽  
Matteo Curtarello ◽  
Martina Verza ◽  
Giovanni Esposito ◽  
...  

Pyruvate dehydrogenase kinase 1 (PDK1) blockade triggers are well characterized in vitro metabolic alterations in cancer cells, including reduced glycolysis and increased glucose oxidation. Here, by gene expression profiling and digital pathology-mediated quantification of in situ markers in tumors, we investigated effects of PDK1 silencing on growth, angiogenesis and metabolic features of tumor xenografts formed by highly glycolytic OC316 and OVCAR3 ovarian cancer cells. Notably, at variance with the moderate antiproliferative effects observed in vitro, we found a dramatic negative impact of PDK1 silencing on tumor growth. These findings were associated with reduced angiogenesis and increased necrosis in the OC316 and OVCAR3 tumor models, respectively. Analysis of viable tumor areas uncovered increased proliferation as well as increased apoptosis in PDK1-silenced OVCAR3 tumors. Moreover, RNA profiling disclosed increased glucose catabolic pathways—comprising both oxidative phosphorylation and glycolysis—in PDK1-silenced OVCAR3 tumors, in line with the high mitotic activity detected in the viable rim of these tumors. Altogether, our findings add new evidence in support of a link between tumor metabolism and angiogenesis and remark on the importance of investigating net effects of modulations of metabolic pathways in the context of the tumor microenvironment.


2021 ◽  
Vol 7 (3) ◽  
pp. 51
Author(s):  
Emanuela Paladini ◽  
Edoardo Vantaggiato ◽  
Fares Bougourzi ◽  
Cosimo Distante ◽  
Abdenour Hadid ◽  
...  

In recent years, automatic tissue phenotyping has attracted increasing interest in the Digital Pathology (DP) field. For Colorectal Cancer (CRC), tissue phenotyping can diagnose the cancer and differentiate between different cancer grades. The development of Whole Slide Images (WSIs) has provided the required data for creating automatic tissue phenotyping systems. In this paper, we study different hand-crafted feature-based and deep learning methods using two popular multi-classes CRC-tissue-type databases: Kather-CRC-2016 and CRC-TP. For the hand-crafted features, we use two texture descriptors (LPQ and BSIF) and their combination. In addition, two classifiers are used (SVM and NN) to classify the texture features into distinct CRC tissue types. For the deep learning methods, we evaluate four Convolutional Neural Network (CNN) architectures (ResNet-101, ResNeXt-50, Inception-v3, and DenseNet-161). Moreover, we propose two Ensemble CNN approaches: Mean-Ensemble-CNN and NN-Ensemble-CNN. The experimental results show that the proposed approaches outperformed the hand-crafted feature-based methods, CNN architectures and the state-of-the-art methods in both databases.


2017 ◽  
Vol 3 (2) ◽  
pp. 811-814 ◽  
Author(s):  
Erik Rodner ◽  
Marcel Simon ◽  
Joachim Denzler

AbstractWe present an automated approach for rating HER2 over-expressions in given whole-slide images of breast cancer histology slides. The slides have a very high resolution and only a small part of it is relevant for the rating.Our approach is based on Convolutional Neural Networks (CNN), which are directly modelling the whole computer vision pipeline, from feature extraction to classification, with a single parameterized model. CNN models have led to a significant breakthrough in a lot of vision applications and showed promising results for medical tasks. However, the required size of training data is still an issue. Our CNN models are pre-trained on a large set of datasets of non-medical images, which prevents over-fitting to the small annotated dataset available in our case. We assume the selection of the probe in the data with just a single mouse click defining a point of interest. This is reasonable especially for slices acquired together with another sample. We sample image patches around the point of interest and obtain bilinear features by passing them through a CNN and encoding the output of the last convolutional layer with its second-order statistics.Our approach ranked second in the Her2 contest held by the University of Warwick achieving 345 points compared to 348 points of the winning team. In addition to pure classification, our approach would also allow for localization of parts of the slice relevant for visual detection of Her2 over-expression.


Healthcare ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 30
Author(s):  
Daniele Giansanti

Thanks to the incredible changes promoted by Information and Communication Technology (ICT) conveyed today by electronic-health (eHealth) and mobile-health (mHealth), many new applications of both organ and cellular diagnostics are now possible [...]


Sign in / Sign up

Export Citation Format

Share Document