scholarly journals Faculty Opinions recommendation of Human-interpretable image features derived from densely mapped cancer pathology slides predict diverse molecular phenotypes.

Author(s):  
Chao Cheng
2021 ◽  
Vol 12 (1) ◽  
Author(s):  
James A. Diao ◽  
Jason K. Wang ◽  
Wan Fung Chui ◽  
Victoria Mountain ◽  
Sai Chowdary Gullapally ◽  
...  

AbstractComputational methods have made substantial progress in improving the accuracy and throughput of pathology workflows for diagnostic, prognostic, and genomic prediction. Still, lack of interpretability remains a significant barrier to clinical integration. We present an approach for predicting clinically-relevant molecular phenotypes from whole-slide histopathology images using human-interpretable image features (HIFs). Our method leverages >1.6 million annotations from board-certified pathologists across >5700 samples to train deep learning models for cell and tissue classification that can exhaustively map whole-slide images at two and four micron-resolution. Cell- and tissue-type model outputs are combined into 607 HIFs that quantify specific and biologically-relevant characteristics across five cancer types. We demonstrate that these HIFs correlate with well-known markers of the tumor microenvironment and can predict diverse molecular signatures (AUROC 0.601–0.864), including expression of four immune checkpoint proteins and homologous recombination deficiency, with performance comparable to ‘black-box’ methods. Our HIF-based approach provides a comprehensive, quantitative, and interpretable window into the composition and spatial architecture of the tumor microenvironment.


2020 ◽  
Author(s):  
James A. Diao ◽  
Wan Fung Chui ◽  
Jason K. Wang ◽  
Richard N. Mitchell ◽  
Sudha K. Rao ◽  
...  

While computational methods have made substantial progress in improving the accuracy and throughput of pathology workflows for diagnostic, prognostic, and genomic prediction, lack of interpretability remains a significant barrier to clinical integration. In this study, we present a novel approach for predicting clinically-relevant molecular phenotypes from histopathology whole-slide images (WSIs) using human-interpretable image features (HIFs). Our method leverages >1.6 million annotations from board-certified pathologists across >5,700 WSIs to train deep learning models for high-resolution tissue classification and cell detection across entire WSIs in five cancer types. Combining cell- and tissue-type models enables computation of 607 HIFs that comprehensively capture specific and biologically-relevant characteristics of multiple tumors. We demonstrate that these HIFs correlate with well-known markers of the tumor microenvironment (TME) and can predict diverse molecular signatures, including immune checkpoint protein expression and homologous recombination deficiency (HRD). Our HIF-based approach provides a novel, quantitative, and interpretable window into the composition and spatial architecture of the TME.


Author(s):  
J.R. Parsons ◽  
C.W. Hoelke

The direct imaging of a crystal lattice has intrigued electron microscopists for many years. What is of interest, of course, is the way in which defects perturb their atomic regularity. There are problems, however, when one wishes to relate aperiodic image features to structural aspects of crystalline defects. If the defect is inclined to the foil plane and if, as is the case with present 100 kV transmission electron microscopes, the objective lens is not perfect, then terminating fringes and fringe bending seen in the image cannot be related in a simple way to lattice plane geometry in the specimen (1).The purpose of the present work was to devise an experimental test which could be used to confirm, or not, the existence of a one-to-one correspondence between lattice image and specimen structure over the desired range of specimen spacings. Through a study of computed images the following test emerged.


Author(s):  
W. Krakow ◽  
D. A. Smith

The successful determination of the atomic structure of [110] tilt boundaries in Au stems from the investigation of microscope performance at intermediate accelerating voltages (200 and 400kV) as well as a detailed understanding of how grain boundary image features depend on dynamical diffraction processes variation with specimen and beam orientations. This success is also facilitated by improving image quality by digital image processing techniques to the point where a structure image is obtained and each atom position is represented by a resolved image feature. Figure 1 shows an example of a low angle (∼10°) Σ = 129/[110] tilt boundary in a ∼250Å Au film, taken under tilted beam brightfield imaging conditions, to illustrate the steps necessary to obtain the atomic structure configuration from the image. The original image of Fig. 1a shows the regular arrangement of strain-field images associated with the cores of ½ [10] primary dislocations which are separated by ∼15Å.


Author(s):  
W.W. Adams ◽  
G. Price ◽  
A. Krause

It has been shown that there are numerous advantages in imaging both coated and uncoated polymers in scanning electron microscopy (SEM) at low voltages (LV) from 0.5 to 2.0 keV compared to imaging at conventional voltages of 10 to 20 keV. The disadvantages of LVSEM of degraded resolution and decreased beam current have been overcome with the new generation of field emission gun SEMs. In imaging metal coated polymers in LVSEM beam damage is reduced, contrast is improved, and charging from irregularly shaped features (which may be unevenly coated) is reduced or eliminated. Imaging uncoated polymers in LVSEM allows direct observation of the surface with little or no charging and with no alterations of surface features from the metal coating process required for higher voltage imaging. This is particularly important for high resolution (HR) studies of polymers where it is desired to image features 1 to 10 nm in size. Metal sputter coating techniques produce a 10 - 20 nm film that has its own texture which can obscure topographical features of the original polymer surface. In examining thin, uncoated insulating samples on a conducting substrate at low voltages the effect of sample-beam interactions on image formation and resolution will differ significantly from the effect at higher accelerating voltages. We discuss here sample-beam interactions in single crystals on conducting substrates at low voltages and also present the first results on HRSEM of single crystal morphologies which show some of these effects.


2020 ◽  
pp. 1-12
Author(s):  
Wu Xin ◽  
Qiu Daping

The inheritance and innovation of ancient architecture decoration art is an important way for the development of the construction industry. The data process of traditional ancient architecture decoration art is relatively backward, which leads to the obvious distortion of the digitalization of ancient architecture decoration art. In order to improve the digital effect of ancient architecture decoration art, based on neural network, this paper combines the image features to construct a neural network-based ancient architecture decoration art data system model, and graphically expresses the static construction mode and dynamic construction process of the architecture group. Based on this, three-dimensional model reconstruction and scene simulation experiments of architecture groups are realized. In order to verify the performance effect of the system proposed in this paper, it is verified through simulation and performance testing, and data visualization is performed through statistical methods. The result of the study shows that the digitalization effect of the ancient architecture decoration art proposed in this paper is good.


2014 ◽  
Vol 5 (2) ◽  
pp. 151-156
Author(s):  
Z. Mechbal ◽  
A. Khamlichi

Composites made from E-glass/epoxy or aramid/epoxy are frequently used in aircraft and aerospace industries. These materials are prone to suffer from the presence of delamination, which can reduce severely the performance of aircrafts and even threaten their safety. Since electric conductivity of these composites is rather small, they can propagate electromagnetic waves. Detection of delamination damage can then be monitored by using an electromagnetic penetrating radar scanner, which consists of emitting waves having the form of short time pulses that are centered on a given work frequency. While propagating, these waves undergo partial reflection when running into an obstacle or a material discontinuity. Habitually, the radar is moved at constant speed along a straight path and the reflected signal is processed as a radargram that gives the reflected energy as function of the two-way time and the antenna position.In this work, modeling of electromagnetic wave propagation in composites made from E-glass/epoxy was performed analytically. The electromagnetic wave reflection from a delamination defect was analyzed as function of key intervening factors which include the defect extent and depth, as well as the work frequency. Various simulations were performed and the obtained results have enabled to correlate the reflection pattern image features to the actual delamination defect characteristics which can provide quantification of delamination.


Sign in / Sign up

Export Citation Format

Share Document