3D Single Molecule Localization Microscopy via Deep Learning

Author(s):  
Xiaoxu Li ◽  
Runzhao Yang ◽  
Yuchen Guo ◽  
Hui Qiao ◽  
Qionghai Dai
2020 ◽  
Author(s):  
Anish Mukherjee

The quality of super-resolution images largely depends on the performance of the emitter localization algorithm used to localize point sources. In this article, an overview of the various techniques which are used to localize point sources in single-molecule localization microscopy are discussed and their performances are compared. This overview can help readers to select a localization technique for their application. Also, an overview is presented about the emergence of deep learning methods that are becoming popular in various stages of single-molecule localization microscopy. The state of the art deep learning approaches are compared to the traditional approaches and the trade-offs of selecting an algorithm for localization are discussed.


2021 ◽  
Vol 1 ◽  
Author(s):  
Benjamin Blundell ◽  
Christian Sieben ◽  
Suliana Manley ◽  
Ed Rosten ◽  
QueeLim Ch’ng ◽  
...  

Understanding the structure of a protein complex is crucial in determining its function. However, retrieving accurate 3D structures from microscopy images is highly challenging, particularly as many imaging modalities are two-dimensional. Recent advances in Artificial Intelligence have been applied to this problem, primarily using voxel based approaches to analyse sets of electron microscopy images. Here we present a deep learning solution for reconstructing the protein complexes from a number of 2D single molecule localization microscopy images, with the solution being completely unconstrained. Our convolutional neural network coupled with a differentiable renderer predicts pose and derives a single structure. After training, the network is discarded, with the output of this method being a structural model which fits the data-set. We demonstrate the performance of our system on two protein complexes: CEP152 (which comprises part of the proximal toroid of the centriole) and centrioles.


2019 ◽  
Author(s):  
Ismail M. Khater ◽  
Stephane T. Aroca-Ouellette ◽  
Fanrui Meng ◽  
Ivan Robert Nabi ◽  
Ghassan Hamarneh

AbstractCaveolae are plasma membrane invaginations whose formation requires caveolin-1 (Cav1), the adaptor protein polymerase I, and the transcript release factor (PTRF or CAVIN1). Caveolae have an important role in cell functioning, signaling, and disease. In the absence of CAVIN1/PTRF, Cav1 forms non-caveolar membrane domains called scaffolds. In this work, we train machine learning models to automatically distinguish between caveolae and scaffolds from single molecule localization microscopy (SMLM) data. We apply machine learning algorithms to discriminate biological structures from SMLM data. Our work is the first that is leveraging machine learning approaches (including deep learning models) to automatically identifying biological structures from SMLM data. In particular, we develop and compare three binary classification methods to identify whether or not a given 3D cluster of Cav1 proteins is a caveolae. The first uses a random forest classifier applied to 28 hand-crafted/designed features, the second uses a convolutional neural net (CNN) applied to a projection of the point clouds onto three planes, and the third uses a PointNet model, a recent development that can directly take point clouds as its input. We validate our methods on a dataset of super-resolution microscopy images of PC3 prostate cancer cells labeled for Cav1. Specifically, we have images from two cell populations: 10 PC3 and 10 CAVIN1/PTRF-transfected PC3 cells (PC3-PTRF cells) that form caveolae. We obtained a balanced set of 1714 different cellular structures. Our results show that both the random forest on hand-designed features and the deep learning approach achieve high accuracy in distinguishing the intrinsic features of the caveolae and non-caveolae biological structures. More specifically, both random forest and deep CNN classifiers achieve classification accuracy reaching 94% on our test set, while the PointNet model only reached 83% accuracy. We also discuss the pros and cons of the different approaches.


PLoS ONE ◽  
2019 ◽  
Vol 14 (8) ◽  
pp. e0211659 ◽  
Author(s):  
Ismail M. Khater ◽  
Stephane T. Aroca-Ouellette ◽  
Fanrui Meng ◽  
Ivan Robert Nabi ◽  
Ghassan Hamarneh

2020 ◽  
Vol 11 (5) ◽  
pp. 2705
Author(s):  
Sunil Kumar Gaire ◽  
Yang Zhang ◽  
Hongyu Li ◽  
Ray Yu ◽  
Hao F. Zhang ◽  
...  

2019 ◽  
Author(s):  
Zacharias Thiel ◽  
Pablo Rivera-Fuentes

Many biomacromolecules are known to cluster in microdomains with specific subcellular localization. In the case of enzymes, this clustering greatly defines their biological functions. Nitroreductases are enzymes capable of reducing nitro groups to amines and play a role in detoxification and pro-drug activation. Although nitroreductase activity has been detected in mammalian cells, the subcellular localization of this activity remains incompletely characterized. Here, we report a fluorescent probe that enables super-resolved imaging of pools of nitroreductase activity within mitochondria. This probe is activated sequentially by nitroreductases and light to give a photo-crosslinked adduct of active enzymes. In combination with a general photoactivatable marker of mitochondria, we performed two-color, threedimensional, single-molecule localization microscopy. These experiments allowed us to image the sub-mitochondrial organization of microdomains of nitroreductase activity.<br>


2019 ◽  
Author(s):  
Zacharias Thiel ◽  
Pablo Rivera-Fuentes

Many biomacromolecules are known to cluster in microdomains with specific subcellular localization. In the case of enzymes, this clustering greatly defines their biological functions. Nitroreductases are enzymes capable of reducing nitro groups to amines and play a role in detoxification and pro-drug activation. Although nitroreductase activity has been detected in mammalian cells, the subcellular localization of this activity remains incompletely characterized. Here, we report a fluorescent probe that enables super-resolved imaging of pools of nitroreductase activity within mitochondria. This probe is activated sequentially by nitroreductases and light to give a photo-crosslinked adduct of active enzymes. In combination with a general photoactivatable marker of mitochondria, we performed two-color, threedimensional, single-molecule localization microscopy. These experiments allowed us to image the sub-mitochondrial organization of microdomains of nitroreductase activity.<br>


Sign in / Sign up

Export Citation Format

Share Document