scholarly journals Reconstruction of the mass and geometry of snowfall particles frommulti angle snowflake camera (MASC) images

2021 ◽  
Author(s):  
Jussi Leinonen ◽  
Jacopo Grazioli ◽  
Berne Alexis
Keyword(s):  
Total Mass ◽  
3D Structure ◽  
Free Fall ◽  
Maximum Size ◽  
Internal Mass ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Retrieval Algorithms ◽  
Field Campaigns ◽  
Power Law Parameters

Abstract. This paper presents a method named 3D-GAN, based on a generative adversarial network (GAN), to retrieve the total mass, 3D structure and the internal mass distribution of snowflakes. The method uses as input a triplet of binary silhouettes of particles, corresponding to the triplet of stereoscopic images of snowflakes in free fall captured by a Multi-Angle Snowflake Camera (MASC). 3D-GAN is trained on simulated snowflakes of known characteristics whose silhouettes are statistically similar to real MASC observations and it is evaluated by means of snowflake replicas printed in 3D at 1 : 1 scale. The estimation of mass obtained by 3D-GAN has a normalized RMSE (NRMSE) of 40 %, a mean normalized bias (MNB) of 8 % and largely outperforms standard relationships based on maximum size and compactness. The volume of the convex hull of the particles is retrieved with MNRSE of 35 % and MNB of +19 %. In order to illustrate the potential of 3D-GAN to study snowfall microphysics and highlight its complementarity with existing retrieval algorithms, some application examples and ideas are provided, using as showcases the large available datasets of MASC images collected worldwide during various field campaigns. The combination of mass estimates (from 3D-GAN) and hydrometeor classification or riming degree estimation (from independent methods) allows for example to obtain mass-to-size power law parameters stratified on hydrometeor type or riming degree. The parameters obtained in this way are consistent with previous findings, with exponents overall around 2 and increasing with the degree of riming.

scholarly journals CryoGAN: A New Reconstruction Paradigm for Single-Particle Cryo-EM via Deep Adversarial Learning

2020 ◽  
Author(s):  
Harshit Gupta ◽  
Michael T. McCann ◽  
Laurène Donati ◽  
Michael Unser
Keyword(s):  
Single Particle ◽  
3D Structure ◽  
User Interaction ◽  
Real Data ◽  
New Paradigm ◽  
Contrast Transfer Function ◽  
Generative Adversarial Network ◽  
Volume Estimate ◽  
Adversarial Learning ◽  
Adversarial Network

We present CryoGAN, a new paradigm for single-particle cryo-EM reconstruction based on unsupervised deep adversarial learning. The major challenge in single-particle cryo-EM is that the imaged particles have unknown poses. Current reconstruction techniques are based on a marginalized maximum-likelihood formulation that requires calculations over the set of all possible poses for each projection image, a computationally demanding procedure. CryoGAN sidesteps this problem by using a generative adversarial network (GAN) to learn the 3D structure that has simulated projections that most closely match the real data in a distributional sense. The architecture of CryoGAN resembles that of standard GAN, with the twist that the generator network is replaced by a model of the cryo-EM image acquisition process. CryoGAN is an unsupervised algorithm that only demands projection images and an estimate of the contrast transfer function parameters. No initial volume estimate or prior training is needed. Moreover, CryoGAN requires minimal user interaction and can provide reconstructions in a matter of hours on a high-end GPU. In addition, we provide sound mathematical guarantees on the recovery of the correct structure. CryoGAN currently achieves a 8.6 Å resolution on a realistic synthetic dataset. Preliminary results on real β-galactosidase data demonstrate CryoGAN’s ability to exploit data statistics under standard experimental imaging conditions. We believe that this paradigm opens the door to a family of novel likelihood-free algorithms for cryo-EM reconstruction.

Urban 3D Structure Reconstruction Through a Generative Adversarial Network Model

2020 ◽  
Vol 45 (12) ◽  
pp. 10731-10741
Author(s):  
Bharath Haridas Aithal ◽  
Soumya Kanta Das ◽  
Prakash Pilinja Subrahmanya
Keyword(s):  
Network Model ◽  
3D Structure ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Structure Reconstruction

ORGANIC (1).pdf

2017 ◽  
Author(s):  
Benjamin Sanchez-Lengeling ◽  
Carlos Outeiral ◽  
Gabriel L. Guimaraes ◽  
Alan Aspuru-Guzik
Keyword(s):  
Machine Learning ◽  
Learning Community ◽  
Chemical Species ◽  
Material Design ◽  
Organic Photovoltaic ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Photovoltaic Material

Molecular discovery seeks to generate chemical species tailored to very specific needs. In this paper, we present ORGANIC, a framework based on Objective-Reinforced Generative Adversarial Networks (ORGAN), capable of producing a distribution over molecular space that matches with a certain set of desirable metrics. This methodology combines two successful techniques from the machine learning community: a Generative Adversarial Network (GAN), to create non-repetitive sensible molecular species, and Reinforcement Learning (RL), to bias this generative distribution towards certain attributes. We explore several applications, from optimization of random physicochemical properties to candidates for drug discovery and organic photovoltaic material design.

Role of General Adversarial Networks in Mammogram Analysis: A Review

2020 ◽  
Vol 16 (7) ◽  
pp. 863-877
Author(s):  
Annapoorani Gopal ◽  
Lathaselvi Gandhimaruthian ◽  
Javid Ali
Keyword(s):  
Breast Tumor ◽  
Deep Neural Networks ◽  
Training Data ◽  
Learning Technology ◽  
Breast Cancers ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Tumor Extraction

The Deep Neural Networks have gained prominence in the biomedical domain, becoming the most commonly used networks after machine learning technology. Mammograms can be used to detect breast cancers with high precision with the help of Convolutional Neural Network (CNN) which is deep learning technology. An exhaustive labeled data is required to train the CNN from scratch. This can be overcome by deploying Generative Adversarial Network (GAN) which comparatively needs lesser training data during a mammogram screening. In the proposed study, the application of GANs in estimating breast density, high-resolution mammogram synthesis for clustered microcalcification analysis, effective segmentation of breast tumor, analysis of the shape of breast tumor, extraction of features and augmentation of the image during mammogram classification have been extensively reviewed.

scholarly journals Realistic Sonar Image Simulation Using Generative Adversarial Network

2019 ◽  
Vol 52 (21) ◽  
pp. 291-296 ◽  
Author(s):  
Minsung Sung ◽  
Jason Kim ◽  
Juhwan Kim ◽  
Son-Cheol Yu
Keyword(s):  
Image Simulation ◽  
Generative Adversarial Network ◽  
Sonar Image ◽  
Adversarial Network
Sign in / Sign up

Export Citation Format

Share Document