Shale Digital Core Image Generation Based on Generative Adversarial Networks

2020 ◽  
Vol 143 (3) ◽  
Author(s):  
Wenshu Zha ◽  
Xingbao Li ◽  
Daolun Li ◽  
Yan Xing ◽  
Lei He ◽  
...  
Keyword(s):  
Organic Matter ◽  
Morphological Characteristics ◽  
Generative Adversarial Networks ◽  
Reconstruction Method ◽  
Core Samples ◽  
Adversarial Networks ◽  
Training Samples ◽  
Digital Core ◽  
Artificial Intelligence Models ◽  
Convolution Properties

Abstract Stochastic reconstruction of digital core images is a vital part of digital core physics analysis, aiming to generate representative microstructure samples for sampling and uncertainty quantification analysis. This paper proposes a novel reconstruction method of the digital core of shale based on generative adversarial networks (GANs) with powerful capabilities of the generation of samples. GANs are a series of unsupervised generative artificial intelligence models that take the noise vector as an input. In this paper, the GANs with a generative and a discriminative network are created respectively, and the shale image with 45 nm/pixel preprocessed by the three-value-segmentation method is used as training samples. The generative network is used to learn the distribution of real training samples, and the discriminative network is used to distinguish real samples from synthetic ones. Finally, realistic digital core samples of shale are successfully reconstructed through the adversarial training process. We used the Fréchet inception distance (FID) and Kernel inception distance (KID) to evaluate the ability of GANs to generate real digital core samples of shale. The comparison of the morphological characteristics between them, such as the ratio of organic matter and specific surface area of organic matter, indicates that real and reconstructed samples are highly close. The results show that deep convolutional generative adversarial networks with full convolution properties can reconstruct digital core samples of shale effectively. Therefore, compared with the classical methods of reconstruction, the new reconstruction method is more promising.

Intrusion detection of railway clearance from infrared images using generative adversarial networks

2020 ◽  
pp. 1-13
Author(s):  
Yundong Li ◽  
Yi Liu ◽  
Han Dong ◽  
Wei Hu ◽  
Chen Lin
Keyword(s):  
Intrusion Detection ◽  
Synthetic Data ◽  
Generative Adversarial Networks ◽  
Generation Model ◽  
Single Shot ◽  
Data Generation ◽  
Infrared Images ◽  
Adversarial Networks ◽  
Training Samples ◽  
Rgb Images

The intrusion detection of railway clearance is crucial for avoiding railway accidents caused by the invasion of abnormal objects, such as pedestrians, falling rocks, and animals. However, detecting intrusions using deep learning methods from infrared images captured at night remains a challenging task because of the lack of sufficient training samples. To address this issue, a transfer strategy that migrates daytime RGB images to the nighttime style of infrared images is proposed in this study. The proposed method consists of two stages. In the first stage, a data generation model is trained on the basis of generative adversarial networks using RGB images and a small number of infrared images, and then, synthetic samples are generated using a well-trained model. In the second stage, a single shot multibox detector (SSD) model is trained using synthetic data and utilized to detect abnormal objects from infrared images at nighttime. To validate the effectiveness of the proposed method, two groups of experiments, namely, railway and non-railway scenes, are conducted. Experimental results demonstrate the effectiveness of the proposed method, and an improvement of 17.8% is achieved for object detection at nighttime.

scholarly journals Harnessing GANs for Zero-Shot Learning of New Classes in Visual Speech Recognition

2020 ◽  
Vol 34 (03) ◽  
pp. 2645-2652 ◽  
Author(s):  
Yaman Kumar ◽  
Dhruva Sahrawat ◽  
Shubham Maheshwari ◽  
Debanjan Mahata ◽  
Amanda Stent ◽  
...  
Keyword(s):  
Speech Recognition ◽  
Classification Problem ◽  
Visual Speech ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Adversarial Networks ◽  
Novel Approach ◽  
Visual Speech Recognition ◽  
Training Samples ◽  
English Training

Visual Speech Recognition (VSR) is the process of recognizing or interpreting speech by watching the lip movements of the speaker. Recent machine learning based approaches model VSR as a classification problem; however, the scarcity of training data leads to error-prone systems with very low accuracies in predicting unseen classes. To solve this problem, we present a novel approach to zero-shot learning by generating new classes using Generative Adversarial Networks (GANs), and show how the addition of unseen class samples increases the accuracy of a VSR system by a significant margin of 27% and allows it to handle speaker-independent out-of-vocabulary phrases. We also show that our models are language agnostic and therefore capable of seamlessly generating, using English training data, videos for a new language (Hindi). To the best of our knowledge, this is the first work to show empirical evidence of the use of GANs for generating training samples of unseen classes in the domain of VSR, hence facilitating zero-shot learning. We make the added videos for new classes publicly available along with our code1.

scholarly journals Blind Image Separation Method Based on Cascade Generative Adversarial Networks

2021 ◽  
Vol 11 (20) ◽  
pp. 9416
Author(s):  
Fei Jia ◽  
Jindong Xu ◽  
Xiao Sun ◽  
Yongli Ma ◽  
Mengying Ni
Keyword(s):  
Prior Knowledge ◽  
Image Synthesis ◽  
Generative Adversarial Networks ◽  
Synthetic Image ◽  
Adversarial Networks ◽  
Training Samples ◽  
Image Separation ◽  
Blind Image ◽  
Insufficient Number ◽  
Image Datasets

To solve the challenge of single-channel blind image separation (BIS) caused by unknown prior knowledge during the separation process, we propose a BIS method based on cascaded generative adversarial networks (GANs). To ensure that the proposed method can perform well in different scenarios and to address the problem of an insufficient number of training samples, a synthetic network is added to the separation network. This method is composed of two GANs: a U-shaped GAN (UGAN), which is used to learn image synthesis, and a pixel-to-attention GAN (PAGAN), which is used to learn image separation. The two networks jointly complete the task of image separation. UGAN uses the unpaired mixed image and the unmixed image to learn the mixing style, thereby generating an image with the “true” mixing characteristics which addresses the problem of an insufficient number of training samples for the PAGAN. A self-attention mechanism is added to the PAGAN to quickly extract important features from the image data. The experimental results show that the proposed method achieves good results on both synthetic image datasets and real remote sensing image datasets. Moreover, it can be used for image separation in different scenarios which lack prior knowledge and training samples.

scholarly journals Investigating the Performance of Generative Adversarial Networks for Prostate Tissue Detection and Segmentation

2020 ◽  
Vol 6 (9) ◽  
pp. 83 ◽  
Author(s):  
Ufuk Cem Birbiri ◽  
Azam Hamidinekoo ◽  
Amélie Grall ◽  
Paul Malcolm ◽  
Reyer Zwiggelaar
Keyword(s):  
Region Of Interest ◽  
Training Data ◽  
Prostate Tissue ◽  
Generative Adversarial Networks ◽  
Correct Identification ◽  
Adversarial Networks ◽  
Training Samples ◽  
Mri Scans ◽  
Magnetic Resonance Imaging Mri ◽  
Public Datasets

The manual delineation of region of interest (RoI) in 3D magnetic resonance imaging (MRI) of the prostate is time-consuming and subjective. Correct identification of prostate tissue is helpful to define a precise RoI to be used in CAD systems in clinical practice during diagnostic imaging, radiotherapy and monitoring the progress of disease. Conditional GAN (cGAN), cycleGAN and U-Net models and their performances were studied for the detection and segmentation of prostate tissue in 3D multi-parametric MRI scans. These models were trained and evaluated on MRI data from 40 patients with biopsy-proven prostate cancer. Due to the limited amount of available training data, three augmentation schemes were proposed to artificially increase the training samples. These models were tested on a clinical dataset annotated for this study and on a public dataset (PROMISE12). The cGAN model outperformed the U-Net and cycleGAN predictions owing to the inclusion of paired image supervision. Based on our quantitative results, cGAN gained a Dice score of 0.78 and 0.75 on the private and the PROMISE12 public datasets, respectively.

scholarly journals SARA-GAN: Self-Attention and Relative Average Discriminator Based Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction

2020 ◽  
Vol 14 ◽  
Author(s):  
Zhenmou Yuan ◽  
Mingfeng Jiang ◽  
Yaming Wang ◽  
Bo Wei ◽  
Yongming Li ◽  
...  
Keyword(s):  
Signal To Noise Ratio ◽  
Similarity Index ◽  
Structural Similarity ◽  
Attention Mechanism ◽  
Generative Adversarial Networks ◽  
Reconstruction Method ◽  
Mri Imaging ◽  
Adversarial Networks ◽  
Reconstruction Methods ◽  
Mri Reconstruction

Research on undersampled magnetic resonance image (MRI) reconstruction can increase the speed of MRI imaging and reduce patient suffering. In this paper, an undersampled MRI reconstruction method based on Generative Adversarial Networks with the Self-Attention mechanism and the Relative Average discriminator (SARA-GAN) is proposed. In our SARA-GAN, the relative average discriminator theory is applied to make full use of the prior knowledge, in which half of the input data of the discriminator is true and half is fake. At the same time, a self-attention mechanism is incorporated into the high-layer of the generator to build long-range dependence of the image, which can overcome the problem of limited convolution kernel size. Besides, spectral normalization is employed to stabilize the training process. Compared with three widely used GAN-based MRI reconstruction methods, i.e., DAGAN, DAWGAN, and DAWGAN-GP, the proposed method can obtain a higher peak signal-to-noise ratio (PSNR) and structural similarity index measure(SSIM), and the details of the reconstructed image are more abundant and more realistic for further clinical scrutinization and diagnostic tasks.

scholarly journals Connectivity-informed drainage network generation using deep convolution generative adversarial networks

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Sung Eun Kim ◽  
Yongwon Seo ◽  
Junshik Hwang ◽  
Hongkyu Yoon ◽  
Jonghyun Lee
Keyword(s):  
Generative Adversarial Networks ◽  
Compact Representation ◽  
Drainage Network ◽  
Stochastic Network ◽  
The Novel ◽  
High Contrast ◽  
Directional Information ◽  
Adversarial Networks ◽  
Drainage Networks ◽  
Training Samples

AbstractStochastic network modeling is often limited by high computational costs to generate a large number of networks enough for meaningful statistical evaluation. In this study, Deep Convolutional Generative Adversarial Networks (DCGANs) were applied to quickly reproduce drainage networks from the already generated network samples without repetitive long modeling of the stochastic network model, Gibb’s model. In particular, we developed a novel connectivity-informed method that converts the drainage network images to the directional information of flow on each node of the drainage network, and then transforms it into multiple binary layers where the connectivity constraints between nodes in the drainage network are stored. DCGANs trained with three different types of training samples were compared; (1) original drainage network images, (2) their corresponding directional information only, and (3) the connectivity-informed directional information. A comparison of generated images demonstrated that the novel connectivity-informed method outperformed the other two methods by training DCGANs more effectively and better reproducing accurate drainage networks due to its compact representation of the network complexity and connectivity. This work highlights that DCGANs can be applicable for high contrast images common in earth and material sciences where the network, fractures, and other high contrast features are important.

scholarly journals Challenges and Prospects of Digital Core-Reconstruction Research

Geofluids ◽  
2019 ◽  
Vol 2019 ◽  
pp. 1-29 ◽  
Author(s):  
Linqi Zhu ◽  
Chong Zhang ◽  
Chaomo Zhang ◽  
Xueqing Zhou ◽  
Zhansong Zhang ◽  
...  
Keyword(s):  
Oil And Gas ◽  
Three Dimensional ◽  
Morphological Characteristics ◽  
Research Area ◽  
Rock Properties ◽  
Reconstruction Method ◽  
Oil And Gas Exploration ◽  
Stochastic Reconstruction ◽  
Reconstruction Methods ◽  
Digital Core

The simulation of various rock properties based on three-dimensional digital cores plays an increasingly important role in oil and gas exploration and development. The accuracy of 3D digital core reconstruction is important for determining rock properties. In this paper, existing 3D digital core-reconstruction methods are divided into two categories: 3D digital cores based on physical experiments and 3D digital core stochastic reconstructions based on two-dimensional (2D) slices. Additionally, 2D slice-based digital core stochastic reconstruction techniques are classified into four types: a stochastic reconstruction method based on 2D slice mathematical-feature statistical constraints, a stochastic reconstruction method based on statistical constraints that are related to 2D slice morphological characteristics, a physics process-based stochastic reconstruction method, and a hybrid stochastic reconstruction method. The progress related to these various stochastic reconstruction methods, the characteristics of constructed 3D digital cores, and the potential of these methods are analysed and discussed in detail. Finally, reasonable prospects are presented based on the current state of this research area. Currently, studies on digital core reconstruction, especially for the 3D digital core stochastic reconstruction method based on 2D slices, are still very rough, and much room for improvement remains. In particular, we emphasize the importance of evaluating functions, multiscale 3D digital cores, multicomponent 3D digital cores, and disciplinary intersection methods in the 3D construction of digital cores. These four directions should provide focus, alongside challenges, for this research area in the future. This review provides important insights into 3D digital core reconstruction.

scholarly journals Automated Segmentation of Epithelial Tissue Using Cycle-Consistent Generative Adversarial Networks

2018 ◽  
Author(s):  
Matthias Häring ◽  
Jörg Großhans ◽  
Fred Wolf ◽  
Stephan Eule
Keyword(s):  
Ground Truth ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Epithelial Tissue ◽  
Automated Segmentation ◽  
Segmentation Method ◽  
Adversarial Networks ◽  
Training Samples ◽  
Segmentation Of Images ◽  
Image Mask

AbstractA central problem in biomedical imaging is the automated segmentation of images for further quantitative analysis. Recently, fully convolutional neural networks, such as the U-Net, were applied successfully in a variety of segmentation tasks. A downside of this approach is the requirement for a large amount of well-prepared training samples, consisting of image - ground truth mask pairs. Since training data must be created by hand for each experiment, this task can be very costly and time-consuming. Here, we present a segmentation method based on cycle consistent generative adversarial networks, which can be trained even in absence of prepared image - mask pairs. We show that it successfully performs image segmentation tasks on samples with substantial defects and even generalizes well to different tissue types.

scholarly journals License Plate Image Reconstruction Based on Generative Adversarial Networks

2021 ◽  
Vol 13 (15) ◽  
pp. 3018
Author(s):  
Mianfen Lin ◽  
Liangxin Liu ◽  
Fei Wang ◽  
Jingcong Li ◽  
Jiahui Pan
Keyword(s):  
Image Reconstruction ◽  
Intelligent Transportation Systems ◽  
Structural Similarity ◽  
Input Image ◽  
Transportation Systems ◽  
Image Features ◽  
Generative Adversarial Networks ◽  
License Plate ◽  
Reconstruction Method ◽  
Adversarial Networks

License plate image reconstruction plays an important role in Intelligent Transportation Systems. In this paper, a super-resolution image reconstruction method based on Generative Adversarial Networks (GAN) is proposed. The proposed method mainly consists of four parts: (1) pretreatment for the input image; (2) image features extraction using residual dense network; (3) introduction of progressive sampling, which can provide larger receptive field and more information details; (4) discriminator based on markovian discriminator (PatchGAN) can make a more accurate judgment, which guides the generator to reconstruct images with higher quality and details. Regarding the Chinese City Parking Dataset (CCPD) dataset, compared with the current better algorithm, the experiment results prove that our model has a higher peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) and less reconstruction time, which verifies the feasibility of our approach.

Sign in / Sign up

Export Citation Format

Share Document