Exhaustive Probabilistic Neural Network for attribute selection and supervised seismic facies classification

2020 ◽  
pp. 1-67
Author(s):  
David Lubo-Robles ◽  
Thang Ha ◽  
Sivaramakrishnan Lakshmivarahan ◽  
Kurt J. Marfurt ◽  
Matthew J. Pranter
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Probabilistic Neural Network ◽  
Learning Algorithms ◽  
Computational Cost ◽  
Component Analysis ◽  
Machine Learning Algorithms ◽  
Seismic Facies ◽  
Seismic Survey ◽  
Facies Classification

Machine learning algorithms such as principal component analysis (PCA), independent component analysis (ICA), self-organizing maps (SOM), and artificial neural networks (ANN), have been used by geoscientists to not only accelerate the interpretation of their data, but also to provide a more quantitative estimate of the likelihood that any voxel belongs to a given facies. Identifying the best combination of attributes needed to perform either supervised or unsupervised machine learning tasks continues to be the most-asked question by interpreters. In the past decades, stepwise regression and genetic algorithms have been used together with supervised learning algorithms to select the best number and combination of attributes. For reasons of computational efficiency, these techniques do not test all the seismic attribute combinations, potentially leading to a suboptimal classification. In this study, we develop an exhaustive probabilistic neural network (PNN) algorithm which exploits the PNN’s capacity in exploring non-linear relationships to obtain the optimal attribute subset that best differentiates target seismic facies of interest. We show the efficacy of our proposed workflow in differentiating salt from non-salt seismic facies in a Eugene Island seismic survey, offshore Louisiana. We find that from seven input candidate attributes, the Exhaustive PNN is capable of removing irrelevant attributes by selecting a smaller subset of four seismic attributes. The enhanced classification using fewer attributes also reduces the computational cost. We then use the resulting facies probability volumes to construct the 3D distribution of the salt diapir geobodies embedded in a stratigraphic matrix.

EMOTIONS RECOGNITION IN HUMAN SPEECH USING DEEP NEURAL NETWORKS

2021 ◽  
pp. 44-51
Author(s):  
E. Yu. Shchetinin
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Recurrent Neural Network ◽  
Deep Neural Networks ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Audio Recordings ◽  
Computer Studies

The recognition of human emotions is one of the most relevant and dynamically developing areas of modern speech technologies, and the recognition of emotions in speech (RER) is the most demanded part of them. In this paper, we propose a computer model of emotion recognition based on an ensemble of bidirectional recurrent neural network with LSTM memory cell and deep convolutional neural network ResNet18. In this paper, computer studies of the RAVDESS database containing emotional speech of a person are carried out. RAVDESS-a data set containing 7356 files. Entries contain the following emotions: 0 – neutral, 1 – calm, 2 – happiness, 3 – sadness, 4 – anger, 5 – fear, 6 – disgust, 7 – surprise. In total, the database contains 16 classes (8 emotions divided into male and female) for a total of 1440 samples (speech only). To train machine learning algorithms and deep neural networks to recognize emotions, existing audio recordings must be pre-processed in such a way as to extract the main characteristic features of certain emotions. This was done using Mel-frequency cepstral coefficients, chroma coefficients, as well as the characteristics of the frequency spectrum of audio recordings. In this paper, computer studies of various models of neural networks for emotion recognition are carried out on the example of the data described above. In addition, machine learning algorithms were used for comparative analysis. Thus, the following models were trained during the experiments: logistic regression (LR), classifier based on the support vector machine (SVM), decision tree (DT), random forest (RF), gradient boosting over trees – XGBoost, convolutional neural network CNN, recurrent neural network RNN (ResNet18), as well as an ensemble of convolutional and recurrent networks Stacked CNN-RNN. The results show that neural networks showed much higher accuracy in recognizing and classifying emotions than the machine learning algorithms used. Of the three neural network models presented, the CNN + BLSTM ensemble showed higher accuracy.

Applications of Artificial Neural Networks for Seismic Facies Classification

2021 ◽  
Vol 73 (02) ◽  
pp. 68-69
Author(s):  
Chris Carpenter
Keyword(s):  
Neural Network ◽  
Seismic Data ◽  
Reservoir Characterization ◽  
Probabilistic Neural Network ◽  
Oil Field ◽  
Seismic Facies ◽  
Data Set ◽  
Full Field ◽  
Facies Classification

This article, written by JPT Technology Editor Chris Carpenter, contains highlights of paper SPE 200577, “Applications of Artificial Neural Networks for Seismic Facies Classification: A Case Study From the Mid-Cretaceous Reservoir in a Supergiant Oil Field,” by Ali Al-Ali, Karl Stephen, SPE, and Asghar Shams, Heriot-Watt University, prepared for the 2020 SPE Europec featured at the 82nd EAGE Conference and Exhibition, originally scheduled to be held in Amsterdam, 1-3 December. The paper has not been peer reviewed. Facies classification using data from sources such as wells and outcrops cannot capture all reservoir characterization in the interwell region. Therefore, as an alternative approach, seismic facies classification schemes are applied to reduce the uncertainties in the reservoir model. In this study, a machine-learning neural network was introduced to predict the lithology required for building a full-field Earth model for carbonate reservoirs in southern Iraq. The work and the methodology provide a significant improvement in facies classification and reveal the capability of a probabilistic neural network technique. Introduction The use of machine learning in seismic facies classification has increased gradually during the past decade in the interpretation of 3D and 4D seismic volumes and reservoir characterization work flows. The complete paper provides a literature review regarding this topic. Previously, seismic reservoir characterization has revealed the heterogeneity of the Mishrif reservoir and its distribution in terms of the pore system and the structural model. However, the main objective of this work is to classify and predict the heterogeneous facies of the carbonate Mishrif reservoir in a giant oil field using a multilayer feed-forward network (MLFN) and a probabilistic neural network (PNN) in nonlinear facies classification techniques. A related objective was to find any domain-specific causal relationships among input and output variables. These two methods have been applied to classify and predict the presence of different facies in Mishrif reservoir rock types. Case Study Reservoir and Data Set Description. The West Qurna field is a giant, multibillion-barrel oil field in the southern Mesopotamian Basin with multiple carbonate and clastic reservoirs. The overall structure of the field is a north/south trending anticline steep on the western flank and gentle on the eastern flank. Many producing reservoirs developed in this oil field; however, the Mid- Cretaceous Mishrif reservoir is the main producing reservoir. The reservoir consists of thick carbonate strata (roughly 250 m) deposited on a shallow water platform adjacent to more-distal, deeper-water nonreservoir carbonate facies developing into three stratigraphic sequence units in the second order. Mishrif facies are characterized by a porosity greater than 20% and large permeability contrast from grainstones to microporosity (10-1000 md). The first full-field 3D seismic data set was achieved over 500 km2 during 2012 and 2013 in order to plan the development of all field reservoirs. A de-tailed description of the reservoir has been determined from well logs and core and seismic data. This study is mainly based on facies log (22 wells) and high-resolution 3D seismic volume to generate seismic attributes as the input data for the training of the neural network model. The model is used to evaluate lithofacies in wells without core data but with appropriate facies logs. Also, testing was carried out in parallel with the core data to verify the results of facies classification.

scholarly journals Development and Evaluation of the Combined Machine Learning Models for the Prediction of Dam Inflow

Water ◽  
2020 ◽  
Vol 12 (10) ◽  
pp. 2927
Author(s):  
Jiyeong Hong ◽  
Seoro Lee ◽  
Joo Hyun Bae ◽  
Jimin Lee ◽  
Woon Ji Park ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Random Forest ◽  
Multilayer Perceptron ◽  
Short Term Memory ◽  
Learning Algorithms ◽  
Absolute Error ◽  
Machine Learning Algorithms ◽  
Gradient Boosting ◽  
Dam Inflow

Predicting dam inflow is necessary for effective water management. This study created machine learning algorithms to predict the amount of inflow into the Soyang River Dam in South Korea, using weather and dam inflow data for 40 years. A total of six algorithms were used, as follows: decision tree (DT), multilayer perceptron (MLP), random forest (RF), gradient boosting (GB), recurrent neural network–long short-term memory (RNN–LSTM), and convolutional neural network–LSTM (CNN–LSTM). Among these models, the multilayer perceptron model showed the best results in predicting dam inflow, with the Nash–Sutcliffe efficiency (NSE) value of 0.812, root mean squared errors (RMSE) of 77.218 m3/s, mean absolute error (MAE) of 29.034 m3/s, correlation coefficient (R) of 0.924, and determination coefficient (R2) of 0.817. However, when the amount of dam inflow is below 100 m3/s, the ensemble models (random forest and gradient boosting models) performed better than MLP for the prediction of dam inflow. Therefore, two combined machine learning (CombML) models (RF_MLP and GB_MLP) were developed for the prediction of the dam inflow using the ensemble methods (RF and GB) at precipitation below 16 mm, and the MLP at precipitation above 16 mm. The precipitation of 16 mm is the average daily precipitation at the inflow of 100 m3/s or more. The results show the accuracy verification results of NSE 0.857, RMSE 68.417 m3/s, MAE 18.063 m3/s, R 0.927, and R2 0.859 in RF_MLP, and NSE 0.829, RMSE 73.918 m3/s, MAE 18.093 m3/s, R 0.912, and R2 0.831 in GB_MLP, which infers that the combination of the models predicts the dam inflow the most accurately. CombML algorithms showed that it is possible to predict inflow through inflow learning, considering flow characteristics such as flow regimes, by combining several machine learning algorithms.

A comparison of deep machine learning and Monte Carlo methods for facies classification from seismic data

Geophysics ◽  
2020 ◽  
Vol 85 (4) ◽  
pp. WA41-WA52 ◽  
Author(s):  
Dario Grana ◽  
Leonardo Azevedo ◽  
Mingliang Liu
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Monte Carlo ◽  
Monte Carlo Methods ◽  
Seismic Data ◽  
Transition Probabilities ◽  
Machine Learning Algorithms ◽  
Data Set ◽  
Facies Classification ◽  
The Neural Network

Among the large variety of mathematical and computational methods for estimating reservoir properties such as facies and petrophysical variables from geophysical data, deep machine-learning algorithms have gained significant popularity for their ability to obtain accurate solutions for geophysical inverse problems in which the physical models are partially unknown. Solutions of classification and inversion problems are generally not unique, and uncertainty quantification studies are required to quantify the uncertainty in the model predictions and determine the precision of the results. Probabilistic methods, such as Monte Carlo approaches, provide a reliable approach for capturing the variability of the set of possible models that match the measured data. Here, we focused on the classification of facies from seismic data and benchmarked the performance of three different algorithms: recurrent neural network, Monte Carlo acceptance/rejection sampling, and Markov chain Monte Carlo. We tested and validated these approaches at the well locations by comparing classification predictions to the reference facies profile. The accuracy of the classification results is defined as the mismatch between the predictions and the log facies profile. Our study found that when the training data set of the neural network is large enough and the prior information about the transition probabilities of the facies in the Monte Carlo approach is not informative, machine-learning methods lead to more accurate solutions; however, the uncertainty of the solution might be underestimated. When some prior knowledge of the facies model is available, for example, from nearby wells, Monte Carlo methods provide solutions with similar accuracy to the neural network and allow a more robust quantification of the uncertainty, of the solution.

scholarly journals Classification of Children’s Sitting Postures Using Machine Learning Algorithms

2018 ◽  
Vol 8 (8) ◽  
pp. 1280 ◽  
Author(s):  
Yong Kim ◽  
Youngdoo Son ◽  
Wonjoon Kim ◽  
Byungki Jin ◽  
Myung Yun
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Monitoring System ◽  
Multinomial Logistic Regression ◽  
Learning Algorithms ◽  
Feedback System ◽  
Machine Learning Algorithms ◽  
Sensor Data ◽  
Future Research ◽  
Support Vector

Sitting on a chair in an awkward posture or sitting for a long period of time is a risk factor for musculoskeletal disorders. A postural habit that has been formed cannot be changed easily. It is important to form a proper postural habit from childhood as the lumbar disease during childhood caused by their improper posture is most likely to recur. Thus, there is a need for a monitoring system that classifies children’s sitting postures. The purpose of this paper is to develop a system for classifying sitting postures for children using machine learning algorithms. The convolutional neural network (CNN) algorithm was used in addition to the conventional algorithms: Naïve Bayes classifier (NB), decision tree (DT), neural network (NN), multinomial logistic regression (MLR), and support vector machine (SVM). To collect data for classifying sitting postures, a sensing cushion was developed by mounting a pressure sensor mat (8 × 8) inside children’s chair seat cushion. Ten children participated, and sensor data was collected by taking a static posture for the five prescribed postures. The accuracy of CNN was found to be the highest as compared with those of the other algorithms. It is expected that the comprehensive posture monitoring system would be established through future research on enhancing the classification algorithm and providing an effective feedback system.

scholarly journals Predicting Alert Source Device using Machine Learning Algorithms

2020 ◽  
Vol 9 (9) ◽  
pp. 1-10
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Model Building ◽  
Learning Algorithm ◽  
Learning Algorithms ◽  
Research Work ◽  
Machine Learning Algorithms ◽  
Training Dataset ◽  
Imbalanced Dataset ◽  
Daunting Task

In a large distributed virtualized environment, predicting the alerting source from its text seems to be daunting task. This paper explores the option of using machine learning algorithm to solve this problem. Unfortunately, our training dataset is highly imbalanced. Where 96% of alerting data is reported by 24% of alerting sources. This is the expected dataset in any live distributed virtualized environment, where new version of device will have relatively less alert compared to older devices. Any classification effort with such imbalanced dataset present different set of challenges compared to binary classification. This type of skewed data distribution makes conventional machine learning less effective, especially while predicting the minority device type alerts. Our challenge is to build a robust model which can cope with this imbalanced dataset and achieves relative high level of prediction accuracy. This research work stared with traditional regression and classification algorithms using bag of words model. Then word2vec and doc2vec models are used to represent the words in vector formats, which preserve the sematic meaning of the sentence. With this alerting text with similar message will have same vector form representation. This vectorized alerting text is used with Logistic Regression for model building. This yields better accuracy, but the model is relatively complex and demand more computational resources. Finally, simple neural network is used for this multi-class text classification problem domain by using keras and tensorflow libraries. A simple two layered neural network yielded 99 % accuracy, even though our training dataset was not balanced. This paper goes through the qualitative evaluation of the different machine learning algorithms and their respective result. Finally, two layered deep learning algorithms is selected as final solution, since it takes relatively less resource and time with better accuracy values.

scholarly journals Computational classification of animals for a highway detection system

2021 ◽  
Vol 58 ◽  
pp. e174951
Author(s):  
Denis Sato ◽  
Adroaldo José Zanella ◽  
Ernane Xavier Costa
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Computer Vision ◽  
Convolutional Neural Network ◽  
Road Safety ◽  
Detection System ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
The World

Vehicle-animal collisions represent a serious problem in roadway infrastructure. To avoid these roadway collisions, different mitigation systems have been applied in various regions of the world. In this article, a system for detecting animals on highways is presented using computer vision and machine learning algorithms. The models were trained to classify two groups of animals: capybaras and donkeys. Two variants of the convolutional neural network called Yolo (You only look once) were used, Yolov4 and Yolov4-tiny (a lighter version of the network). The training was carried out using pre-trained models. Detection tests were performed on 147 images. The accuracy results obtained were 84.87% and 79.87% for Yolov4 and Yolov4-tiny, respectively. The proposed system has the potential to improve road safety by reducing or preventing accidents with animals.

Sign in / Sign up

Export Citation Format

Share Document