Hidden Markov Models for Recognition Using Artificial Neural Networks

Author(s):  
V. Bevilacqua ◽  
G. Mastronardi ◽  
A. Pedone ◽  
G. Romanazzi ◽  
D. Daleno
2020 ◽  
Vol 221 (3) ◽  
pp. 1484-1498 ◽  
Author(s):  
Runhai Feng

SUMMARY Lithofacies is one of the most important reservoir parameters, which could provide a qualitative description for hydrocarbon and geothermal reservoirs. Various techniques, such as artificial neural networks (ANN) and hidden Markov models (HMM), have been applied to extract this information, with the well log suites as inputs. However, both of these methods have their own limitations, such as no geological priors in ANN, since log samples along the depth direction are treated independently. While in HMM, a simple Gaussian assumption is usually adopted, which may not be sufficient for complex data distributions. In order to address these problems, a new method is proposed, which combines ANN and HMM into a hybrid system. This new technique allows for a more flexible approach to the probability distributions of rock properties, without any Gaussian assumption being made. At the same time, the geological dependence between adjacent samples is introduced by a representative transition matrix of lithofacies. The output probability from ANN must be reformulated to an emission function before it can be fed into the HMM, which is achieved via the Bayes’ rule. Then the Viterbi algorithm in HMM is applied for the decoding of sequential patterns in the subsurface. In this fashion, the classification process can be proceeded statistically and geologically. Better performance of the proposed approach, compared with other classification methods, is demonstrated in two case studies.


2022 ◽  
pp. 629-647
Author(s):  
Yosra Abdulaziz Mohammed

Cries of infants can be seen as an indicator of pain. It has been proven that crying caused by pain, hunger, fear, stress, etc., show different cry patterns. The work presented here introduces a comparative study between the performance of two different classification techniques implemented in an automatic classification system for identifying two types of infants' cries, pain, and non-pain. The techniques are namely, Continuous Hidden Markov Models (CHMM) and Artificial Neural Networks (ANN). Two different sets of acoustic features were extracted from the cry samples, those are MFCC and LPCC, the feature vectors generated by each were eventually fed into the classification module for the purpose of training and testing. The results of this work showed that the system based on CDHMM have better performance than that based on ANN. CDHMM gives the best identification rate at 96.1%, which is much higher than 79% of ANN whereby in general the system based on MFCC features performed better than the one that utilizes LPCC features.


Author(s):  
YOSHUA BENGIO

The task discussed in this paper is that of learning to map input sequences to output sequences. In particular, problems of phoneme recognition in continuous speech are considered, but most of the discussed techniques could be applied to other tasks, such as the recognition of sequences of handwritten characters. The systems considered in this paper are based on connectionist models, or artificial neural networks, sometimes combined with statistical techniques for recognition of sequences of patterns, stressing the integration of prior knowledge and learning. Different architectures for sequence and speech recognition are reviewed, including recurrent networks as well as hybrid systems involving hidden Markov models.


2019 ◽  
Author(s):  
Ranjani Murali ◽  
James Hemp ◽  
Victoria Orphan ◽  
Yonatan Bisk

AbstractThe ability to correctly predict the functional role of proteins from their amino acid sequences would significantly advance biological studies at the molecular level by improving our ability to understand the biochemical capability of biological organisms from their genomic sequence. Existing methods that are geared towards protein function prediction or annotation mostly use alignment-based approaches and probabilistic models such as Hidden-Markov Models. In this work we introduce a deep learning architecture (FunctionIdentification withNeuralDescriptions orFIND) which performs protein annotation from primary sequence. The accuracy of our methods matches state of the art techniques, such as protein classifiers based on Hidden Markov Models. Further, our approach allows for model introspection via a neural attention mechanism, which weights parts of the amino acid sequence proportionally to their relevance for functional assignment. In this way, the attention weights automatically uncover structurally and functionally relevant features of the classified protein and find novel functional motifs in previously uncharacterized proteins. While this model is applicable to any database of proteins, we chose to apply this model to superfamilies of homologous proteins, with the aim of extracting features inherent to divergent protein families within a larger superfamily. This provided insight into the functional diversification of an enzyme superfamily and its adaptation to different physiological contexts. We tested our approach on three families (nitrogenases, cytochromebd-type oxygen reductases and heme-copper oxygen reductases) and present a detailed analysis of the sequence characteristics identified in previously characterized proteins in the heme-copper oxygen reductase (HCO) superfamily. These are correlated with their catalytic relevance and evolutionary history. FIND was then applied to discover features in previously uncharacterized members of the HCO superfamily, providing insight into their unique sequence features. This modeling approach demonstrates the power of neural networks to recognize patterns in large datasets and can be utilized to discover biochemically and structurally important features in proteins from their amino acid sequences.Author summary


Sign in / Sign up

Export Citation Format

Share Document