A Promising Hardware Accelerator with PAST Adder

2021 ◽  
Vol 105 ◽  
pp. 241-248
Author(s):  
Abhishek Choubey ◽  
Shruti Bhargava Choubey
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Resource Utilization ◽  
Network Inference ◽  
Hardware Accelerator ◽  
High Complexity ◽  
High Resource ◽  
The Neural Network ◽  
And Storage ◽  
Dedicated Hardware

Recent neural network research has demonstrated a significant benefit in machine learning compared to conventional algorithms based on handcrafted models and features. In regions such as video, speech and image recognition, the neural network is now widely adopted. But the high complexity of neural network inference in computation and storage poses great differences on its application. These networks are computer-intensive algorithms that currently require the execution of dedicated hardware. In this case, we point out the difficulty of Adders (MOAs) and their high-resource utilization in a CNN implementation of FPGA .to address these challenge a parallel self-time adder is implemented which mainly aims at minimizing the amount of transistors and estimating different factors for PASTA, i.e. field, power, delay.

scholarly journals Discretization and machine learning approximation of BSDEs with a constraint on the Gains-process

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Idris Kharroubi ◽  
Thomas Lim ◽  
Xavier Warin
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Differential Equations ◽  
Numerical Experiments ◽  
Optimization Problem ◽  
Learning Approach ◽  
The Neural Network ◽  
Machine Learning Approach ◽  
Mesh Grid

AbstractWe study the approximation of backward stochastic differential equations (BSDEs for short) with a constraint on the gains process. We first discretize the constraint by applying a so-called facelift operator at times of a grid. We show that this discretely constrained BSDE converges to the continuously constrained one as the mesh grid converges to zero. We then focus on the approximation of the discretely constrained BSDE. For that we adopt a machine learning approach. We show that the facelift can be approximated by an optimization problem over a class of neural networks under constraints on the neural network and its derivative. We then derive an algorithm converging to the discretely constrained BSDE as the number of neurons goes to infinity. We end by numerical experiments.

Tagging terms in text

Terminology ◽  
2022 ◽  
Author(s):  
Ayla Rigouts Terryn ◽  
Véronique Hoste ◽  
Els Lefever
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Language Processing ◽  
Conditional Random Fields ◽  
Traditional Approach ◽  
Learning Approaches ◽  
Term Extraction ◽  
The Neural Network ◽  
Predicted Probability ◽  
Automatic Term Extraction

Abstract As with many tasks in natural language processing, automatic term extraction (ATE) is increasingly approached as a machine learning problem. So far, most machine learning approaches to ATE broadly follow the traditional hybrid methodology, by first extracting a list of unique candidate terms, and classifying these candidates based on the predicted probability that they are valid terms. However, with the rise of neural networks and word embeddings, the next development in ATE might be towards sequential approaches, i.e., classifying each occurrence of each token within its original context. To test the validity of such approaches for ATE, two sequential methodologies were developed, evaluated, and compared: one feature-based conditional random fields classifier and one embedding-based recurrent neural network. An additional comparison was added with a machine learning interpretation of the traditional approach. All systems were trained and evaluated on identical data in multiple languages and domains to identify their respective strengths and weaknesses. The sequential methodologies were proven to be valid approaches to ATE, and the neural network even outperformed the more traditional approach. Interestingly, a combination of multiple approaches can outperform all of them separately, showing new ways to push the state-of-the-art in ATE.

A comparison of deep machine learning and Monte Carlo methods for facies classification from seismic data

Geophysics ◽  
2020 ◽  
Vol 85 (4) ◽  
pp. WA41-WA52 ◽  
Author(s):  
Dario Grana ◽  
Leonardo Azevedo ◽  
Mingliang Liu
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Monte Carlo ◽  
Monte Carlo Methods ◽  
Seismic Data ◽  
Transition Probabilities ◽  
Machine Learning Algorithms ◽  
Data Set ◽  
Facies Classification ◽  
The Neural Network

Among the large variety of mathematical and computational methods for estimating reservoir properties such as facies and petrophysical variables from geophysical data, deep machine-learning algorithms have gained significant popularity for their ability to obtain accurate solutions for geophysical inverse problems in which the physical models are partially unknown. Solutions of classification and inversion problems are generally not unique, and uncertainty quantification studies are required to quantify the uncertainty in the model predictions and determine the precision of the results. Probabilistic methods, such as Monte Carlo approaches, provide a reliable approach for capturing the variability of the set of possible models that match the measured data. Here, we focused on the classification of facies from seismic data and benchmarked the performance of three different algorithms: recurrent neural network, Monte Carlo acceptance/rejection sampling, and Markov chain Monte Carlo. We tested and validated these approaches at the well locations by comparing classification predictions to the reference facies profile. The accuracy of the classification results is defined as the mismatch between the predictions and the log facies profile. Our study found that when the training data set of the neural network is large enough and the prior information about the transition probabilities of the facies in the Monte Carlo approach is not informative, machine-learning methods lead to more accurate solutions; however, the uncertainty of the solution might be underestimated. When some prior knowledge of the facies model is available, for example, from nearby wells, Monte Carlo methods provide solutions with similar accuracy to the neural network and allow a more robust quantification of the uncertainty, of the solution.

Eccentricity of Rotor Prediction of Aero-Engine Rotor Based on Image Identification and Machine Learning

2019 ◽  
Author(s):  
Zihao Zhang ◽  
Junkang Guo ◽  
Yanhui Sun ◽  
Jun Hong
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Rbf Neural Network ◽  
Engineering Application ◽  
Direction Error ◽  
Rotor Eccentricity ◽  
The Neural Network ◽  
Aero Engine ◽  
Feature Information ◽  
Engine Rotor

Abstract The eccentricity of rotor seriously affect the vibration and reliability of aero-engine. Due to the machining error of parts, it is very important to accurately predict the error propagation in assembly. A method based on image recognition and machine learning is proposed to predict the eccentricity of rotor. Firstly, by analyzing and calculating the axial and radial runout error data, the error is mainly concentrated in the first 30 orders of the Fourier series. Secondly, based on the mapping relationship between profile trajectory and eccentricity of rotor, the feature information of the profile trajectory is extracted by constructing the complex domain autoregressive (CAR) model for the radial and axial direction error profile trajectory. Then use the finite element method to calculate the rotor eccentricity. Using the feature information as the input of the neural network, the rotor eccentricity is assembled as the output of the neural network, and the radial basis function (RBF) neural network is built to predict the rotor eccentricity. Theoretical and experimental results show that the proposed method has good enforceability, high accuracy, short calculation time and high engineering application value. In addition, this method can not only be applied to predict the eccentricity of aero-engine rotor flange assembly, but also can be used in the general field of interference fit of assembly.

scholarly journals Comparison of rule-based and neural network models for negation detection in radiology reports

2020 ◽  
pp. 1-22 ◽  
Author(s):  
D. Sykes ◽  
A. Grivas ◽  
C. Grover ◽  
R. Tobin ◽  
C. Sudlow ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Language Processing ◽  
Network Models ◽  
Neural Network Models ◽  
Test Set ◽  
Rule Based ◽  
Radiology Reports ◽  
The Neural Network ◽  
Negation Detection

Abstract Using natural language processing, it is possible to extract structured information from raw text in the electronic health record (EHR) at reasonably high accuracy. However, the accurate distinction between negated and non-negated mentions of clinical terms remains a challenge. EHR text includes cases where diseases are stated not to be present or only hypothesised, meaning a disease can be mentioned in a report when it is not being reported as present. This makes tasks such as document classification and summarisation more difficult. We have developed the rule-based EdIE-R-Neg, part of an existing text mining pipeline called EdIE-R (Edinburgh Information Extraction for Radiology reports), developed to process brain imaging reports, (https://www.ltg.ed.ac.uk/software/edie-r/) and two machine learning approaches; one using a bidirectional long short-term memory network and another using a feedforward neural network. These were developed on data from the Edinburgh Stroke Study (ESS) and tested on data from routine reports from NHS Tayside (Tayside). Both datasets consist of written reports from medical scans. These models are compared with two existing rule-based models: pyConText (Harkema et al. 2009. Journal of Biomedical Informatics42(5), 839–851), a python implementation of a generalisation of NegEx, and NegBio (Peng et al. 2017. NegBio: A high-performance tool for negation and uncertainty detection in radiology reports. arXiv e-prints, p. arXiv:1712.05898), which identifies negation scopes through patterns applied to a syntactic representation of the sentence. On both the test set of the dataset from which our models were developed, as well as the largely similar Tayside test set, the neural network models and our custom-built rule-based system outperformed the existing methods. EdIE-R-Neg scored highest on F1 score, particularly on the test set of the Tayside dataset, from which no development data were used in these experiments, showing the power of custom-built rule-based systems for negation detection on datasets of this size. The performance gap of the machine learning models to EdIE-R-Neg on the Tayside test set was reduced through adding development Tayside data into the ESS training set, demonstrating the adaptability of the neural network models.

scholarly journals Towards a climatology of fog frequency in the Atacama Desert via multi-spectral satellite data and machine learning techniques

2021 ◽  
Author(s):  
Christoph Böhm ◽  
Jan H. Schween ◽  
Mark Reyers ◽  
Benedikt Maier ◽  
Ulrich Löhnert ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Satellite Data ◽  
Atacama Desert ◽  
Arid Ecosystems ◽  
Data Set ◽  
Geological Processes ◽  
The Neural Network ◽  
Detection Approach ◽  
Fog Detection

AbstractIn many hyper-arid ecosystems, such as the Atacama Desert, fog is the most important fresh water source. To study biological and geological processes in such water-limited regions, knowledge about the spatio-temporal distribution and variability of fog presence is necessary. In this study, in-situ measurements provided by a network of climate stations equipped, inter alia, with leaf wetness sensors are utilized to create a reference fog data set which enables the validation of satellite-based fog retrieval methods. Further, a new satellite-based fog detection approach is introduced which uses brightness temperatures measured by the Moderate Resolution Imaging Spectroradiometer (MODIS) as input for a neural network. Such a machine learning technique can exploit all spectral information of the satellite data and represent potential non-linear relationships. Compared to a second fog detection approach based on MODIS cloud top height retrievals, the neural network reaches a higher detection skill (Heidke skill score of 0.56 compared to 0.49). A suitable representation of temporal variability on subseasonal time scales is provided with correlations mostly greater than 0.7 between fog occurrence time series derived from the neural network and the reference data for individual climate stations, respectively. Furthermore, a suitable spatial representativity of the neural network approach to expand the application to the whole region is indicated. Three-year averages of fog frequencies reveal similar spatial patterns for the austral winter season for both approaches. However, differences are found for the summer and potential reasons are discussed.

scholarly journals Effective Methodology for Co-Referential Aspect Based Sentiment Analysis of Tourist Reviews

2020 ◽  
pp. 523-529
Author(s):  
Kamlesh A. Waghmare ◽  
Sheetal K. Bhala
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Sentiment Analysis ◽  
High Accuracy ◽  
Machine Learning Algorithms ◽  
Data Sets ◽  
Knowledge Processing ◽  
The Neural Network ◽  
The World ◽  
Sentiment Score

Tourist reviews are the source of data that is going to be used for the travelers around the world to find the hotels for their stay according to their comfort. In this the hotels are ranked over the parameters or aspects considered keeping travelers in mind. This computation of data sets is done with the help of the machine learning algorithms and the neural network. The knowledge processing done over the reviews generates the sentiment score for each hotel with respect to the aspects defined. Here, the explicit , implicit and co-referential aspects are identified by suppressing the noise. This paper proposes the method that can be best used for the detection of the sentiments with the high accuracy.

scholarly journals Coupled online learning as a way to tackle instabilities and biases in neural network parameterizations: general algorithms and Lorenz96 case study (v1.0)

2020 ◽  
Author(s):  
Stephan Rasp
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Online Learning ◽  
High Resolution ◽  
Machine Learning Algorithms ◽  
Training Dataset ◽  
The Neural Network ◽  
Training Stage ◽  
Lorenz 96 ◽  
Resolution Simulation

Abstract. Over the last couple of years, machine learning parameterizations have emerged as a potential way to improve the representation of sub-grid processes in Earth System Models (ESMs). So far, all studies were based on the same three-step approach: first a training dataset was created from a high-resolution simulation, then a machine learning algorithms was fitted to this dataset, before the trained algorithms was implemented in the ESM. The resulting online simulations were frequently plagued by instabilities and biases. Here, coupled online learning is proposed as a way to combat these issues. Coupled learning can be seen as a second training stage in which the pretrained machine learning parameterization, specifically a neural network, is run in parallel with a high-resolution simulation. The high-resolution simulation is kept in sync with the neural network-driven ESM through constant nudging. This enables the neural network to learn from the tendencies that the high-resolution simulation would produce if it experienced the states the neural network creates. The concept is illustrated using the Lorenz 96 model, where coupled learning is able to recover the "true" parameterizations. Further, detailed algorithms for the implementation of coupled learning in 3D cloud-resolving models and the super parameterization framework are presented. Finally, outstanding challenges and issues not resolved by this approach are discussed.

scholarly journals Application of Machine Learning Algorithms for Solving Problems in the Oil and Gas Sector

2021 ◽  
Vol 19 (3) ◽  
pp. 55-64
Author(s):  
K. N. Maiorov ◽  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Reinforcement Learning ◽  
Machine Learning Algorithms ◽  
Design Stage ◽  
Learning Methods ◽  
Field Development ◽  
Advantages And Disadvantages ◽  
Machine Learning Methods ◽  
The Neural Network

The paper examines the life cycle of field development, analyzes the processes of the field development design stage for the application of machine learning methods. For each process, relevant problems are highlighted, existing solutions based on machine learning methods, ideas and problems are proposed that could be effectively solved by machine learning methods. For the main part of the processes, examples of solutions are briefly described; the advantages and disadvantages of the approaches are identified. The most common solution method is feed-forward neural networks. Subject to preliminary normalization of the input data, this is the most versatile algorithm for regression and classification problems. However, in the problem of selecting wells for hydraulic fracturing, a whole ensemble of machine learning models was used, where, in addition to a neural network, there was a random forest, gradient boosting and linear regression. For the problem of optimizing the placement of a grid of oil wells, the disadvantages of existing solutions based on a neural network and a simple reinforcement learning approach based on Markov decision-making process are identified. A deep reinforcement learning algorithm called Alpha Zero is proposed, which has previously shown significant results in the role of artificial intelligence for games. This algorithm is a decision tree search that directs the neural network: only those branches that have received the best estimates from the neural network are considered more thoroughly. The paper highlights the similarities between the tasks for which Alpha Zero was previously used, and the task of optimizing the placement of a grid of oil producing wells. Conclusions are made about the possibility of using and modifying the algorithm of the optimization problem being solved. Аn approach is proposed to take into account symmetric states in a Monte Carlo tree to reduce the number of required simulations.

Sign in / Sign up

Export Citation Format

Share Document