scholarly journals Suggestion for a new deterministic model coupled with machine learning techniques for landslide susceptibility mapping

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Dae-Hong Min ◽  
Hyung-Koo Yoon
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Linear Regression ◽  
High Reliability ◽  
Back Propagation ◽  
Measured Data ◽  
Landslide Susceptibility Mapping ◽  
Deterministic Models ◽  
Soil Thickness ◽  
The Neural Network

AbstractDeterministic models have been widely applied in landslide risk assessment (LRA), but they have limitations in obtaining various geotechnical and hydraulic properties. The objective of this study is to suggest a new deterministic method based on machine learning (ML) algorithms. Eight crucial variables of LRA are selected with reference to expert opinions, and the output value is set to the safety factor derived by Mohr–Coulomb failure theory in infinite slope. Linear regression and a neural network based on ML are applied to find the best model between independent and dependent variables. To increase the reliability of linear regression and the neural network, the results of back propagation, including gradient descent, Levenberg–Marquardt (LM), and Bayesian regularization (BR) methods, are compared. An 1800-item dataset is constructed through measured data and artificial data by using a geostatistical technique, which can provide the information of an unknown area based on measured data. The results of linear regression and the neural network show that the special LM and BR back propagation methods demonstrate a high determination of coefficient. The important variables are also investigated though random forest (RF) to overcome the number of various input variables. Only four variables—shear strength, soil thickness, elastic modulus, and fine content—demonstrate a high reliability for LRA. The results show that it is possible to perform LRA with ML, and four variables are enough when it is difficult to obtain various variables.

scholarly journals Estudio comparativo de los algoritmos backpropagation (bp) y multiple linear regression (mlr) a través del análisis estadístico de datos aplicado a redes neuronales artificiales

2020 ◽  
Vol 9 (3) ◽  
pp. 144-152
Author(s):  
Iván Mesias Hidalgo-Cajo ◽  
Saul Yasaca-Pucuna ◽  
Byron Geovanny Hidalgo-Cajo ◽  
Diego Patricio Hidalgo-Cajo ◽  
Nelly Baltazara Latorre-Benalcázar
Keyword(s):  
Neural Network ◽  
Linear Regression ◽  
Multiple Linear Regression ◽  
Sea Level ◽  
Total Error ◽  
Back Propagation ◽  
The Neural Network ◽  
Power Turbine ◽  
La Red ◽  
Network Type

El objetivo de la investigación es comparar el algoritmo Backpropagation desarrollado por el usuario bajo software libre Java y el algoritmo Multiple Linear Regression, dicha comparación demanda del análisis estadístico decriptivo basado en redes neuronales artificiales. Se utilizó específicamente dos modelos de algoritmos de predicción aplicados a 451 patrones o registros a procesar que están repartidos en las primeras 401 filas para entrenamiento de la red neuronal y los otros 50 registros para validación y prueba, conformado por  4 variables de entrada (Height above sea level, Fall, Net fall, Flux) y 1 variable a predecir (Power turbine), para las diferentes pruebas los parámetros de entrenamiento y selección con los mejores resultados son: Architecture of the neural network, Type of scaling of data, Initial range of weight and thresholds, Learning rate and Momentum, Batched / online, Number of training epochs. Entre los resultados de comparación de los algoritmos analizados se determinó que el error en mayor iteracciones es menor que son respuestas de los 50 patrones de prueba. En el algoritmo Multiple Linear Regression  la variable real es el valor de la variable a predecir, esta variable es la suministrada a predecir por el usuario y es el valor que se predijo de la red neuronal, la variable prediction es la diferencia que se hace de la resta de los anteriores errores y se lo realiza para calcular el error y el total error es el valor mínimo a obtener que representa el error calculado de todos los datos, es decir el porcentaje de error de la red neuronal de back-propagation. Entre más bajo es este porcentaje mejor será la red, porque menor será su porcentaje de error.

scholarly journals Discretization and machine learning approximation of BSDEs with a constraint on the Gains-process

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Idris Kharroubi ◽  
Thomas Lim ◽  
Xavier Warin
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Differential Equations ◽  
Numerical Experiments ◽  
Optimization Problem ◽  
Learning Approach ◽  
The Neural Network ◽  
Machine Learning Approach ◽  
Mesh Grid

AbstractWe study the approximation of backward stochastic differential equations (BSDEs for short) with a constraint on the gains process. We first discretize the constraint by applying a so-called facelift operator at times of a grid. We show that this discretely constrained BSDE converges to the continuously constrained one as the mesh grid converges to zero. We then focus on the approximation of the discretely constrained BSDE. For that we adopt a machine learning approach. We show that the facelift can be approximated by an optimization problem over a class of neural networks under constraints on the neural network and its derivative. We then derive an algorithm converging to the discretely constrained BSDE as the number of neurons goes to infinity. We end by numerical experiments.

scholarly journals Hysteresis Modeling and Compensation of Fast Steering Mirrors with Hysteresis Operator Based Back Propagation Neural Networks

Micromachines ◽  
2021 ◽  
Vol 12 (7) ◽  
pp. 732
Author(s):  
Kairui Cao ◽  
Guanglu Hao ◽  
Qingfeng Liu ◽  
Liying Tan ◽  
Jing Ma
Keyword(s):  
Neural Network ◽  
Back Propagation ◽  
Hysteresis Model ◽  
Cooperative Movement ◽  
Hysteresis Operator ◽  
The Neural Network ◽  
Hysteresis Nonlinearity ◽  
Hysteresis Modeling ◽  
Hysteresis Characteristics ◽  
Inverse Hysteresis

Fast steering mirrors (FSMs), driven by piezoelectric ceramics, are usually used as actuators for high-precision beam control. A FSM generally contains four ceramics that are distributed in a crisscross pattern. The cooperative movement of the two ceramics along one radial direction generates the deflection of the FSM in the same orientation. Unlike the hysteresis nonlinearity of a single piezoelectric ceramic, which is symmetric or asymmetric, the FSM exhibits complex hysteresis characteristics. In this paper, a systematic way of modeling the hysteresis nonlinearity of FSMs is proposed using a Madelung’s rules based symmetric hysteresis operator with a cascaded neural network. The hysteresis operator provides a basic hysteresis motion for the FSM. The neural network modifies the basic hysteresis motion to accurately describe the hysteresis nonlinearity of FSMs. The wiping-out and congruency properties of the proposed method are also analyzed. Moreover, the inverse hysteresis model is constructed to reduce the hysteresis nonlinearity of FSMs. The effectiveness of the presented model is validated by experimental results.

Estimating Traffic Volume on Minor Roads at Rural Stop-Controlled Intersections using Deep Learning

2019 ◽  
Vol 2673 (4) ◽  
pp. 108-116 ◽  
Author(s):  
Mostafa H. Tawfeek ◽  
Karim El-Basyouny
Keyword(s):  
Neural Network ◽  
Linear Regression ◽  
Network Model ◽  
Neural Network Model ◽  
Deep Neural Network ◽  
Safety Management ◽  
Estimation Method ◽  
Estimation Model ◽  
The Neural Network ◽  
Annual Average Daily Traffic

Safety Performance Functions (SPFs) are regression models used to predict the expected number of collisions as a function of various traffic and geometric characteristics. One of the integral components in developing SPFs is the availability of accurate exposure factors, that is, annual average daily traffic (AADT). However, AADTs are not often available for minor roads at rural intersections. This study aims to develop a robust AADT estimation model using a deep neural network. A total of 1,350 rural four-legged, stop-controlled intersections from the Province of Alberta, Canada, were used to train the neural network. The results of the deep neural network model were compared with the traditional estimation method, which uses linear regression. The results indicated that the deep neural network model improved the estimation of minor roads’ AADT by 35% when compared with the traditional method. Furthermore, SPFs developed using linear regression resulted in models with statistically insignificant AADTs on minor roads. Conversely, the SPF developed using the neural network provided a better fit to the data with both AADTs on minor and major roads being statistically significant variables. The findings indicated that the proposed model could enhance the predictive power of the SPF and therefore improve the decision-making process since SPFs are used in all parts of the safety management process.

scholarly journals Rethinking the Random Cropping Data Augmentation Method Used in the Training of CNN-Based SAR Image Ship Detector

2020 ◽  
Vol 13 (1) ◽  
pp. 34
Author(s):  
Rong Yang ◽  
Robert Wang ◽  
Yunkai Deng ◽  
Xiaoxue Jia ◽  
Heng Zhang
Keyword(s):  
Neural Network ◽  
Data Augmentation ◽  
Back Propagation ◽  
Detection Performance ◽  
Training Data ◽  
Sar Image ◽  
Optical Images ◽  
The Neural Network ◽  
Effective Training ◽  
Standard Configuration

The random cropping data augmentation method is widely used to train convolutional neural network (CNN)-based target detectors to detect targets in optical images (e.g., COCO datasets). It can expand the scale of the dataset dozens of times while consuming only a small amount of calculations when training the neural network detector. In addition, random cropping can also greatly enhance the spatial robustness of the model, because it can make the same target appear in different positions of the sample image. Nowadays, random cropping and random flipping have become the standard configuration for those tasks with limited training data, which makes it natural to introduce them into the training of CNN-based synthetic aperture radar (SAR) image ship detectors. However, in this paper, we show that the introduction of traditional random cropping methods directly in the training of the CNN-based SAR image ship detector may generate a lot of noise in the gradient during back propagation, which hurts the detection performance. In order to eliminate the noise in the training gradient, a simple and effective training method based on feature map mask is proposed. Experiments prove that the proposed method can effectively eliminate the gradient noise introduced by random cropping and significantly improve the detection performance under a variety of evaluation indicators without increasing inference cost.

scholarly journals Safety Warning Model of Coal Face Based on FCM Fuzzy Clustering and GA-BP Neural Network

Symmetry ◽  
2021 ◽  
Vol 13 (6) ◽  
pp. 1082
Author(s):  
Fanqiang Meng
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Early Warning ◽  
Back Propagation ◽  
Back Propagation Neural Network ◽  
Coal Face ◽  
Early Warning Model ◽  
Working Face ◽  
The Neural Network ◽  
Warning Model

Risk and security are two symmetric descriptions of the uncertainty of the same system. If the risk early warning is carried out in time, the security capability of the system can be improved. A safety early warning model based on fuzzy c-means clustering (FCM) and back-propagation neural network was established, and a genetic algorithm was introduced to optimize the connection weight and other properties of the neural network, so as to construct the safety early warning system of coal mining face. The system was applied in a coal face in Shandong, China, with 46 groups of data as samples. Firstly, the original data were clustered by FCM, the input space was fuzzy divided, and the samples were clustered into three categories. Then, the clustered data was used as the input of the neural network for training and prediction. The back-propagation neural network and genetic algorithm optimization neural network were trained and verified many times. The results show that the early warning model can realize the prediction and early warning of the safety condition of the working face, and the performance of the neural network model optimized by genetic algorithm is better than the traditional back-propagation artificial neural network model, with higher prediction accuracy and convergence speed. The established early warning model and method can provide reference and basis for the prediction, early warning and risk management of coal mine production safety, so as to discover the hidden danger of working face accident as soon as possible, eliminate the hidden danger in time and reduce the accident probability to the maximum extent.

Application of ANN Back-Propagation for Fracture Design Parameters in Extra-Low Cycle Rotating Bending Fatigue

2009 ◽  
Vol 610-613 ◽  
pp. 450-453
Author(s):  
Hong Yan Duan ◽  
You Tang Li ◽  
Jin Zhang ◽  
Gui Ping He
Keyword(s):  
Neural Network ◽  
Neural Network Model ◽  
Back Propagation ◽  
Training Data ◽  
Design Parameters ◽  
Ann Model ◽  
Bending Fatigue ◽  
The Neural Network ◽  
Rotating Bending Fatigue ◽  
Rotating Bending

The fracture problems of ecomaterial (aluminum alloyed cast iron) under extra-low cycle rotating bending fatigue loading were studied using artificial neural networks (ANN) in this paper. The training data were used in the formation of training set of ANN. The ANN model exhibited excellent in results comparison with the experimental results. It was concluded that predicted fracture design parameters by the trained neural network model seem more reasonable compared to approximate methods. It is possible to claim that, ANN is fairly promising prediction technique if properly used. Training ANN model was introduced at first. And then the Training data for the development of the neural network model was obtained from the experiments. The input parameters, notch depth, the presetting deflection and tip radius of the notch, and the output parameters, the cycle times of fracture were used during the network training. The neural network architecture is designed. The ANN model was developed using back propagation architecture with three layers jump connections, where every layer was connected or linked to every previous layer. The number of hidden neurons was determined according to special formula. The performance of system is summarized at last. In order to facilitate the comparisons of predicted values, the error evaluation and mean relative error are obtained. The result show that the training model has good performance, and the experimental data and predicted data from ANN are in good coherence.

The Optimization of Adaptive PID Control Algorithm Based on RBF Neural Network

2014 ◽  
Vol 998-999 ◽  
pp. 943-946
Author(s):  
Jing Liu ◽  
Guo Xin Wang
Keyword(s):  
Neural Network ◽  
Pid Controller ◽  
Rbf Neural Network ◽  
High Reliability ◽  
Simple Algorithm ◽  
Poor Performance ◽  
Learning Ability ◽  
The Neural Network ◽  
Pid Controller Tuning ◽  
Deterministic Control

As the earliest practical controller, PID controller has more than 50 years of history, and it is still the most widely used and most common industrial controllers. PID controller is simple to understand and use, without a prerequisite for an accurate model of the physical system, thus become the most popular, the most common controller. The reason why PID controller is the first developed one is that its simple algorithm, robustness and high reliability. It is widely used in process control and motion control, especially for accurate mathematical model that can be established deterministic control system. But the conventional PID controller tuning parameters are often poor performance, poor adaptability to the operating environment. The neural network has a strong nonlinear mapping ability, competence, self-learning ability of associative memory, and has a viable quantities of information processing methods and good fault tolerance.

Landslide susceptibility mapping based on convolutional neural network and conventional machine learning methods

2021 ◽  
Author(s):  
Rui Liu ◽  
Xin Yang ◽  
Chong Xu ◽  
Luyao Li ◽  
Xiangqiang Zeng
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Convolutional Neural Network ◽  
Landslide Susceptibility ◽  
Susceptibility Mapping ◽  
Landslide Susceptibility Mapping ◽  
Support Vector ◽  
Learning Methods ◽  
Machine Learning Methods ◽  
Conventional Machine

Abstract Landslide susceptibility mapping (LSM) is a useful tool to estimate the probability of landslide occurrence, providing a scientific basis for natural hazards prevention, land use planning, and economic development in landslide-prone areas. To date, a large number of machine learning methods have been applied to LSM, and recently the advanced Convolutional Neural Network (CNN) has been gradually adopted to enhance the prediction accuracy of LSM. The objective of this study is to introduce a CNN based model in LSM and systematically compare its overall performance with the conventional machine learning models of random forest, logistic regression, and support vector machine. Herein, we selected the Jiuzhaigou region in Sichuan Province, China as the study area. A total number of 710 landslides and 12 predisposing factors were stacked to form spatial datasets for LSM. The ROC analysis and several statistical metrics, such as accuracy, root mean square error (RMSE), Kappa coefficient, sensitivity, and specificity were used to evaluate the performance of the models in the training and validation datasets. Finally, the trained models were calculated and the landslide susceptibility zones were mapped. Results suggest that both CNN and conventional machine-learning based models have a satisfactory performance (AUC: 85.72% − 90.17%). The CNN based model exhibits excellent good-of-fit and prediction capability, and achieves the highest performance (AUC: 90.17%) but also significantly reduces the salt-of-pepper effect, which indicates its great potential of application to LSM.

scholarly journals Stock Market Prediction Using Artificial Neural Networks

2012 ◽  
Vol 6-7 ◽  
pp. 1055-1060 ◽  
Author(s):  
Yang Bing ◽  
Jian Kun Hao ◽  
Si Chang Zhang
Keyword(s):  
Neural Network ◽  
Prediction Models ◽  
Learning Algorithm ◽  
Stock Exchange ◽  
Back Propagation ◽  
Composite Index ◽  
Network Models ◽  
Back Propagation Neural Network ◽  
Neural Network Models ◽  
The Neural Network

In this study we apply back propagation Neural Network models to predict the daily Shanghai Stock Exchange Composite Index. The learning algorithm and gradient search technique are constructed in the models. We evaluate the prediction models and conclude that the Shanghai Stock Exchange Composite Index is predictable in the short term. Empirical study shows that the Neural Network models is successfully applied to predict the daily highest, lowest, and closing value of the Shanghai Stock Exchange Composite Index, but it can not predict the return rate of the Shanghai Stock Exchange Composite Index in short terms.

Sign in / Sign up

Export Citation Format

Share Document