Neural Network Based Transfer Learning of Manipulator Inverse Displacement Analysis

2020 ◽  
Author(s):  
Houcheng Tang ◽  
Leila Notash
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Transfer Learning ◽  
Learning Approach ◽  
Training Process ◽  
Displacement Analysis ◽  
Performance Targets ◽  
The Neural Networks ◽  
Random Initialization ◽  
And Performance

Abstract In this paper, a neural network based transfer learning approach of inverse displacement analysis of robot manipulators is studied. Neural networks with different structures are applied utilizing data from different configurations of a manipulator for training purposes. Then the transfer learning was conducted between manipulators with different geometric layouts. The training is performed on both the neural networks with pretrained initial parameters and the neural networks with random initialization. To investigate the rate of convergence of data fitting comprehensively, different values of performance targets are defined. The computing epochs and performance measures are compared. It is presented that, depending on the structure of neural network, the proposed transfer learning can accelerate the training process and achieve higher accuracy. For different datasets, the transfer learning approach improves their performance differently.

Neural Network-Based Transfer Learning of Manipulator Inverse Displacement Analysis

2021 ◽  
Vol 13 (3) ◽  
Author(s):  
Houcheng Tang ◽  
Leila Notash
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Transfer Learning ◽  
Robot Manipulators ◽  
Learning Approach ◽  
Displacement Analysis ◽  
Performance Targets ◽  
The Neural Network ◽  
The Neural Networks ◽  
And Performance

Abstract In this paper, the feasibility of applying transfer learning for modeling robot manipulators is examined. A neural network-based transfer learning approach of inverse displacement analysis of robot manipulators is studied. Neural networks with different structures are applied utilizing data from different configurations of a manipulator for training purposes. Then, the transfer learning was conducted between manipulators with different geometric layouts. The training is performed on both the neural networks with pretrained initial parameters and the neural networks with random initialization. To investigate the rate of convergence of data fitting comprehensively, different values of performance targets are defined. The computing epochs and performance measures are compared. It is presented that, depending on the structure of the neural network, the proposed transfer learning can accelerate the training process and achieve higher accuracy. For different datasets, the transfer learning approach improves their performance differently.

Neural Network Based Transfer Learning for Robot Path Generation

2021 ◽  
Author(s):  
Houcheng Tang ◽  
Leila Notash
Keyword(s):  
Neural Network ◽  
Transfer Learning ◽  
Training Process ◽  
Learning Methods ◽  
End Effector ◽  
Performance Targets ◽  
Random Initialization ◽  
And Performance ◽  
Artificial Neural Network Ann ◽  
Robot Path

Abstract In this paper, an artificial neural network (ANN) based transfer learning approach of inverse displacement analysis of robot manipulators is studied. ANNs with different structures are applied utilizing data from different end effector paths of a manipulator for training purposes. Four transfer learning methods are proposed by applying pretrained initial parameters. Final training results of ANN with transfer learning are compared with those of ANN with random initialization. To investigate the rate of convergence of data fitting comprehensively, different values of performance targets are defined. The computing epochs and performance measures are compared. It is presented that, depending on the structure of ANN, the proposed transfer learning methods can accelerate the training process and achieve higher accuracy. Depending on the method, the transfer learning improves the performance differently.

scholarly journals Convolutional Neural Network Coupled with a Transfer-Learning Approach for Time-Series Flood Predictions

Water ◽  
2019 ◽  
Vol 12 (1) ◽  
pp. 96 ◽  
Author(s):  
Nobuaki Kimura ◽  
Ikuo Yoshinaga ◽  
Kenji Sekijima ◽  
Issaku Azechi ◽  
Daichi Baba
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Learning Approach ◽  
Target Domain ◽  
Training Time ◽  
Source Domain ◽  
Flood Model

East Asian regions in the North Pacific have recently experienced severe riverine flood disasters. State-of-the-art neural networks are currently utilized as a quick-response flood model. Neural networks typically require ample time in the training process because of the use of numerous datasets. To reduce the computational costs, we introduced a transfer-learning approach to a neural-network-based flood model. For a concept of transfer leaning, once the model is pretrained in a source domain with large datasets, it can be reused in other target domains. After retraining parts of the model with the target domain datasets, the training time can be reduced due to reuse. A convolutional neural network (CNN) was employed because the CNN with transfer learning has numerous successful applications in two-dimensional image classification. However, our flood model predicts time-series variables (e.g., water level). The CNN with transfer learning requires a conversion tool from time-series datasets to image datasets in preprocessing. First, the CNN time-series classification was verified in the source domain with less than 10% errors for the variation in water level. Second, the CNN with transfer learning in the target domain efficiently reduced the training time by 1/5 of and a mean error difference by 15% of those obtained by the CNN without transfer learning, respectively. Our method can provide another novel flood model in addition to physical-based models.

scholarly journals Tax Fraud Detection through Neural Networks: An Application Using a Sample of Personal Income Taxpayers

2019 ◽  
Vol 11 (4) ◽  
pp. 86 ◽  
Author(s):  
César Pérez López ◽  
María Delgado Rodríguez ◽  
Sonia de Lucas Santos
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Income Tax ◽  
Fraud Detection ◽  
Personal Income ◽  
Personal Income Tax ◽  
Tax Returns ◽  
The Neural Networks ◽  
Tax Fraud ◽  
Efficiency Rate

The goal of the present research is to contribute to the detection of tax fraud concerning personal income tax returns (IRPF, in Spanish) filed in Spain, through the use of Machine Learning advanced predictive tools, by applying Multilayer Perceptron neural network (MLP) models. The possibilities springing from these techniques have been applied to a broad range of personal income return data supplied by the Institute of Fiscal Studies (IEF). The use of the neural networks enabled taxpayer segmentation as well as calculation of the probability concerning an individual taxpayer’s propensity to attempt to evade taxes. The results showed that the selected model has an efficiency rate of 84.3%, implying an improvement in relation to other models utilized in tax fraud detection. The proposal can be generalized to quantify an individual’s propensity to commit fraud with regards to other kinds of taxes. These models will support tax offices to help them arrive at the best decisions regarding action plans to combat tax fraud.

scholarly journals Discretization and machine learning approximation of BSDEs with a constraint on the Gains-process

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Idris Kharroubi ◽  
Thomas Lim ◽  
Xavier Warin
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Differential Equations ◽  
Numerical Experiments ◽  
Optimization Problem ◽  
Learning Approach ◽  
The Neural Network ◽  
Machine Learning Approach ◽  
Mesh Grid

AbstractWe study the approximation of backward stochastic differential equations (BSDEs for short) with a constraint on the gains process. We first discretize the constraint by applying a so-called facelift operator at times of a grid. We show that this discretely constrained BSDE converges to the continuously constrained one as the mesh grid converges to zero. We then focus on the approximation of the discretely constrained BSDE. For that we adopt a machine learning approach. We show that the facelift can be approximated by an optimization problem over a class of neural networks under constraints on the neural network and its derivative. We then derive an algorithm converging to the discretely constrained BSDE as the number of neurons goes to infinity. We end by numerical experiments.

scholarly journals An Efficient Neural Network-Based Method for Diagnosing Faults of PV Array

2021 ◽  
Vol 13 (11) ◽  
pp. 6194
Author(s):  
Selma Tchoketch_Kebir ◽  
Nawal Cheggaga ◽  
Adrian Ilinca ◽  
Sabri Boulouma
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Modeling Process ◽  
Photovoltaic Arrays ◽  
Mode Of Operation ◽  
Different Types ◽  
The Neural Networks ◽  
Operational Modes ◽  
Types Of Faults ◽  
Electrical Data

This paper presents an efficient neural network-based method for fault diagnosis in photovoltaic arrays. The proposed method was elaborated on three main steps: the data-feeding step, the fault-modeling step, and the decision step. The first step consists of feeding the real meteorological and electrical data to the neural networks, namely solar irradiance, panel temperature, photovoltaic-current, and photovoltaic-voltage. The second step consists of modeling a healthy mode of operation and five additional faulty operational modes; the modeling process is carried out using two networks of artificial neural networks. From this step, six classes are obtained, where each class corresponds to a predefined model, namely, the faultless scenario and five faulty scenarios. The third step involves the diagnosis decision about the system’s state. Based on the results from the above step, two probabilistic neural networks will classify each generated data according to the six classes. The obtained results show that the developed method can effectively detect different types of faults and classify them. Besides, this method still achieves high performances even in the presence of noises. It provides a diagnosis even in the presence of data injected at reduced real-time, which proves its robustness.

scholarly journals Broken Rotor Bars Fault Detection Based on Envelope Analysis Spectrum and Neural Network in Induction Motors

2018 ◽  
Vol 3 (3) ◽  
pp. 106-116
Author(s):  
Saddam BENSAOUCHA ◽  
Sid Ahmed BESSEDIK ◽  
Aissa AMEUR ◽  
Abdellatif SEGHIOUR
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Fourier Transform ◽  
Induction Motors ◽  
Current Signal ◽  
Broken Rotor Bars ◽  
Stator Current ◽  
The Neural Networks ◽  
Modulus Spectrum ◽  
Load Conditions

In this paper, a study has presented the performance of a neural networks technique to detect the broken rotor bars (BRBs) fault in induction motors (IMs). In this context, the fast Fourier transform (FFT) applied on Hilbert modulus obtained via the stator current signal has been used as a diagnostic signal to replace the FFT classic, the characteristics frequency are selected from the Hilbert modulus spectrum, in addition, the different load conditions are used as three inputs data for the neural networks. The efficiency of the proposed method is verified by simulation in MATLAB environment.

scholarly journals NEURAL NETWORK ANALYSIS FOR TUMOR INVESTIGATION AND CANCER PREDICTION

2019 ◽  
Vol 2019 (02) ◽  
pp. 89-98
Author(s):  
Vijayakumar T
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Early Stage ◽  
Original Data ◽  
Data Set ◽  
Cancer Prediction ◽  
The Neural Network ◽  
Feed Forward Neural Networks ◽  
The Neural Networks ◽  
Human Nervous System

Predicting the category of tumors and the types of the cancer in its early stage remains as a very essential process to identify depth of the disease and treatment available for it. The neural network that functions similar to the human nervous system is widely utilized in the tumor investigation and the cancer prediction. The paper presents the analysis of the performance of the neural networks such as the, FNN (Feed Forward Neural Networks), RNN (Recurrent Neural Networks) and the CNN (Convolutional Neural Network) investigating the tumors and predicting the cancer. The results obtained by evaluating the neural networks on the breast cancer Wisconsin original data set shows that the CNN provides 43 % better prediction than the FNN and 25% better prediction than the RNN.

Automated detection of pneumonia cases using deep transfer learning with paediatric chest X-ray images

2021 ◽  
pp. 20201263
Author(s):  
Mohammad Salehi ◽  
Reza Mohammadi ◽  
Hamed Ghaffari ◽  
Nahid Sadighi ◽  
Reza Reiazi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Area Under Curve ◽  
Binary Classification ◽  
Classification Performance ◽  
Learning Approach ◽  
Insufficient Data ◽  
X Ray ◽  
Chest X Ray

Objective: Pneumonia is a lung infection and causes the inflammation of the small air sacs (Alveoli) in one or both lungs. Proper and faster diagnosis of pneumonia at an early stage is imperative for optimal patient care. Currently, chest X-ray is considered as the best imaging modality for diagnosing pneumonia. However, the interpretation of chest X-ray images is challenging. To this end, we aimed to use an automated convolutional neural network-based transfer-learning approach to detect pneumonia in paediatric chest radiographs. Methods: Herein, an automated convolutional neural network-based transfer-learning approach using four different pre-trained models (i.e. VGG19, DenseNet121, Xception, and ResNet50) was applied to detect pneumonia in children (1–5 years) chest X-ray images. The performance of different proposed models for testing data set was evaluated using five performances metrics, including accuracy, sensitivity/recall, Precision, area under curve, and F1 score. Results: All proposed models provide accuracy greater than 83.0% for binary classification. The pre-trained DenseNet121 model provides the highest classification performance of automated pneumonia classification with 86.8% accuracy, followed by Xception model with an accuracy of 86.0%. The sensitivity of the proposed models was greater than 91.0%. The Xception and DenseNet121 models achieve the highest classification performance with F1-score greater than 89.0%. The plotted area under curve of receiver operating characteristics of VGG19, Xception, ResNet50, and DenseNet121 models are 0.78, 0.81, 0.81, and 0.86, respectively. Conclusion: Our data showed that the proposed models achieve a high accuracy for binary classification. Transfer learning was used to accelerate training of the proposed models and resolve the problem associated with insufficient data. We hope that these proposed models can help radiologists for a quick diagnosis of pneumonia at radiology departments. Moreover, our proposed models may be useful to detect other chest-related diseases such as novel Coronavirus 2019. Advances in knowledge: Herein, we used transfer learning as a machine learning approach to accelerate training of the proposed models and resolve the problem associated with insufficient data. Our proposed models achieved accuracy greater than 83.0% for binary classification.

Sign in / Sign up

Export Citation Format

Share Document