scholarly journals Prediction of Peptide Detectability Based on CapsNet and Convolutional Block Attention Module

2021 ◽  
Vol 22 (21) ◽  
pp. 12080
Author(s):  
Minzhe Yu ◽  
Yushuai Duan ◽  
Zhong Li ◽  
Yang Zhang
Keyword(s):  
Feature Learning ◽  
Peptide Identification ◽  
Performance Assessments ◽  
Network Training ◽  
The Neural Network ◽  
Proteomics Technology ◽  
Experimental Process ◽  
Quantitative Results ◽  
Novel Method ◽  
Peptide Detectability

According to proteomics technology, as impacted by the complexity of sampling in the experimental process, several problems remain with the reproducibility of mass spectrometry experiments, and the peptide identification and quantitative results continue to be random. Predicting the detectability exhibited by peptides can optimize the mentioned results to be more accurate, so such a prediction is of high research significance. This study builds a novel method to predict the detectability of peptides by complying with the capsule network (CapsNet) and the convolutional block attention module (CBAM). First, the residue conical coordinate (RCC), the amino acid composition (AAC), the dipeptide composition (DPC), and the sequence embedding code (SEC) are extracted as the peptide chain features. Subsequently, these features are divided into the biological feature and sequence feature, and separately inputted into the neural network of CapsNet. Moreover, the attention module CBAM is added to the network to assign weights to channels and spaces, as an attempt to enhance the feature learning and improve the network training effect. To verify the effectiveness of the proposed method, it is compared with some other popular methods. As revealed from the experimentally achieved results, the proposed method outperforms those methods in most performance assessments.

Self-validating deep learning of continental hydrology through satellite gravimetry and altimetry

2021 ◽  
Author(s):  
Christopher Irrgang ◽  
Jan Saynisch-Wagner ◽  
Robert Dill ◽  
Eva Boergens ◽  
Maik Thomas
Keyword(s):  
Neural Network ◽  
Satellite Altimetry ◽  
Water Cycle ◽  
Global Water Cycle ◽  
Network Training ◽  
The Neural Network ◽  
Continental Hydrology ◽  
Terrestrial Water ◽  
Combine Machine ◽  
Groundwater Basins

<p>Space-borne observations of terrestrial water storage (TWS) are an essential ingredient for understanding the Earth's global water cycle, its susceptibility to climate change, and for risk assessments of ecosystems, agriculture, and water management. However, the complex distribution of water masses in rivers, lakes, or groundwater basins remains elusive in coarse-resolution gravimetry observations. We combine machine learning, numerical modeling, and satellite altimetry to build and train a downscaling neural network that recovers simulated TWS from synthetic space-borne gravity observations. The neural network is designed to adapt and validate its training progress by considering independent satellite altimetry records. We show that the neural network can accurately derive TWS anomalies in 2019 after being trained over the years 2003 to 2018. Specifically for validated regions in the Amazonas, we highlight that the neural network can outperform the numerical hydrology model used in the network training.</p><p>https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2020GL089258</p>

Research on the Optimized Algorithms on Neural Network

2012 ◽  
Vol 605-607 ◽  
pp. 2175-2178
Author(s):  
Xiao Qin Wu
Keyword(s):  
Neural Network ◽  
Bp Neural Network ◽  
Simulated Annealing Algorithm ◽  
Fitness Function ◽  
Strong Stability ◽  
Training Algorithm ◽  
Network Training ◽  
The Neural Network ◽  
Annealing Algorithm ◽  
Proper Operation

In order to overcome the disadvantage of neural networks that their structure and parameters were decided stochastically or by one’s experience, an improved BP neural network training algorithm based on genetic algorithm was proposed.In this paper,genetic algorithms and simulated annealing algorithm that optimizes neural network is proposed which is used to scale the fitness function and select the proper operation according to the expected value in the course of optimization,and the weights and thresholds of the neural network is optimized. This method is applied to the stock prediction system.The experimental results show that the proposed approach have high accuracy,strong stability and improved confidence.

A Graph Grammar Approach to Generate Neural Network Topologies

2007 ◽  
Author(s):  
Chaitanya Vempati ◽  
Matthew I. Campbell
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Process Modeling ◽  
Graph Transformation ◽  
Graph Grammar ◽  
Transformation Rules ◽  
The Neural Network ◽  
Network Topologies ◽  
Novel Method ◽  
Defining Graph

Neural networks are increasingly becoming a useful and popular choice for process modeling. The success of neural networks in effectively modeling a certain problem depends on the topology of the neural network. Generating topologies manually relies on previous neural network experience and is tedious and difficult. Hence there is a rising need for a method that generates neural network topologies for different problems automatically. Current methods such as growing, pruning and using genetic algorithms for this task are very complicated and do not explore all the possible topologies. This paper presents a novel method of automatically generating neural networks using a graph grammar. The approach involves representing the neural network as a graph and defining graph transformation rules to generate the topologies. The approach is simple, efficient and has the ability to create topologies of varying complexity. Two example problems are presented to demonstrate the power of our approach.

scholarly journals Modeling a Thermochemical Reactor of a Solar Refrigerator by BaCl2-NH3 Sorption Using Artificial Neural Networks and Mathematical Symmetry Groups

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Onesimo Meza-Cruz ◽  
Isaac Pilatowsky ◽  
Agustín Pérez-Ramírez ◽  
Carlos Rivera-Blanco ◽  
Youness El Hamzaoui ◽  
...  
Keyword(s):  
Neural Network ◽  
Experimental Data ◽  
Neural Networks ◽  
Heating Temperature ◽  
Barium Chloride ◽  
Symmetry Groups ◽  
Solar Cooling ◽  
Network Training ◽  
The Neural Network ◽  
Marquardt Algorithm

The aim of this work is to present a model for heat transfer, desorbed refrigerant, and pressure of an intermittent solar cooling system’s thermochemical reactor based on backpropagation neural networks and mathematical symmetry groups. In order to achieve this, a reactor was designed and built based on the reaction of BaCl2-NH3. Experimental data from this reactor were collected, where barium chloride was used as a solid absorbent and ammonia as a refrigerant. The neural network was trained using the Levenberg–Marquardt algorithm. The correlation coefficient between experimental data and data simulated by the neural network was r = 0.9957. In the neural network’s sensitivity analysis, it was found that the inputs, reactor’s heating temperature and sorption time, influence neural network’s learning by 35% and 20%, respectively. It was also found that, by applying permutations to experimental data and using multibase mathematical symmetry groups, the neural network training algorithm converges faster.

The Novel Method of Structural Health Monitoring Using FEM and Neural Networks

2005 ◽  
Vol 475-479 ◽  
pp. 2099-2102 ◽  
Author(s):  
Shijie Zheng ◽  
Hong Tao Wang ◽  
Lifeng Liu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Composite Beam ◽  
Epoxy Composite ◽  
The Novel ◽  
Element Analysis ◽  
The Neural Network ◽  
The Finite Element Analysis ◽  
Novel Method ◽  
Modal Values

In this paper, a new method of combining computational mechanics and neural networks for prediction of composite beam delamination is proposed. One beam with delamination, as well as a ‘healthy’ beam with no delamination, had a four-ply symmetric carbon/epoxy composite design, were fabricated simultaneously. The delamination was assumed at different location of the beam, and then the finite element analysis was performed and the modal frequencies of the composite beam were obtained, which were used to train the neural network. The piezoelectric patch was attached to the top of the composite beam to measure its modal frequencies. A feedforward backpropagation neural network was designed, trained, and used to predict the delamination location using the experimental modal values as inputs. The experimental results demonstrate that the predicted delamination location and size error is small.

EFFECTS OF NONSINGULAR PREPROCESSING ON FEEDFORWARD NETWORK TRAINING

2005 ◽  
Vol 19 (02) ◽  
pp. 217-247 ◽  
Author(s):  
CHANGHUA YU ◽  
MICHAEL T. MANRY ◽  
JIANG LI
Keyword(s):  
Back Propagation ◽  
Original Data ◽  
Data Sets ◽  
Training Algorithm ◽  
Feedforward Network ◽  
Data Set ◽  
Network Training ◽  
The Neural Network ◽  
Hidden Layer ◽  
Theoretical Analyses

In the neural network literature, many preprocessing techniques, such as feature de-correlation, input unbiasing and normalization, are suggested to accelerate multilayer perceptron training. In this paper, we show that a network trained with an original data set and one trained with a linear transformation of the original data will go through the same training dynamics, as long as they start from equivalent states. Thus preprocessing techniques may not be helpful and are merely equivalent to using a different weight set to initialize the network. Theoretical analyses of such preprocessing approaches are given for conjugate gradient, back propagation and the Newton method. In addition, an efficient Newton-like training algorithm is proposed for hidden layer training. Experiments on various data sets confirm the theoretical analyses and verify the improvement of the new algorithm.

scholarly journals An Application of Neural Network Technique to Correct the Dome Temperature Effects on Pyrgeometer Measurements

2006 ◽  
Vol 23 (1) ◽  
pp. 80-89 ◽  
Author(s):  
Amauri P. Oliveira ◽  
Jacyra Soares ◽  
Marija Z. Božnar ◽  
Primož Mlakar ◽  
João F. Escobedo
Keyword(s):  
Neural Network ◽  
Temperature Effects ◽  
Longwave Radiation ◽  
Global Solar Radiation ◽  
Time Of Day ◽  
Network Training ◽  
The Neural Network ◽  
Neural Network Algorithm ◽  
Using Data ◽  
The City

Abstract This work describes an application of a multilayer perceptron neural network technique to correct dome emission effects on longwave atmospheric radiation measurements carried out using an Eppley Precision Infrared Radiometer (PIR) pyrgeometer. It is shown that approximately 7-month-long measurements of dome and case temperatures and meteorological variables available in regular surface stations (global solar radiation, air temperature, and air relative humidity) are enough to train the neural network algorithm and correct the observed longwave radiation for dome temperature effects in surface stations with climates similar to that of the city of São Paulo, Brazil. The network was trained using data from 15 October 2003 to 7 January 2004 and verified using data, not present during the network-training period, from 8 January to 30 April 2004. The longwave radiation values generated by the neural network technique were very similar to the values obtained by Fairall et al., assumed here as the reference approach to correct dome emission effects in PIR pyrgeometers. Compared to the empirical approach the neural network technique is less limited to sensor type and time of day (allows nighttime corrections).

scholarly journals Neural network training for vehicle fuel level control

2021 ◽  
Vol 4 (135) ◽  
pp. 12-22
Author(s):  
Vladimir Gerasimov ◽  
Nadija Karpenko ◽  
Denys Druzhynin
Keyword(s):  
Neural Network ◽  
Fuel Consumption ◽  
Confusion Matrix ◽  
Training Model ◽  
Neural Network Training ◽  
Raw Data ◽  
Network Training ◽  
The Neural Network ◽  
Fuel Level ◽  
Distorted Data

The goal of the paper is to create a training model based on real raw noisy data and train a neural network to determine the behavior of the fuel level, namely, to determine the time and volume of vehicle refueling, fuel consumption / excessive consumption / drainage.Various algorithms and data processing methods are used in fuel control and metering systems to get rid of noise. In some systems, primary filtering is used by excluding readings that are out of range, sharp jumps and deviations, and averaging over a sliding window. Research is being carried out on the use of more complex filters than simple averaging – by example, the Kalman filter for data processing.When measuring the fuel level using various fuel level sensor the data is influenced by many external factors that can interfere with the measurement and distort the real fuel level. Since these interferences are random and have a different structure, it is very difficult to completely remove them using classical noise suppression algorithms. Therefore, we use artificial intelligence, namely a neural network, to find patterns, detect noise and correct distorted data. To correct distorted data, you first need to determine which data is distorted, classify the data.In the course of the work, the raw data on the fuel level were transformed for use in the neural network training model. To describe the behavior of the fuel level, we use 4 possible classes: fuel consumption is observed, the vehicle is refueled, the fuel level does not change (the vehicle is idle), the data is distorted by noise. Also, in the process of work, additional tools of the DeepLearning4 library were used to load data training and training a neural network. A multilayer neural network model is used, namely a three-layer neural network, as well as used various training parameters provided by the DeepLearning4j library, which were obtained because of experiments.After training the neural network was used on test data, because of which the Confusion Matrix and Evaluation Metrics were obtained.In conclusion, finding a good model takes a lot of ideas and a lot of experimentation, also need to correctly process and transform the raw data to get the correct data for training. So far, a neural network has been trained to determine the state of the fuel level at a point in time and classify the behavior into four main labels (classes). Although we have not reduced the error in determining the behavior of the fuel level to zero, we have saved the states of the neural network, and in the future we will be able to retrain and evolve our neural network to obtain better results.

Sign in / Sign up

Export Citation Format

Share Document