Co-evolving Multilayer Perceptrons Along Training Sets

2006 ◽  
pp. 503-513 ◽  
Author(s):  
M. G. Arenas ◽  
P. A. Castillo ◽  
G. Romero ◽  
F. Rateb ◽  
J. J. Merelo
Keyword(s):  
Multilayer Perceptrons ◽  
Training Sets

Specification of Training Sets and the Number of Hidden Neurons for Multilayer Perceptrons

2001 ◽  
Vol 13 (12) ◽  
pp. 2673-2680 ◽  
Author(s):  
L. S. Camargo ◽  
T. Yoneyama
Keyword(s):  
Chebyshev Polynomials ◽  
Main Idea ◽  
Multilayer Perceptrons ◽  
Input Output ◽  
Real Functions ◽  
Bounded Functions ◽  
Hidden Layer ◽  
Hidden Neurons ◽  
Selection Of ◽  
Training Sets

This work concerns the selection of input-output pairs for improved training of multilayer perceptrons, in the context of approximation of univariate real functions. A criterion for the choice of the number of neurons in the hidden layer is also provided. The main idea is based on the fact that Chebyshev polynomials can provide approximations to bounded functions up to a prescribed tolerance, and, in turn, a polynomial of a certain order can be fitted with a three-layer perceptron with a prescribed number of hidden neurons. The results are applied to a sensor identification example.

Molecular Generation Targeting Desired Electronic Properties via Deep Generative Models

2019 ◽  
Author(s):  
Qi Yuan ◽  
Alejandro Santana-Bonilla ◽  
Martijn Zwijnenburg ◽  
Kim Jelfs
Keyword(s):  
Neural Network ◽  
Electronic Properties ◽  
Transfer Learning ◽  
Recurrent Neural Network ◽  
Chemical Space ◽  
Generative Models ◽  
Molecular Features ◽  
Donor Acceptor ◽  
Homo Lumo ◽  
Training Sets

<p>The chemical space for novel electronic donor-acceptor oligomers with targeted properties was explored using deep generative models and transfer learning. A General Recurrent Neural Network model was trained from the ChEMBL database to generate chemically valid SMILES strings. The parameters of the General Recurrent Neural Network were fine-tuned via transfer learning using the electronic donor-acceptor database from the Computational Material Repository to generate novel donor-acceptor oligomers. Six different transfer learning models were developed with different subsets of the donor-acceptor database as training sets. We concluded that electronic properties such as HOMO-LUMO gaps and dipole moments of the training sets can be learned using the SMILES representation with deep generative models, and that the chemical space of the training sets can be efficiently explored. This approach identified approximately 1700 new molecules that have promising electronic properties (HOMO-LUMO gap <2 eV and dipole moment <2 Debye), 6-times more than in the original database. Amongst the molecular transformations, the deep generative model has learned how to produce novel molecules by trading off between selected atomic substitutions (such as halogenation or methylation) and molecular features such as the spatial extension of the oligomer. The method can be extended as a plausible source of new chemical combinations to effectively explore the chemical space for targeted properties.</p>

scholarly journals The Use of Artificial Neural Networks and a General Discriminant Analysis for Predicting Culling Reasons in Holstein-Friesian Cows Based on First-Lactation Performance Records

Animals ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. 721
Author(s):  
Krzysztof Adamczyk ◽  
Wilhelm Grzesiak ◽  
Daniel Zaborski
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Discriminant Analysis ◽  
Multilayer Perceptrons ◽  
Correct Classification ◽  
Correct Classification Rate ◽  
Classification Rate ◽  
Holstein Friesian ◽  
Artificial Neural ◽  
Friesian Cows

The aim of the present study was to verify whether artificial neural networks (ANN) may be an effective tool for predicting the culling reasons in cows based on routinely collected first-lactation records. Data on Holstein-Friesian cows culled in Poland between 2017 and 2018 were used in the present study. A general discriminant analysis (GDA) was applied as a reference method for ANN. Considering all predictive performance measures, ANN were the most effective in predicting the culling of cows due to old age (99.76–99.88% of correctly classified cases). In addition, a very high correct classification rate (99.24–99.98%) was obtained for culling the animals due to reproductive problems. It is significant because infertility is one of the conditions that are the most difficult to eliminate in dairy herds. The correct classification rate for individual culling reasons obtained with GDA (0.00–97.63%) was, in general, lower than that for multilayer perceptrons (MLP). The obtained results indicated that, in order to effectively predict the previously mentioned culling reasons, the following first-lactation parameters should be used: calving age, calving difficulty, and the characteristics of the lactation curve based on Wood’s model parameters.

scholarly journals Semi-automated classification of colonial Microcystis by FlowCAM imaging flow cytometry in mesocosm experiment reveals high heterogeneity during seasonal bloom

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Yersultan Mirasbekov ◽  
Adina Zhumakhanova ◽  
Almira Zhantuyakova ◽  
Kuanysh Sarkytbayev ◽  
Dmitry V. Malashenkov ◽  
...  
Keyword(s):  
Machine Learning ◽  
Flow Cytometry ◽  
Spatial Resolution ◽  
Mesocosm Experiment ◽  
Imaging Flow Cytometry ◽  
Leibler Divergence ◽  
Temporal And Spatial ◽  
High Level ◽  
Training Sets

AbstractA machine learning approach was employed to detect and quantify Microcystis colonial morphospecies using FlowCAM-based imaging flow cytometry. The system was trained and tested using samples from a long-term mesocosm experiment (LMWE, Central Jutland, Denmark). The statistical validation of the classification approaches was performed using Hellinger distances, Bray–Curtis dissimilarity, and Kullback–Leibler divergence. The semi-automatic classification based on well-balanced training sets from Microcystis seasonal bloom provided a high level of intergeneric accuracy (96–100%) but relatively low intrageneric accuracy (67–78%). Our results provide a proof-of-concept of how machine learning approaches can be applied to analyze the colonial microalgae. This approach allowed to evaluate Microcystis seasonal bloom in individual mesocosms with high level of temporal and spatial resolution. The observation that some Microcystis morphotypes completely disappeared and re-appeared along the mesocosm experiment timeline supports the hypothesis of the main transition pathways of colonial Microcystis morphoforms. We demonstrated that significant changes in the training sets with colonial images required for accurate classification of Microcystis spp. from time points differed by only two weeks due to Microcystis high phenotypic heterogeneity during the bloom. We conclude that automatic methods not only allow a performance level of human taxonomist, and thus be a valuable time-saving tool in the routine-like identification of colonial phytoplankton taxa, but also can be applied to increase temporal and spatial resolution of the study.

scholarly journals Minimization of the Line Resistance Impact on Memdiode-Based Simulations of Multilayer Perceptron Arrays Applied to Pattern Recognition

2021 ◽  
Vol 11 (1) ◽  
pp. 9
Author(s):  
Fernando Leonel Aguirre ◽  
Nicolás M. Gomez ◽  
Sebastián Matías Pazos ◽  
Félix Palumbo ◽  
Jordi Suñé ◽  
...  
Keyword(s):  
Pattern Recognition ◽  
Ex Situ ◽  
Multilayer Perceptrons ◽  
Spice Simulation ◽  
Large Dataset ◽  
High Line ◽  
Calibration Algorithm ◽  
The Impact ◽  
Line Resistance

In this paper, we extend the application of the Quasi-Static Memdiode model to the realistic SPICE simulation of memristor-based single (SLPs) and multilayer perceptrons (MLPs) intended for large dataset pattern recognition. By considering ex-situ training and the classification of the hand-written characters of the MNIST database, we evaluate the degradation of the inference accuracy due to the interconnection resistances for MLPs involving up to three hidden neural layers. Two approaches to reduce the impact of the line resistance are considered and implemented in our simulations, they are the inclusion of an iterative calibration algorithm and the partitioning of the synaptic layers into smaller blocks. The obtained results indicate that MLPs are more sensitive to the line resistance effect than SLPs and that partitioning is the most effective way to minimize the impact of high line resistance values.

Spatial-temporal variables for swimming coaches: A comparison study between video and TritonWear sensor

2021 ◽  
pp. 174795412110137
Author(s):  
Robin Pla ◽  
Thibaut Ledanois ◽  
Escobar David Simbana ◽  
Anaël Aubry ◽  
Benjamin Tranchard ◽  
...  
Keyword(s):  
Swimming Performance ◽  
Video Recording ◽  
Open Water ◽  
Percentage Error ◽  
Stroke Index ◽  
Wearable Sensor ◽  
Stroke Length ◽  
Video Recordings ◽  
Temporal Variables ◽  
Training Sets

The main aim of this study was to evaluate the validity and the reliability of a swimming sensor to assess swimming performance and spatial-temporal variables. Six international male open-water swimmers completed a protocol which consisted of two training sets: a 6×100m individual medley and a continuous 800 m set in freestyle. Swimmers were equipped with a wearable sensor, the TritonWear to collect automatically spatial-temporal variables: speed, lap time, stroke count (SC), stroke length (SL), stroke rate (SR), and stroke index (SI). Video recordings were added as a “gold-standard” and used to assess the validity and the reliability of the TritonWear sensor. The results show that the sensor provides accurate results in comparison with video recording measurements. A very high accuracy was observed for lap time with a mean absolute percentage error (MAPE) under 5% for each stroke (2.2, 3.2, 3.4, 4.1% for butterfly, backstroke, breaststroke and freestyle respectively) but high error ranges indicate a dependence on swimming technique. Stroke count accuracy was higher for symmetric strokes than for alternate strokes (MAPE: 0, 2.4, 7.1 & 4.9% for butterfly, breaststroke, backstroke & freestyle respectively). The other variables (SL, SR & SI) derived from the SC and the lap time also show good accuracy in all strokes. The wearable sensor provides an accurate real time feedback of spatial-temporal variables in six international open-water swimmers during classical training sets (at low to moderate intensities), which could be a useful tool for coaches, allowing them to monitor training load with no effort.

scholarly journals Estimation of electrical resistivity using artificial neural networks: a case study from Lublin Basin, SE Poland

2021 ◽  
Author(s):  
Jakub Ważny ◽  
Michał Stefaniuk ◽  
Adam Cygal
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Training Data ◽  
Multilayer Perceptrons ◽  
Borehole Data ◽  
Geological Interpretation ◽  
Se Poland ◽  
Geological Conditions ◽  
Artificial Neural ◽  
Reliable Solution

AbstractArtificial neural networks method (ANNs) is a common estimation tool used for geophysical applications. Considering borehole data, when the need arises to supplement a missing well log interval or whole logging—ANNs provide a reliable solution. Supervised training of the network on a reliable set of borehole data values with further application of this network on unknown wells allows creation of synthetic values of missing geophysical parameters, e.g., resistivity. The main assumptions for boreholes are: representation of similar geological conditions and the use of similar techniques of well data collection. In the analyzed case, a set of Multilayer Perceptrons were trained on five separate chronostratigraphic intervals of borehole, considered as training data. The task was to predict missing deep laterolog (LLD) logging in a borehole representing the same sequence of layers within the Lublin Basin area. Correlation between well logs data exceeded 0.8. Subsequently, magnetotelluric parametric soundings were modeled and inverted on both boreholes. Analysis showed that congenial Occam 1D models had better fitting of TM mode of MT data in each case. Ipso facto, synthetic LLD log could be considered as a basis for geophysical and geological interpretation. ANNs provided solution for supplementing datasets based on this analytical approach.

scholarly journals Sensor Validation and Diagnostic Potential of Smartwatches in Movement Disorders

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3139
Author(s):  
Julian Varghese ◽  
Catharina Marie van Alen ◽  
Michael Fujarski ◽  
Georg Stefan Schlake ◽  
Julitta Sucker ◽  
...  
Keyword(s):  
Low Noise ◽  
Disease Classification ◽  
Multilayer Perceptrons ◽  
Sensor Validation ◽  
Diagnostic Potential ◽  
A Prospective Study ◽  
Learning Architectures ◽  
Diagnosis Classification ◽  
Healthy Participants ◽  
Digital Biomarkers

Smartwatches provide technology-based assessments in Parkinson’s Disease (PD). It is necessary to evaluate their reliability and accuracy in order to include those devices in an assessment. We present unique results for sensor validation and disease classification via machine learning (ML). A comparison setup was designed with two different series of Apple smartwatches, one Nanometrics seismometer and a high-precision shaker to measure tremor-like amplitudes and frequencies. Clinical smartwatch measurements were acquired from a prospective study including 450 participants with PD, differential diagnoses (DD) and healthy participants. All participants wore two smartwatches throughout a 15-min examination. Symptoms and medical history were captured on the paired smartphone. The amplitude error of both smartwatches reaches up to 0.005 g, and for the measured frequencies, up to 0.01 Hz. A broad range of different ML classifiers were cross-validated. The most advanced task of distinguishing PD vs. DD was evaluated with 74.1% balanced accuracy, 86.5% precision and 90.5% recall by Multilayer Perceptrons. Deep-learning architectures significantly underperformed in all classification tasks. Smartwatches are capable of capturing subtle tremor signs with low noise. Amplitude and frequency differences between smartwatches and the seismometer were under the level of clinical significance. This study provided the largest PD sample size of two-hand smartwatch measurements and our preliminary ML-evaluation shows that such a system provides powerful means for diagnosis classification and new digital biomarkers, but it remains challenging for distinguishing similar disorders.

scholarly journals A supervised machine learning approach to characterize spinal network function

2019 ◽  
Vol 121 (6) ◽  
pp. 2001-2012 ◽  
Author(s):  
A. N. Dalrymple ◽  
S. A. Sharples ◽  
N. Osachoff ◽  
A. P. Lognon ◽  
P. J. Whelan
Keyword(s):  
Machine Learning ◽  
Spinal Cord ◽  
Nervous System ◽  
Spontaneous Activity ◽  
Machine Learning Algorithms ◽  
Supervised Machine Learning ◽  
Network Activity ◽  
Multilayer Perceptrons ◽  
Network Development ◽  
Newborn Mice

Spontaneous activity is a common feature of immature neuronal networks throughout the central nervous system and plays an important role in network development and consolidation. In postnatal rodents, spontaneous activity in the spinal cord exhibits complex, stochastic patterns that have historically proven challenging to characterize. We developed a software tool for quickly and automatically characterizing and classifying episodes of spontaneous activity generated from developing spinal networks. We recorded spontaneous activity from in vitro lumbar ventral roots of 16 neonatal [postnatal day (P)0–P3] mice. Recordings were DC coupled and detrended, and episodes were separated for analysis. Amplitude-, duration-, and frequency-related features were extracted from each episode and organized into five classes. Paired classes and features were used to train and test supervised machine learning algorithms. Multilayer perceptrons were used to classify episodes as rhythmic or multiburst. We increased network excitability with potassium chloride and tested the utility of the tool to detect changes in features and episode class. We also demonstrate usability by having a novel experimenter use the program to classify episodes collected at a later time point (P5). Supervised machine learning-based classification of episodes accounted for changes that traditional approaches cannot detect. Our tool, named SpontaneousClassification, advances the detail in which we can study not only developing spinal networks, but also spontaneous networks in other areas of the nervous system.NEW & NOTEWORTHY Spontaneous activity is important for nervous system network development and consolidation. Our software uses machine learning to automatically and quickly characterize and classify episodes of spontaneous activity in the spinal cord of newborn mice. It detected changes in network activity following KCl-enhanced excitation. Using our software to classify spontaneous activity throughout development, in pathological models, or with neuromodulation, may offer insight into the development and organization of spinal circuits.

Sign in / Sign up

Export Citation Format

Share Document