scholarly journals High Performance Implementation of Neural Networks Learning using Swarm Optimization Algorithms for EEG Classification based on Brain Wave Data

2022 ◽  
Vol 13 (1) ◽  
pp. 0-0
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Learning Algorithms ◽  
Optimization Algorithms ◽  
Machine Learning Algorithms ◽  
Test Accuracy ◽  
Brain Wave ◽  
Swarm Optimization ◽  
The Neural Network ◽  
The Brain

EEG analysis aims to help scientists better understand the brain, help physicians diagnose and treatment choices of the brain-computer interface. Artificial neural networks are among the most effective learning algorithms to perform computing tasks similar to biological neurons in the human brain. In some problems, the neural network model's performance might significantly degrade and overfit due to some irrelevant features that negatively influence the model performance. Swarm optimization algorithms are robust techniques that can be implemented to find optimal solutions to such problems. In this paper, Grey Wolf Optimizer (GWO) and Particle Swarm Optimization (PSO) algorithms are applied for the feature selection and the training of a Feed-forward Neural Network (FFNN). The performance of the FFNN in terms of test accuracy, precision, recall, and F1_score is investigated. Furthermore, this research has implemented other five machine learning algorithms for the purpose of comparison. Experimental results prove that the neural network model outperforms all other algorithms via GWO.

EMOTIONS RECOGNITION IN HUMAN SPEECH USING DEEP NEURAL NETWORKS

2021 ◽  
pp. 44-51
Author(s):  
E. Yu. Shchetinin
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Recurrent Neural Network ◽  
Deep Neural Networks ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Audio Recordings ◽  
Computer Studies

The recognition of human emotions is one of the most relevant and dynamically developing areas of modern speech technologies, and the recognition of emotions in speech (RER) is the most demanded part of them. In this paper, we propose a computer model of emotion recognition based on an ensemble of bidirectional recurrent neural network with LSTM memory cell and deep convolutional neural network ResNet18. In this paper, computer studies of the RAVDESS database containing emotional speech of a person are carried out. RAVDESS-a data set containing 7356 files. Entries contain the following emotions: 0 – neutral, 1 – calm, 2 – happiness, 3 – sadness, 4 – anger, 5 – fear, 6 – disgust, 7 – surprise. In total, the database contains 16 classes (8 emotions divided into male and female) for a total of 1440 samples (speech only). To train machine learning algorithms and deep neural networks to recognize emotions, existing audio recordings must be pre-processed in such a way as to extract the main characteristic features of certain emotions. This was done using Mel-frequency cepstral coefficients, chroma coefficients, as well as the characteristics of the frequency spectrum of audio recordings. In this paper, computer studies of various models of neural networks for emotion recognition are carried out on the example of the data described above. In addition, machine learning algorithms were used for comparative analysis. Thus, the following models were trained during the experiments: logistic regression (LR), classifier based on the support vector machine (SVM), decision tree (DT), random forest (RF), gradient boosting over trees – XGBoost, convolutional neural network CNN, recurrent neural network RNN (ResNet18), as well as an ensemble of convolutional and recurrent networks Stacked CNN-RNN. The results show that neural networks showed much higher accuracy in recognizing and classifying emotions than the machine learning algorithms used. Of the three neural network models presented, the CNN + BLSTM ensemble showed higher accuracy.

Machine Learning in Gifted Education: A Demonstration Using Neural Networks

2019 ◽  
Vol 63 (4) ◽  
pp. 243-252 ◽  
Author(s):  
Jaret Hodges ◽  
Soumya Mohan
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Supervised Learning ◽  
Language Processing ◽  
Gifted Education ◽  
Learning Algorithms ◽  
Simulated Data ◽  
Machine Learning Algorithms ◽  
Automated Driving ◽  
The Neural Network

Machine learning algorithms are used in language processing, automated driving, and for prediction. Though the theory of machine learning has existed since the 1950s, it was not until the advent of advanced computing that their potential has begun to be realized. Gifted education is a field where machine learning has yet to be utilized, even though one of the underlying problems of gifted education is classification, which is an area where learning algorithms have become exceptionally accurate. We provide a brief overview of machine learning with a focus on neural networks and supervised learning, followed by a demonstration using simulated data and neural networks for classification issues with a practical explanation of the mechanics of the neural network and associated R code. Implications for gifted education are then discussed. Finally, the limitations of supervised learning are discussed. Code used in this article can be found at https://osf.io/4pa3b/

scholarly journals Classification of potential blood donors using machine learning algorithms approach

2020 ◽  
Vol 8 (3) ◽  
pp. 217-221
Author(s):  
Merinda Lestandy ◽  
Lailis Syafa'ah ◽  
Amrul Faruq
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Blood Donor ◽  
Blood Donors ◽  
Naive Bayes ◽  
Learning Algorithms ◽  
Naïve Bayes ◽  
Machine Learning Algorithms ◽  
Blood Type ◽  
The Neural Network

Blood donation is the process of taking blood from someone used for blood transfusions. Blood type, sex, age, blood pressure, and hemoglobin are blood donor criteria that must be met and processed manually to classify blood donor eligibility. The manual process resulted in an irregular blood supply because blood donor candidates did not meet the criteria. This study implements machine learning algorithms includes kNN, naïve Bayes, and neural network methods to determine the eligibility of blood donors. This study used 600 training data divided into two classes, namely potential and non-potential donors. The test results show that the accuracy of the neural network is 84.3 %, higher than kNN and naïve Bayes, respectively of 75 % and 84.17 %. It indicates that the neural network method outperforms comparing with kNN and naïve Bayes.

scholarly journals Analysis of Effectiveness and Performance Prediction of Sports Flipped Classroom Teaching Based on Neural Networks

2021 ◽  
Vol 2021 ◽  
pp. 1-7
Author(s):  
Wei Xu ◽  
Wenying Xiong ◽  
Zhe Shao ◽  
Yun Li
Keyword(s):  
Neural Network ◽  
College Students ◽  
Neural Networks ◽  
Particle Swarm Optimization ◽  
Physical Education ◽  
Flipped Classroom ◽  
Extreme Values ◽  
Sports Performance ◽  
Swarm Optimization ◽  
The Neural Network

Traditional physical education methods are unable to meet this requirement due to the practical nature of sports skill teaching. As a result, as the times demanded, the flipped classroom based on neural network technology arose. It has the potential to not only promote the modernization of physical education but also to ensure that it has a positive educational impact. This is a mode of instruction. Furthermore, colleges and universities are increasingly focusing on college students’ overall quality development. A method for predicting college students’ sports performance using a particle swarm optimization neural network is proposed to accurately predict sports performance and provide a reliable analysis basis for the establishment of sports teaching goals. Neural networks are used in the model. The particle swarm optimization algorithm optimizes the variance and weights of the neural network to improve the accuracy of college students’ sports performance predicted by the neural network by updating the particle position and speed through the two extreme values of individual extreme values and global extreme values. Teachers always play the role of the facilitator and helper in the teaching process, which realizes the transformation of teachers’ and students’ self-positioning, allows students to better play the lead role, and stimulates students’ interest in learning.

Unsupervised physics-based neural networks for seismic migration

2019 ◽  
Vol 7 (3) ◽  
pp. SE189-SE200 ◽  
Author(s):  
Janaki Vamaraju ◽  
Mrinal K. Sen
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Data Processing ◽  
Seismic Data ◽  
Minimum Energy ◽  
Machine Learning Algorithms ◽  
Hopfield Neural Networks ◽  
Seismic Data Processing ◽  
Forward Models ◽  
The Neural Network

We have developed a novel framework for combining physics-based forward models and neural networks to advance seismic processing and inversion algorithms. Migration is an effective tool in seismic data processing and imaging. Over the years, the scope of these algorithms has broadened; today, migration is a central step in the seismic data processing workflow. However, no single migration technique is suitable for all kinds of data and all styles of acquisition. There is always a compromise on the accuracy, cost, and flexibility of these algorithms. On the other hand, machine-learning algorithms and artificial intelligence methods have been found immensely successful in applications in which big data are available. The applicability of these algorithms is being extensively investigated in scientific disciplines such as exploration geophysics with the goal of reducing exploration and development costs. In this context, we have used a special kind of unsupervised recurrent neural network and its variants, Hopfield neural networks and the Boltzmann machine, to solve the problems of Kirchhoff and reverse time migrations. We use the network to migrate seismic data in a least-squares sense using simulated annealing to globally optimize the cost function of the neural network. The weights and biases of the neural network are derived from the physics-based forward models that are used to generate seismic data. The optimal configuration of the neural network after training corresponds to the minimum energy of the network and thus gives the reflectivity solution of the migration problem. Using synthetic examples, we determine that (1) Hopfield neural networks are fast and efficient and (2) they provide reflectivity images with mitigated migration artifacts and improved spatial resolution. Specifically, the presented approach minimizes the artifacts that arise from limited aperture, low subsurface illumination, coarse sampling, and gaps in the data.

scholarly journals Implementation of the solution to the oil displacement problem using machine learning classifiers and neural networks

2021 ◽  
Vol 5 (4 (113)) ◽  
pp. 55-63
Author(s):  
Beimbet Daribayev ◽  
Aksultan Mukhanbet ◽  
Yedil Nurakhov ◽  
Timur Imankulov
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Learning Algorithms ◽  
High Accuracy ◽  
Machine Learning Algorithms ◽  
Gradient Boosting ◽  
Machine Learning Classifiers ◽  
Oil Displacement ◽  
Learning Classifiers

The problem of oil displacement was solved using neural networks and machine learning classifiers. The Buckley-Leverett model is selected, which describes the process of oil displacement by water. It consists of the equation of continuity of oil, water phases and Darcy’s law. The challenge is to optimize the oil displacement problem. Optimization will be performed at three levels: vectorization of calculations; implementation of classical algorithms; implementation of the algorithm using neural networks. A feature of the method proposed in the work is the identification of the method with high accuracy and the smallest errors, comparing the results of machine learning classifiers and types of neural networks. The research paper is also one of the first papers in which a comparison was made with machine learning classifiers and neural and recurrent neural networks. The classification was carried out according to three classification algorithms, such as decision tree, support vector machine (SVM) and gradient boosting. As a result of the study, the Gradient Boosting classifier and the neural network showed high accuracy, respectively 99.99 % and 97.4 %. The recurrent neural network trained faster than the others. The SVM classifier has the lowest accuracy score. To achieve this goal, a dataset was created containing over 67,000 data for class 10. These data are important for the problems of oil displacement in porous media. The proposed methodology provides a simple and elegant way to instill oil knowledge into machine learning algorithms. This removes two of the most significant drawbacks of machine learning algorithms: the need for large datasets and the robustness of extrapolation. The presented principles can be generalized in countless ways in the future and should lead to a new class of algorithms for solving both forward and inverse oil problems

scholarly journals Artificial Neurovascular Network (ANVN) to Study the Accuracy Vs. Efficiency trade-off in an Energy Dependent Neural Network

2021 ◽  
Author(s):  
Bhadra S Kumar ◽  
Nagavarshini Mayakkannan ◽  
N Sowmya Manojna ◽  
V. Srinivasa Chakravarthy
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Energy Supply ◽  
Minimum Energy ◽  
Limited Resource ◽  
Vascular Network ◽  
Vascular Tree ◽  
The Neural Network ◽  
Hidden Neurons ◽  
The Brain

AbstractArtificial feedforward neural networks perform a wide variety of classification and function approximation tasks with high accuracy. Unlike their artificial counterparts, biological neural networks require a supply of adequate energy delivered to single neurons by a network of cerebral microvessels. Since energy is a limited resource, a natural question is whether the cerebrovascular network is capable of ensuring maximum performance of the neural network while consuming minimum energy? Should the cerebrovascular network also be trained, along with the neural network, to achieve such an optimum?In order to answer the above questions in a simplified modeling setting, we constructed an Artificial Neurovascular Network (ANVN) comprising a multilayered perceptron (MLP) connected to a vascular tree structure. The root node of the vascular tree structure is connected to an energy source, and the terminal nodes of the vascular tree supply energy to the hidden neurons of the MLP. The energy delivered by the terminal vascular nodes to the hidden neurons determines the biases of the hidden neurons. The “weights” on the branches of the vascular tree depict the energy distribution from the parent node to the child nodes. The vascular weights are updated by a kind of “backpropagation” of the energy demand error generated by the hidden neurons.We observed that higher performance was achieved at lower energy levels when the vascular network was also trained along with the neural network. This indicates that the vascular network needs to be trained to ensure efficient neural performance. We observed that below a certain network size, the energetic dynamics of the network in the per capita energy consumption vs. classification accuracy space approaches a fixed-point attractor for various initial conditions. Once the number of hidden neurons increases beyond a threshold, the fixed point appears to vanish, giving place to a line of attractors. The model also showed that when there is a limited resource, the energy consumption of neurons is strongly correlated to their individual contribution to the network’s performance.Author summaryThe limited availability of resources contributed to a significant role in shaping evolution. The brain is also no different. It is known to have tremendous computing power at a significantly lower cost than artificial computing systems. The artificial neural networks aim typically at minimizing output error and maximizing accuracy. A biological network like the brain has an added constraint of energy availability, which might force it to choose an optimal solution that provides the best possible accuracy while consuming minimum energy. The intricate vascular network which ensures adequate energy to the brain might be a systematically trained layout rather than a hard-wired anatomical structure. Through this work, we intend to explore how the artificial neural network would behave if it were made dependent on an energy supply network and how the training of the energy supply network would influence the performance of the neural network. Our model concluded that training of a vascular energy network is highly desirable, and when the size of the neural network is small, the energy consumed by each neuron is a direct readout on its contribution to the network performance.

scholarly journals Human-Computer Interaction with Special Emphasis on Converting Brain Signals to Speech

2020 ◽  
Vol 9 (6) ◽  
pp. 523-529
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Science Fiction ◽  
Linear Models ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
The Road ◽  
Brain Signals ◽  
On The Road ◽  
The Brain

Huge hurdle neuro engineers face on the road to effective brain-computer interfaces is attempting to translate the big selection of signals made by our brain into words pictures which may be simply communicable. The science-fiction plan of having the ability to manage devices or communicate with others simply by thinking is slowly but surely, obtaining nearer to reality. Translating brainwaves into words has been another large challenge for researchers, but again with the help of machine learning algorithms, superb advances are seen in recent years. The exploitation of deep learning and acceptable machine learning algorithms, the management signals from the brain will regenerate to some actions or some speech or text. For this, a neural network is created for the brain and conjointly a mapping is completed to catch all the brain signals in which neural network will be additionally used for changing these signals into actions. From the past literature, it is being concluded that the Deep Neural Networks are one of the main algorithms that are being placed into use for this research. This review article majorly focuses on studying the behavioral patterns generated by the brain signals and how they can be converted into actions effectively so that people suffering from semi or full paralysis can use this technology to live a normal life if not completely but to a certain extent. Also, it focuses on analyzing and drawing a comparison between linear and non-linear models and to conclude the best-suited model for the same currently available to the researchers.

scholarly journals Cell Cycle-Regulated Genes Classification using Machine Learning and Deep Learning Techniques on Processed Microarrays Images

2021 ◽  
Vol 10 (2) ◽  
pp. 1100-1107
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Cell Cycle ◽  
Deep Learning ◽  
New Technologies ◽  
Gene Evolution ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Support Vector ◽  
Test Accuracy

Nowadays, machine learning and deep learning algorithms, are considered as new technologies increasingly used in the biomedical field. Machine learning is a branch of Artificial Intelligence that aims to automatically find patterns in existing data. A new Machine Learning subfield, the deep learning theory, has emerged. It deals with object recognition in images. In this paper, our goal is DNA Microarrays’analysis with these algorithms to classify two genes’ types. The first class represents cell cycle regulated genes and the second is non cell cycle regulated ones. In the current state of the art, the researchers are processing the numerical data associated to gene evolution to achieve this classification. Here, we propose a new and different approach, based on the microarrays images’ treatment. To classify images, we use three machine learning algorithms which are: Support Vector Machine, KNearest Neighbors and Random Forest Classifier. We also use the Convolutional Neural Network and the fully connected neural network algorithms. Experiments demonstrate that our approaches outperform the state of art by a margin of 14.73 per cent by using machine learning algorithms and a margin of 22.39 per cent by using deep learning models. Our models accomplish real time test accuracy of ~ 92.39 % at classifying using CNNand 94.73% using machine learning algorithms.

scholarly journals Effects of Fast Presynaptic Noise in Attractor Neural Networks

2006 ◽  
Vol 18 (3) ◽  
pp. 614-633 ◽  
Author(s):  
J. M. Cortes ◽  
J. J. Torres ◽  
J. Marro ◽  
P. L. Garrido ◽  
H. J. Kappen
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Short Timescale ◽  
The Neural Network ◽  
Network Sensitivity ◽  
Transmission Of Information ◽  
Class Identification ◽  
Short Time ◽  
The Brain ◽  
Neuron Dynamics

We study both analytically and numerically the effect of presynaptic noise on the transmission of information in attractor neural networks. The noise occurs on a very short timescale compared to that for the neuron dynamics and it produces short-time synaptic depression. This is inspired in recent neurobiological findings that show that synaptic strength may either increase or decrease on a short timescale depending on presynaptic activity. We thus describe a mechanism by which fast presynaptic noise enhances the neural network sensitivity to an external stimulus. The reason is that, in general, presynaptic noise induces nonequilibrium behavior and, consequently, the space of fixed points is qualitatively modified in such a way that the system can easily escape from the attractor. As a result, the model shows, in addition to pattern recognition, class identification and categorization, which may be relevant to the understanding of some of the brain complex tasks.

Sign in / Sign up

Export Citation Format

Share Document