scholarly journals A Grammar-based Genetic Programming Approach to Optimize Convolutional Neural Network Architectures

2018 ◽  
Author(s):  
Jessica Barbosa Diniz ◽  
Filipe R. Cordeiro ◽  
Pericles B. C. Miranda ◽  
Laura A. Tomaz Da Silva
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Genetic Programming ◽  
Convolutional Neural Network ◽  
Research Area ◽  
Classification Performance ◽  
Programming Approach ◽  
Network Architectures ◽  
Neural Network Architectures ◽  
Grammar Based Genetic Programming

Deep Learning is a research area under the spotlight in recent years due to its successful application to many domains, such as computer vision and image recognition. The most prominent technique derived from Deep Learning is Convolutional Neural Network, which allows the network to automatically learn representations needed for detection or classification tasks. However, Convolutional Neural Networks have some limitations, as designing these networks are not easy to master and require expertise and insight. In this work, we present the use of Genetic Algorithm associated to Grammar-based Genetic Programming to optimize Convolution Neural Network architectures. To evaluate our proposed approach, we adopted CIFAR-10 dataset to validate the evolution of the generated architectures, using the metric of accuracy to evaluate its classification performance in the test dataset. The results demonstrate that our method using Grammar-based Genetic Programming can easily produce optimized CNN architectures that are competitive and achieve high accuracy results.

scholarly journals A Genetic Programming Approach to Designing Convolutional Neural Network Architectures

2018 ◽  
Author(s):  
Masanori Suganuma ◽  
Shinichi Shirakawa ◽  
Tomoharu Nagao
Keyword(s):  
Neural Network ◽  
Genetic Programming ◽  
Convolutional Neural Network ◽  
State Of The Art ◽  
Directed Acyclic Graphs ◽  
Validation Dataset ◽  
Programming Approach ◽  
Network Architectures ◽  
Cartesian Genetic Programming ◽  
Acyclic Graphs

We propose a method for designing convolutional neural network (CNN) architectures based on Cartesian genetic programming (CGP). In the proposed method, the architectures of CNNs are represented by directed acyclic graphs, in which each node represents highly-functional modules such as convolutional blocks and tensor operations, and each edge represents the connectivity of layers. The architecture is optimized to maximize the classification accuracy for a validation dataset by an evolutionary algorithm. We show that the proposed method can find competitive CNN architectures compared with state-of-the-art methods on the image classification task using CIFAR-10 and CIFAR-100 datasets.

scholarly journals Validating Deep Neural Networks for Online Decoding of Motor Imagery Movements from EEG Signals

Sensors ◽  
2019 ◽  
Vol 19 (1) ◽  
pp. 210 ◽  
Author(s):  
Zied Tayeb ◽  
Juri Fedjaev ◽  
Nejla Ghaboosi ◽  
Christoph Richter ◽  
Lukas Everding ◽  
...  
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Motor Imagery ◽  
Classification Performance ◽  
Feature Engineering ◽  
Learning Models ◽  
Eeg Signals ◽  
Learning Methods

Non-invasive, electroencephalography (EEG)-based brain-computer interfaces (BCIs) on motor imagery movements translate the subject’s motor intention into control signals through classifying the EEG patterns caused by different imagination tasks, e.g., hand movements. This type of BCI has been widely studied and used as an alternative mode of communication and environmental control for disabled patients, such as those suffering from a brainstem stroke or a spinal cord injury (SCI). Notwithstanding the success of traditional machine learning methods in classifying EEG signals, these methods still rely on hand-crafted features. The extraction of such features is a difficult task due to the high non-stationarity of EEG signals, which is a major cause by the stagnating progress in classification performance. Remarkable advances in deep learning methods allow end-to-end learning without any feature engineering, which could benefit BCI motor imagery applications. We developed three deep learning models: (1) A long short-term memory (LSTM); (2) a spectrogram-based convolutional neural network model (CNN); and (3) a recurrent convolutional neural network (RCNN), for decoding motor imagery movements directly from raw EEG signals without (any manual) feature engineering. Results were evaluated on our own publicly available, EEG data collected from 20 subjects and on an existing dataset known as 2b EEG dataset from “BCI Competition IV”. Overall, better classification performance was achieved with deep learning models compared to state-of-the art machine learning techniques, which could chart a route ahead for developing new robust techniques for EEG signal decoding. We underpin this point by demonstrating the successful real-time control of a robotic arm using our CNN based BCI.

Optimizing Deep Learning Methods in Neural Network Architectures

2021 ◽  
Vol 14 (2) ◽  
pp. 93
Author(s):  
Kristina Gorshkova ◽  
Victoria Zueva ◽  
Maria Kuznetsova ◽  
Larisa Tugashova
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Network Architectures ◽  
Learning Methods ◽  
Neural Network Architectures
Sign in / Sign up

Export Citation Format

Share Document