scholarly journals Graph Neural Networks with Multiple Feature Extraction Paths for Chemical Property Estimation

Molecules ◽  
2021 ◽  
Vol 26 (11) ◽  
pp. 3125
Author(s):  
Sho Ishida ◽  
Tomo Miyazaki ◽  
Yoshihiro Sugaya ◽  
Shinichiro Omachi
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Feature Extraction ◽  
Chemical Property ◽  
Structural Information ◽  
Three Dimensional ◽  
Property Estimation ◽  
Multiple Feature ◽  
Multiple Structures ◽  
Graph Neural Networks

Feature extraction is essential for chemical property estimation of molecules using machine learning. Recently, graph neural networks have attracted attention for feature extraction from molecules. However, existing methods focus only on specific structural information, such as node relationship. In this paper, we propose a novel graph convolutional neural network that performs feature extraction with simultaneously considering multiple structures. Specifically, we propose feature extraction paths specialized in node, edge, and three-dimensional structures. Moreover, we propose an attention mechanism to aggregate the features extracted by the paths. The attention aggregation enables us to select useful features dynamically. The experimental results showed that the proposed method outperformed previous methods.

scholarly journals SketchGNN: Semantic Sketch Segmentation with Graph Neural Networks

2021 ◽  
Vol 40 (3) ◽  
pp. 1-13
Author(s):  
Lumin Yang ◽  
Jiajie Zhuang ◽  
Hongbo Fu ◽  
Xiangzhi Wei ◽  
Kun Zhou ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Large Scale ◽  
State Of The Art ◽  
Semantic Segmentation ◽  
Structure Information ◽  
Graph Neural Networks ◽  
Node Labels ◽  
Point Level

We introduce SketchGNN , a convolutional graph neural network for semantic segmentation and labeling of freehand vector sketches. We treat an input stroke-based sketch as a graph with nodes representing the sampled points along input strokes and edges encoding the stroke structure information. To predict the per-node labels, our SketchGNN uses graph convolution and a static-dynamic branching network architecture to extract the features at three levels, i.e., point-level, stroke-level, and sketch-level. SketchGNN significantly improves the accuracy of the state-of-the-art methods for semantic sketch segmentation (by 11.2% in the pixel-based metric and 18.2% in the component-based metric over a large-scale challenging SPG dataset) and has magnitudes fewer parameters than both image-based and sequence-based methods.

scholarly journals Pattern Recognition by Hierarchical Feature Extraction

2003 ◽  
Vol 15 (3) ◽  
pp. 278-285
Author(s):  
Daigo Misaki ◽  
◽  
Shigeru Aomura ◽  
Noriyuki Aoyama
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Pattern Recognition ◽  
Feature Extraction ◽  
Input Data ◽  
Local Features ◽  
Detailed Classification

We discuss effective pattern recognition for contour images by hierarchical feature extraction. When pattern recognition is done for an unlimited object, it is effective to see the object in a perspective manner at the beginning and next to see in detail. General features are used for rough classification and local features are used for a more detailed classification. D-P matching is applied for classification of a typical contour image of individual class, which contains selected points called ""landmark""s, and rough classification is done. Features between these landmarks are analyzed and used as input data of neural networks for more detailed classification. We apply this to an illustrated referenced book of insects in which much information is classified hierarchically to verify the proposed method. By introducing landmarks, a neural network can be used effectively for pattern recognition of contour images.

scholarly journals Classification and direction discrimination of faults in transmission lines using 1D convolutional neural networks

2021 ◽  
Vol 12 (3) ◽  
pp. 1928
Author(s):  
Ahmed Thamer Radhi ◽  
Wael Hussein Zayer ◽  
Adel Manaa Dakhil
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Feature Extraction ◽  
Transmission Line ◽  
Convolutional Neural Networks ◽  
Transmission Lines ◽  
Fault Classification ◽  
Line System ◽  
Direction Discrimination ◽  
Conventional Methods

<span lang="EN-US">This paper presents a fast and accurate fault detection, classification and direction discrimination algorithm of transmission lines using one-dimensional convolutional neural networks (1D-CNNs) that have ingrained adaptive model to avoid the feature extraction difficulties and fault classification into one learning algorithm. A proposed algorithm is directly usable with raw data and this deletes the need of a discrete feature extraction method resulting in more effective protective system. The proposed approach based on the three-phase voltages and currents signals of one end at the relay location in the transmission line system are taken as input to the proposed 1D-CNN algorithm. A 132kV power transmission line is simulated by Matlab simulink to prepare the training and testing data for the proposed 1D- CNN algorithm. The testing accuracy of the proposed algorithm is compared with other two conventional methods which are neural network and fuzzy neural network. The results of test explain that the new proposed detection system is efficient and fast for classifying and direction discrimination of fault in transmission line with high accuracy as compared with other conventional methods under various conditions of faults.</span>

scholarly journals The Role and Utilization of CNN in Automatic Logo Based Document Image Retrieval Methods

2018 ◽  
Vol 7 (3.1) ◽  
pp. 13
Author(s):  
Raveendra K ◽  
R Vinoth Kanna
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Feature Extraction ◽  
Image Retrieval ◽  
Convolutional Neural Network ◽  
Convolutional Neural Networks ◽  
Document Image ◽  
Retrieval Process ◽  
Pictorial Representations

Automatic logo based document image retrieval process is an essential and mostly used method in the feature extraction applications. In this paper the architecture of Convolutional Neural Network (CNN) was elaborately explained with pictorial representations in order to understand the complex Convolutional Neural Networks process in a simplified way. The main objective of this paper is to effectively utilize the CNN in the process of automatic logo based document image retrieval methods.  

scholarly journals Towards Heterogeneous Multi-Agent Reinforcement Learning with Graph Neural Networks

2020 ◽  
Author(s):  
Douglas Meneghetti ◽  
Reinaldo Bianchi
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Communication Channels ◽  
Neural Network Architecture ◽  
Graph Representations ◽  
Labeled Graph ◽  
Multiple Agent ◽  
Multi Agent ◽  
Graph Neural Networks

This work proposes a neural network architecture that learns policies for multiple agent classes in a heterogeneous multi-agent reinforcement setting. The proposed network uses directed labeled graph representations for states, encodes feature vectors of different sizes for different entity classes, uses relational graph convolution layers to model different communication channels between entity types and learns distinct policies for different agent classes, sharing parameters wherever possible. Results have shown that specializing the communication channels between entity classes is a promising step to achieve higher performance in environments composed of heterogeneous entities.

scholarly journals Fast and Deep Graph Neural Networks

2020 ◽  
Vol 34 (04) ◽  
pp. 3898-3905 ◽  
Author(s):  
Claudio Gallicchio ◽  
Alessio Micheli
Keyword(s):  
Neural Network ◽  
Dynamical System ◽  
Neural Networks ◽  
State Of The Art ◽  
Input Graph ◽  
Sparse Networks ◽  
Set Up ◽  
The Stability ◽  
Graph Neural Networks ◽  
Architectural Organization

We address the efficiency issue for the construction of a deep graph neural network (GNN). The approach exploits the idea of representing each input graph as a fixed point of a dynamical system (implemented through a recurrent neural network), and leverages a deep architectural organization of the recurrent units. Efficiency is gained by many aspects, including the use of small and very sparse networks, where the weights of the recurrent units are left untrained under the stability condition introduced in this work. This can be viewed as a way to study the intrinsic power of the architecture of a deep GNN, and also to provide insights for the set-up of more complex fully-trained models. Through experimental results, we show that even without training of the recurrent connections, the architecture of small deep GNN is surprisingly able to achieve or improve the state-of-the-art performance on a significant set of tasks in the field of graphs classification.

Neural Networks for the Classification of Benign and Malignant Patters in Digital Mammograms

2006 ◽  
pp. 251-272 ◽  
Author(s):  
Brijesh Verma ◽  
Rinku Panchal
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Feature Extraction ◽  
Digital Mammography ◽  
Extensive Review ◽  
Benchmark Database ◽  
Feature Extraction And Selection ◽  
Recent Developments ◽  
Artificial Neural Network Ann

This chapter presents neural network-based techniques for the classification of micro-calcification patterns in digital mammograms. Artificial neural network (ANN) applications in digital mammography are mainly focused on feature extraction, feature selection, and classification of micro-calcification patterns into ‘benign’ and ‘malignant’. An extensive review of neural network based techniques in digital mammography is presented. Recent developments such as auto-associators and evolutionary neural networks for feature extraction and selection are presented. Experimental results using ANN techniques on a benchmark database are described and analysed. Finally, a comparison of various neural network-based techniques is presented.

Identifying User Suitability in sEMG Based Hand Prosthesis Using Neural Networks

2019 ◽  
Vol 14 (2) ◽  
pp. 158-164 ◽  
Author(s):  
G. Emayavaramban ◽  
A. Amudha ◽  
T. Rajendran ◽  
M. Sivaramkumar ◽  
K. Balachandar ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Pattern Recognition ◽  
Feature Extraction ◽  
Classification Accuracy ◽  
Network Models ◽  
Prosthetic Hand ◽  
Neural Network Models ◽  
The Neural Network ◽  
Semg Signals

Background: Identifying user suitability plays a vital role in various modalities like neuromuscular system research, rehabilitation engineering and movement biomechanics. This paper analysis the user suitability based on neural networks (NN), subjects, age groups and gender for surface electromyogram (sEMG) pattern recognition system to control the myoelectric hand. Six parametric feature extraction algorithms are used to extract the features from sEMG signals such as AR (Autoregressive) Burg, AR Yule Walker, AR Covariance, AR Modified Covariance, Levinson Durbin Recursion and Linear Prediction Coefficient. The sEMG signals are modeled using Cascade Forward Back propagation Neural Network (CFBNN) and Pattern Recognition Neural Network. Methods: sEMG signals generated from forearm muscles of the participants are collected through an sEMG acquisition system. Based on the sEMG signals, the type of movement attempted by the user is identified in the sEMG recognition module using signal processing, feature extraction and machine learning techniques. The information about the identified movement is passed to microcontroller wherein a control is developed to command the prosthetic hand to emulate the identified movement. Results: From the six feature extraction algorithms and two neural network models used in the study, the maximum classification accuracy of 95.13% was obtained using AR Burg with Pattern Recognition Neural Network. This justifies that the Pattern Recognition Neural Network is best suited for this study as the neural network model is specially designed for pattern matching problem. Moreover, it has simple architecture and low computational complexity. AR Burg is found to be the best feature extraction technique in this study due to its high resolution for short data records and its ability to always produce a stable model. In all the neural network models, the maximum classification accuracy is obtained for subject 10 as a result of his better muscle fitness and his maximum involvement in training sessions. Subjects in the age group of 26-30 years are best suited for the study due to their better muscle contractions. Better muscle fatigue resistance has contributed for better performance of female subjects as compared to male subjects. From the single trial analysis, it can be observed that the hand close movement has achieved best recognition rate for all neural network models. Conclusion: In this paper a study was conducted to identify user suitability for designing hand prosthesis. Data were collected from ten subjects for twelve tasks related to finger movements. The suitability of the user was identified using two neural networks with six parametric features. From the result, it was concluded thatfit women doing regular physical exercises aged between 26-30 years are best suitable for developing HMI for designing a prosthetic hand. Pattern Recognition Neural Network with AR Burg extraction features using extension movements will be a better way to design the HMI. However, Signal acquisition based on wireless method is worth considering for the future.

The Character Recognition of Vehicle's License Plate Based on BP Neural Networks

2014 ◽  
Vol 513-517 ◽  
pp. 3805-3808 ◽  
Author(s):  
Wen Bo Liu ◽  
Tao Wang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Feature Extraction ◽  
Bp Neural Network ◽  
Character Recognition ◽  
License Plate ◽  
Image Preprocessing ◽  
Matrix Operations ◽  
Neural Network Algorithm ◽  
Character Segment

This paper based on license plate image preprocessing ,license plate localization, and character segment ,using BP neural network algorithm to identify the license plate characters. Through k-l algorithm of characters on the feature extraction and recognition of license plate character respectively then taking the extraction of license plate character features into the character classifier to the training. When the end of training, extracting the net-work weights and offset matrix, and storing in the computer. To take the identified character images input to the MATLAB, and with the preservation weights and offset matrix operations, obtain the final results of recognition.

Active Noise Control Using Multi-Layered Perceptron Neural Networks

1997 ◽  
Vol 16 (2) ◽  
pp. 109-144 ◽  
Author(s):  
M.O. Tokhi ◽  
R. Wood
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Noise Control ◽  
Learning Algorithm ◽  
Free Field ◽  
Active Noise Control ◽  
Three Dimensional ◽  
Broadband Noise ◽  
Active Noise

This paper presents the development of a neuro-adaptive active noise control (ANC) system. Multi-layered perceptron neural networks with a backpropagation learning algorithm are considered in both the modelling and control contexts. The capabilities of the neural network in modelling dynamical systems are investigated. A feedforward ANC structure is considered for optimum cancellation of broadband noise in a three-dimensional propagation medium. An on-line adaptation and training mechanism allowing a neural network architecture to characterise the optimal controller within the ANC system is developed. The neuro-adaptive ANC algorithm thus developed is implemented within a free-field environment and simulation results verifying its performance are presented and discussed.

Sign in / Sign up

Export Citation Format

Share Document