Structured Pyramidal Neural Networks

2018 ◽  
Vol 28 (05) ◽  
pp. 1750021 ◽  
Author(s):  
Alessandra M. Soares ◽  
Bruno J. T. Fernandes ◽  
Carmelo J. A. Bastos-Filho
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Processing Time ◽  
Receptive Fields ◽  
Memory Capacity ◽  
The Other ◽  
Support Vector ◽  
Proposed Model ◽  
Novel Method ◽  
Original Approach

The Pyramidal Neural Networks (PNN) are an example of a successful recently proposed model inspired by the human visual system and deep learning theory. PNNs are applied to computer vision and based on the concept of receptive fields. This paper proposes a variation of PNN, named here as Structured Pyramidal Neural Network (SPNN). SPNN has self-adaptive variable receptive fields, while the original PNNs rely on the same size for the fields of all neurons, which limits the model since it is not possible to put more computing resources in a particular region of the image. Another limitation of the original approach is the need to define values for a reasonable number of parameters, which can turn difficult the application of PNNs in contexts in which the user does not have experience. On the other hand, SPNN has a fewer number of parameters. Its structure is determined using a novel method with Delaunay Triangulation and k-means clustering. SPNN achieved better results than PNNs and similar performance when compared to Convolutional Neural Network (CNN) and Support Vector Machine (SVM), but using lower memory capacity and processing time.

scholarly journals A Novel Method for Sea-Land Clutter Separation Using Regularized Randomized and Kernel Ridge Neural Networks

Sensors ◽  
2020 ◽  
Vol 20 (22) ◽  
pp. 6491
Author(s):  
Le Zhang ◽  
Jeyan Thiyagalingam ◽  
Anke Xue ◽  
Shuwen Xu
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Classification Accuracy ◽  
Signal Amplitude ◽  
Statistical Characteristics ◽  
Support Vector ◽  
Amplitude Change ◽  
Novel Method

Classification of clutter, especially in the context of shore based radars, plays a crucial role in several applications. However, the task of distinguishing and classifying the sea clutter from land clutter has been historically performed using clutter models and/or coastal maps. In this paper, we propose two machine learning, particularly neural network, based approaches for sea-land clutter separation, namely the regularized randomized neural network (RRNN) and the kernel ridge regression neural network (KRR). We use a number of features, such as energy variation, discrete signal amplitude change frequency, autocorrelation performance, and other statistical characteristics of the respective clutter distributions, to improve the performance of the classification. Our evaluation based on a unique mixed dataset, which is comprised of partially synthetic clutter data for land and real clutter data from sea, offers improved classification accuracy. More specifically, the RRNN and KRR methods offer 98.50% and 98.75% accuracy, outperforming the conventional support vector machine and extreme learning based solutions.

scholarly journals An Efficient and Fast Model Reduced Kernel KNN for Human Activity Recognition

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Zongying Liu ◽  
Shaoxi Li ◽  
Jiangling Hao ◽  
Jingfeng Hu ◽  
Mingyang Pan
Keyword(s):  
Neural Network ◽  
Activity Recognition ◽  
Human Activity ◽  
Processing Time ◽  
Kernel Method ◽  
Nearest Neighbors ◽  
Human Activity Recognition ◽  
Support Vector ◽  
K Nearest Neighbors ◽  
Proposed Model

With accumulation of data and development of artificial intelligence, human activity recognition attracts lots of attention from researchers. Many classic machine learning algorithms, such as artificial neural network, feed forward neural network, K-nearest neighbors, and support vector machine, achieve good performance for detecting human activity. However, these algorithms have their own limitations and their prediction accuracy still has space to improve. In this study, we focus on K-nearest neighbors (KNN) and solve its limitations. Firstly, kernel method is employed in model KNN, which transforms the input features to be the high-dimensional features. The proposed model KNN with kernel (K-KNN) improves the accuracy of classification. Secondly, a novel reduced kernel method is proposed and used in model K-KNN, which is named as Reduced Kernel KNN (RK-KNN). It reduces the processing time and enhances the classification performance. Moreover, this study proposes an approach of defining number of K neighbors, which reduces the parameter dependency problem. Based on the experimental works, the proposed RK-KNN obtains the best performance in benchmarks and human activity datasets compared with other models. It has super classification ability in human activity recognition. The accuracy of human activity data is 91.60% for HAPT and 92.67% for Smartphone, respectively. Averagely, compared with the conventional KNN, the proposed model RK-KNN increases the accuracy by 1.82% and decreases standard deviation by 0.27. The small gap of processing time between KNN and RK-KNN in all datasets is only 1.26 seconds.

scholarly journals Compressor performance modelling method based on support vector machine nonlinear regression algorithm

2020 ◽  
Vol 7 (1) ◽  
pp. 191596
Author(s):  
Yulong Ying ◽  
Siyu Xu ◽  
Jingchao Li ◽  
Bin Zhang
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Support Vector Machine ◽  
The Other ◽  
Support Vector ◽  
Performance Modelling ◽  
Network Algorithms ◽  
Modelling Method ◽  
Characteristic Map ◽  
Compressor Performance

To overcome the difficulty of having only part of compressor characteristic maps including on-design operating point, and accurately calculate compressor thermodynamic performance under variable working conditions, this paper proposes a novel compressor performance modelling method based on support vector machine nonlinear regression algorithm. It is compared with the other three neural network algorithms (i.e. back propagation (BP), radial basis function (RBF) and Elman neural networks) from the perspective of interpolation and extrapolation accuracy as well as calculation time, to prove the validity of the proposed method. Application analyses indicate that the proposed method has better interpolation and extrapolation performance than the other three neural networks. In terms of flow characteristic map representation, the root mean square error (RMSE) of the extrapolation performance at higher and lower speed operating area by the proposed method is 0.89% and 2.57%, respectively. And the total RMSE by the proposed method is 2.72%, which is more accurate by 47% than the Elman algorithm. For efficiency characteristic map representation, the RMSE of the extrapolation performance at higher and lower speed operating area by the proposed method is 2.85% and 1.22%, respectively. And the total RMSE by the proposed method is 1.81%, which is more accurate by 35% than the BP algorithm. Moreover, the proposed method has better real-time performance compared with the other three neural network algorithms.

scholarly journals The Budapest Amyloid Predictor and Its Applications

Biomolecules ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 500
Author(s):  
László Keresztes ◽  
Evelin Szögi ◽  
Bálint Varga ◽  
Viktor Farkas ◽  
András Perczel ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Support Vector ◽  
User Needs ◽  
Computational Technique ◽  
Linear Support Vector Machine ◽  
Β Sheets ◽  
Artificial Neural ◽  
Amorphous Aggregation

The amyloid state of proteins is widely studied with relevance to neurology, biochemistry, and biotechnology. In contrast with nearly amorphous aggregation, the amyloid state has a well-defined structure, consisting of parallel and antiparallel β-sheets in a periodically repeated formation. The understanding of the amyloid state is growing with the development of novel molecular imaging tools, like cryogenic electron microscopy. Sequence-based amyloid predictors were developed, mainly using artificial neural networks (ANNs) as the underlying computational technique. From a good neural-network-based predictor, it is a very difficult task to identify the attributes of the input amino acid sequence, which imply the decision of the network. Here, we present a linear Support Vector Machine (SVM)-based predictor for hexapeptides with correctness higher than 84%, i.e., it is at least as good as the best published ANN-based tools. Unlike artificial neural networks, the decisions of the linear SVMs are much easier to analyze and, from a good predictor, we can infer rich biochemical knowledge. In the Budapest Amyloid Predictor webserver the user needs to input a hexapeptide, and the server outputs a prediction for the input plus the 6 × 19 = 114 distance-1 neighbors of the input hexapeptide.

scholarly journals Analysis of the Nosema Cells Identification for Microscopic Images

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3068
Author(s):  
Soumaya Dghim ◽  
Carlos M. Travieso-González ◽  
Radim Burget
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Image Processing ◽  
Deep Learning ◽  
The Other ◽  
Support Vector ◽  
Learning Approaches ◽  
Microscopic Images ◽  
Trained Neural Network ◽  
Nosema Disease

The use of image processing tools, machine learning, and deep learning approaches has become very useful and robust in recent years. This paper introduces the detection of the Nosema disease, which is considered to be one of the most economically significant diseases today. This work shows a solution for recognizing and identifying Nosema cells between the other existing objects in the microscopic image. Two main strategies are examined. The first strategy uses image processing tools to extract the most valuable information and features from the dataset of microscopic images. Then, machine learning methods are applied, such as a neural network (ANN) and support vector machine (SVM) for detecting and classifying the Nosema disease cells. The second strategy explores deep learning and transfers learning. Several approaches were examined, including a convolutional neural network (CNN) classifier and several methods of transfer learning (AlexNet, VGG-16 and VGG-19), which were fine-tuned and applied to the object sub-images in order to identify the Nosema images from the other object images. The best accuracy was reached by the VGG-16 pre-trained neural network with 96.25%.

COMPARISON OF SUPPORT VECTOR MACHINES AND BAYESIAN NEURAL NETWORKS PERFORMANCE FOR BREAST TISSUES USING GEOSTATISTICAL FUNCTIONS IN MAMMOGRAPHIC IMAGES

2010 ◽  
Vol 09 (04) ◽  
pp. 271-288
Author(s):  
GERALDO BRAZ JUNIOR ◽  
LEONARDO DE OLIVEIRA MARTINS ◽  
ARISTÓFANES CORREA SILVA ◽  
ANSELMO CARDOSO PAIVA
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Region Of Interest ◽  
Female Breast Cancer ◽  
Support Vector ◽  
Risk Minimization ◽  
Bayesian Neural Network ◽  
Cad System ◽  
Mammographic Images ◽  
Breast Tissues

Female breast cancer is a major cause of deaths in occidental countries. Computer-aided Detection (CAD) systems can aid radiologists to increase diagnostic accuracy. In this work, we present a comparison between two classifiers applied to the separation of normal and abnormal breast tissues from mammograms. The purpose of the comparison is to select the best prediction technique to be part of a CAD system. Each region of interest is classified through a Support Vector Machine (SVM) and a Bayesian Neural Network (BNN) as normal or abnormal region. SVM is a machine-learning method, based on the principle of structural risk minimization, which shows good performance when applied to data outside the training set. A Bayesian Neural Network is a classifier that joins traditional neural networks theory and Bayesian inference. We use a set of measures obtained by the application of the semivariogram, semimadogram, covariogram, and correlogram functions to the characterization of breast tissue as normal or abnormal. The results show that SVM presents best performance for the classification of breast tissues in mammographic images. The tests indicate that SVM has more generalization power than the BNN classifier. BNN has a sensibility of 76.19% and a specificity of 79.31%, while SVM presents a sensibility of 74.07% and a specificity of 98.77%. The accuracy rate for tests is 78.70% and 92.59% for BNN and SVM, respectively.

N. Belknap's Four-Valued Logic, Belknap Computer and New Proximity Functions for Comparing Discrete Objects

2021 ◽  
Vol 1 (2 (6)) ◽  
Author(s):  
Valerii Dmitrienko ◽  
Sergey Leonov ◽  
Mykola Mezentsev
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
The Other ◽  
Proximity Function ◽  
Input Information ◽  
Proximity Measures ◽  
The One ◽  
True Values

The idea of ​​Belknap's four-valued logic is that modern computers should function normally not only with the true values ​​of the input information, but also under the conditions of inconsistency and incompleteness of true failures. Belknap's logic introduces four true values: T (true - true), F (false - false), N (none - nobody, nothing, none), B (both - the two, not only the one but also the other).  For ease of work with these true values, the following designations are introduced: (1, 0, n, b). Belknap's logic can be used to obtain estimates of proximity measures for discrete objects, for which the functions Jaccard and Needhem, Russel and Rao, Sokal and Michener, Hamming, etc. are used. In this case, it becomes possible to assess the proximity, recognition and classification of objects in conditions of uncertainty when the true values ​​are taken from the set (1, 0, n, b). Based on the architecture of the Hamming neural network, neural networks have been developed that allow calculating the distances between objects described using true values ​​(1, 0, n, b). Keywords: four-valued Belknap logic, Belknap computer, proximity assessment, recognition and classification, proximity function, neural network.

A Neural Networks Pruning and Data Fusion Based Intrusion Detection Model

2014 ◽  
Vol 651-653 ◽  
pp. 1772-1775
Author(s):  
Wei Gong
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Intrusion Detection ◽  
Data Fusion ◽  
Input Data ◽  
The Other ◽  
Pruning Algorithm ◽  
Detection Model ◽  
Process Ability

The abilities of summarization, learning and self-fitting and inner-parallel computing make artificial neural networks suitable for intrusion detection. On the other hand, data fusion based IDS has been used to solve the problem of distorting rate and failing-to-report rate and improve its performance. However, multi-sensor input-data makes the IDS lose its efficiency. The research of neural network based data fusion IDS tries to combine the strong process ability of neural network with the advantages of data fusion IDS. A neural network is designed to realize the data fusion and intrusion analysis and Pruning algorithm of neural networks is used for filtering information from multi-sensors. In the process of intrusion analysis pruning algorithm of neural networks is used for filtering information from multi-sensors so as to increase its performance and save the bandwidth of networks.

FPGA Coprocessor for Simulation of Neural Networks Using Compressed Matrix Storage

2011 ◽  
pp. 255-275
Author(s):  
Jörg Bornschein
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Sparse Matrix ◽  
Receptive Fields ◽  
The State ◽  
Connectivity Matrix ◽  
Vector Product ◽  
Sparse Connectivity ◽  
Matrix Vector ◽  
Direct Implementation

An FPGA-based coprocessor has been implemented which simulates the dynamics of a large recurrent neural network composed of binary neurons. The design has been used for unsupervised learning of receptive fields. Since the number of neurons to be simulated (>104) exceeds the available FPGA logic capacity for direct implementation, a set of streaming processors has been designed. Given the state- and activity vectors of the neurons at time t and a sparse connectivity matrix, these streaming processors calculate the state- and activity vectors for time t + 1. The operation implemented by the streaming processors can be understood as a generalized form of a sparse matrix vector product (SpMxV). The largest dataset, the sparse connectivity matrix, is stored and processed in a compressed format to better utilize the available memory bandwidth.

A Graph Grammar Approach to Generate Neural Network Topologies

2007 ◽  
Author(s):  
Chaitanya Vempati ◽  
Matthew I. Campbell
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Process Modeling ◽  
Graph Transformation ◽  
Graph Grammar ◽  
Transformation Rules ◽  
The Neural Network ◽  
Network Topologies ◽  
Novel Method ◽  
Defining Graph

Neural networks are increasingly becoming a useful and popular choice for process modeling. The success of neural networks in effectively modeling a certain problem depends on the topology of the neural network. Generating topologies manually relies on previous neural network experience and is tedious and difficult. Hence there is a rising need for a method that generates neural network topologies for different problems automatically. Current methods such as growing, pruning and using genetic algorithms for this task are very complicated and do not explore all the possible topologies. This paper presents a novel method of automatically generating neural networks using a graph grammar. The approach involves representing the neural network as a graph and defining graph transformation rules to generate the topologies. The approach is simple, efficient and has the ability to create topologies of varying complexity. Two example problems are presented to demonstrate the power of our approach.

Sign in / Sign up

Export Citation Format

Share Document