Choosing an Optimal Neural Network Size to Aid a Search through a Large Image Database

1998 ◽  
Author(s):  
K. Messer ◽  
J. Kittler
Keyword(s):  
Neural Network ◽  
Image Database ◽  
Network Size

Pattern Storage, Bifurcations, and Groupwise Correlation Structure of an Exactly Solvable Asymmetric Neural Network Model

2018 ◽  
Vol 30 (5) ◽  
pp. 1258-1295 ◽  
Author(s):  
Diego Fasoli ◽  
Anna Cattani ◽  
Stefano Panzeri
Keyword(s):  
Neural Network ◽  
Evolution Equations ◽  
Learning Rule ◽  
Network Size ◽  
Oscillatory Behavior ◽  
Spin Model ◽  
Membrane Potentials ◽  
Neural Network Models ◽  
Conditional Probability Distribution ◽  
Firing Rates

Despite their biological plausibility, neural network models with asymmetric weights are rarely solved analytically, and closed-form solutions are available only in some limiting cases or in some mean-field approximations. We found exact analytical solutions of an asymmetric spin model of neural networks with arbitrary size without resorting to any approximation, and we comprehensively studied its dynamical and statistical properties. The network had discrete time evolution equations and binary firing rates, and it could be driven by noise with any distribution. We found analytical expressions of the conditional and stationary joint probability distributions of the membrane potentials and the firing rates. By manipulating the conditional probability distribution of the firing rates, we extend to stochastic networks the associating learning rule previously introduced by Personnaz and coworkers. The new learning rule allowed the safe storage, under the presence of noise, of point and cyclic attractors, with useful implications for content-addressable memories. Furthermore, we studied the bifurcation structure of the network dynamics in the zero-noise limit. We analytically derived examples of the codimension 1 and codimension 2 bifurcation diagrams of the network, which describe how the neuronal dynamics changes with the external stimuli. This showed that the network may undergo transitions among multistable regimes, oscillatory behavior elicited by asymmetric synaptic connections, and various forms of spontaneous symmetry breaking. We also calculated analytically groupwise correlations of neural activity in the network in the stationary regime. This revealed neuronal regimes where, statistically, the membrane potentials and the firing rates are either synchronous or asynchronous. Our results are valid for networks with any number of neurons, although our equations can be realistically solved only for small networks. For completeness, we also derived the network equations in the thermodynamic limit of infinite network size and we analytically studied their local bifurcations. All the analytical results were extensively validated by numerical simulations.

Prediction of slip in cable-drum systems using structured neural networks

2013 ◽  
Vol 228 (3) ◽  
pp. 441-456 ◽  
Author(s):  
Ergin Kilic ◽  
Melik Dolen
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Size ◽  
Network Architectures ◽  
Network Development ◽  
Low Velocity ◽  
Error Band ◽  
Artificial Neural ◽  
Recurrent Type ◽  
Selection Of

This study focuses on the slip prediction in a cable-drum system using artificial neural networks for the prospect of developing linear motion sensing scheme for such mechanisms. Both feed-forward and recurrent-type artificial neural network architectures are considered to capture the slip dynamics of cable-drum mechanisms. In the article, the network development is presented in a progressive (step-by-step) fashion for the purpose of not only making the design process transparent to the readers but also highlighting the corresponding challenges associated with the design phase (i.e. selection of architecture, network size, training process parameters, etc.). Prediction performances of the devised networks are evaluated rigorously via an experimental study. Finally, a structured neural network, which embodies the network with the best prediction performance, is further developed to overcome the drift observed at low velocity. The study illustrates that the resulting structured neural network could predict the slip in the mechanism within an error band of 100 µm when an absolute reference is utilized.

scholarly journals The Performance of Deep Learning Algorithms on Automatic Pulmonary Nodule Detection and Classification Tested on Different Datasets That Are Not Derived from LIDC-IDRI: A Systematic Review

Diagnostics ◽  
2019 ◽  
Vol 9 (4) ◽  
pp. 207 ◽  
Author(s):  
Dana Li ◽  
Bolette Mikela Vilmun ◽  
Jonathan Frederik Carlsen ◽  
Elisabeth Albrecht-Beste ◽  
Carsten Ammitzbøl Lauridsen ◽  
...  
Keyword(s):  
Neural Network ◽  
Systematic Review ◽  
Deep Learning ◽  
Pulmonary Nodule ◽  
Image Database ◽  
Ct Scans ◽  
Learning Technology ◽  
Nodule Detection ◽  
Pulmonary Nodule Detection ◽  
And Training

The aim of this study was to systematically review the performance of deep learning technology in detecting and classifying pulmonary nodules on computed tomography (CT) scans that were not from the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) database. Furthermore, we explored the difference in performance when the deep learning technology was applied to test datasets different from the training datasets. Only peer-reviewed, original research articles utilizing deep learning technology were included in this study, and only results from testing on datasets other than the LIDC-IDRI were included. We searched a total of six databases: EMBASE, PubMed, Cochrane Library, the Institute of Electrical and Electronics Engineers, Inc. (IEEE), Scopus, and Web of Science. This resulted in 1782 studies after duplicates were removed, and a total of 26 studies were included in this systematic review. Three studies explored the performance of pulmonary nodule detection only, 16 studies explored the performance of pulmonary nodule classification only, and 7 studies had reports of both pulmonary nodule detection and classification. Three different deep learning architectures were mentioned amongst the included studies: convolutional neural network (CNN), massive training artificial neural network (MTANN), and deep stacked denoising autoencoder extreme learning machine (SDAE-ELM). The studies reached a classification accuracy between 68–99.6% and a detection accuracy between 80.6–94%. Performance of deep learning technology in studies using different test and training datasets was comparable to studies using same type of test and training datasets. In conclusion, deep learning was able to achieve high levels of accuracy, sensitivity, and/or specificity in detecting and/or classifying nodules when applied to pulmonary CT scans not from the LIDC-IDRI database.

An Efficient Neural Network Model for Path Planning of Car-like Robots in Dynamic Environment

2000 ◽  
Vol 4 (3) ◽  
pp. 220-229 ◽  
Author(s):  
Simon X. Yang ◽  
◽  
Max Meng ◽  
Keyword(s):  
Neural Network ◽  
Path Planning ◽  
Real Time ◽  
Dynamic Environment ◽  
Lyapunov Stability Theory ◽  
Network Size ◽  
Computationally Efficient ◽  
Neural Network Approach ◽  
The Neural Network ◽  
The Stability

In this paper, an effcient neural network approach to real-time path planning with obstacle avoidance of holonomic car-like robots in a dynamic environment is proposed. The dynamics of each neuron in this biologically inspired, topologically organized neural network is characterized by a shunting equation or an additive equation. The state space of the neural network is the configuration space of the robot. There are only local lateral connections among neurons. Thus the computational complexity linearly depends on the neural network size. The real-time collision-free path is planned through the dynamic neural activity landscape of the neural network without explicitly searching over neither the free workspace nor the collision paths, without any prior knowledge of the dynamic environment, without any learning procedures, and without any local collision checking procedures at each step of the robot movement. Therefore it is computationally efficient. The stability of the neural network is proven by both qualitative analysis and the Lyapunov stability theory. The effectiveness and efficiency are demonstrated through simulation studies.

scholarly journals The Evaluation of Deep Neural Networks and X-Ray as a Practical Alternative for Diagnosis and Management of COVID-19

2020 ◽  
Author(s):  
Mohamed Elgendi ◽  
Rich Fletcher ◽  
Newton Howard ◽  
Carlo Menon ◽  
Rabab Ward
Keyword(s):  
Neural Network ◽  
New Technology ◽  
Network Size ◽  
Front Line ◽  
High Resolution Computed Tomography ◽  
Training Time ◽  
X Ray ◽  
Diagnosis And Management ◽  
Diagnostic Technology ◽  
Time Accuracy

High-resolution computed tomography radiology is a critical tool in the diagnosis and management of COVID-19 infection; however, in smaller clinics around the world, there is a shortage of radiologists available to analyze these images. In this paper, we compare the performance of 16 available deep learning algorithms to help identify COVID19. We utilize an already existing diagnostic technology (X-ray) and an already existing neural network (ResNet-50) to diagnose COVID-19. Our approach eliminates the extra time and resources needed to develop new technology and associated algorithm, thus aiding the front-line in the race against the COVID-19 pandemic. Results show that ResNet-50 is the optimal pretrained neural network for the detection of COVID-19, using three different cross-validation ratios, based on training time, accuracy, and network size. We also present a custom visualization of the results that can be used to highlight important visual biomarkers of the disease and disease progression.

Sign in / Sign up

Export Citation Format

Share Document