scholarly journals Digital Implementation of Oscillatory Neural Network for Image Recognition Applications

2021 ◽  
Vol 15 ◽  
Author(s):  
Madeleine Abernot ◽  
Thierry Gil ◽  
Manuel Jiménez ◽  
Juan Núñez ◽  
María J. Avellido ◽  
...  
Keyword(s):  
Neural Networks ◽  
Pattern Recognition ◽  
Fundamental Problem ◽  
System Level ◽  
Future Directions ◽  
Digital Implementation ◽  
Computing Paradigm ◽  
Oscillatory Neural Network ◽  
Neuromorphic System ◽  
Computing Approach

Computing paradigm based on von Neuman architectures cannot keep up with the ever-increasing data growth (also called “data deluge gap”). This has resulted in investigating novel computing paradigms and design approaches at all levels from materials to system-level implementations and applications. An alternative computing approach based on artificial neural networks uses oscillators to compute or Oscillatory Neural Networks (ONNs). ONNs can perform computations efficiently and can be used to build a more extensive neuromorphic system. Here, we address a fundamental problem: can we efficiently perform artificial intelligence applications with ONNs? We present a digital ONN implementation to show a proof-of-concept of the ONN approach of “computing-in-phase” for pattern recognition applications. To the best of our knowledge, this is the first attempt to implement an FPGA-based fully-digital ONN. We report ONN accuracy, training, inference, memory capacity, operating frequency, hardware resources based on simulations and implementations of 5 × 3 and 10 × 6 ONNs. We present the digital ONN implementation on FPGA for pattern recognition applications such as performing digits recognition from a camera stream. We discuss practical challenges and future directions in implementing digital ONN.

Levenshtein Augmentation Improves Performance of SMILES Based Deep-Learning Synthesis Prediction

2020 ◽  
Author(s):  
Dean Sumner ◽  
Jiazhen He ◽  
Amol Thakkar ◽  
Ola Engkvist ◽  
Esben Jannik Bjerrum
Keyword(s):  
Neural Networks ◽  
Pattern Recognition ◽  
Deep Learning ◽  
Recurrent Neural Networks ◽  
Data Augmentation ◽  
State Of The Art ◽  
Sequence Similarity ◽  
Learning Models ◽  
Underlying Network

<p>SMILES randomization, a form of data augmentation, has previously been shown to increase the performance of deep learning models compared to non-augmented baselines. Here, we propose a novel data augmentation method we call “Levenshtein augmentation” which considers local SMILES sub-sequence similarity between reactants and their respective products when creating training pairs. The performance of Levenshtein augmentation was tested using two state of the art models - transformer and sequence-to-sequence based recurrent neural networks with attention. Levenshtein augmentation demonstrated an increase performance over non-augmented, and conventionally SMILES randomization augmented data when used for training of baseline models. Furthermore, Levenshtein augmentation seemingly results in what we define as <i>attentional gain </i>– an enhancement in the pattern recognition capabilities of the underlying network to molecular motifs.</p>

Methods and tools of ensuring the operational reliability of complex industrial facilities.

2020 ◽  
Vol 14 (1) ◽  
pp. 34-42
Author(s):  
A. VAZHYNSKYI ◽  
◽  
S. ZHUKOV ◽  
Keyword(s):  
Neural Networks ◽  
Pattern Recognition ◽  
Artificial Neural Networks ◽  
Expert Systems ◽  
Residual Life ◽  
Full Potential ◽  
Scientific Publications ◽  
Specific Element ◽  
Industrial Facilities ◽  
Artificial Neural

Approaches and algorithms for processing experimental data and data obtained as a result of using modern means of measuring equipment, selecting diagnostic parameters, pattern recognition, which constitute the methodological basis for developing methods and designing tools for creating a service system for complex industrial facilities based on predicting their performance and residual life are described in submitted article. Along with classical methods, methods based on using the full potential of the modern elemental base of microprocessor technology and the use of artificial neural networks, machine learning, and "big data" are discovered. The given examples can serve as the basis for constructing a methodology for the application of the considered approaches for organizing predictive maintenance of complex industrial equipment. An analytical review of a number of scientific publications showed that the creation of new automated diagnostic systems that can increase fault tolerance and extend the life of sophisticated modern power equipment is extremely relevant. For this, various approaches are applied, based on mathematical models, expert systems, artificial neural networks and other algorithms. Summarizing the results of scientific publications, it can be argued that the implementation of a systematic approach to the organization of repair service at the enterprise requires a comprehensive solution to the following urgent problems: • monitoring is formulated as the task of interrogating sensors and collecting information necessary for further analysis; • diagnostics, it is solved as tasks of identifying informative signs with further detection and classification of failures and anomalies in data sets; • improving the accuracy of algorithms aimed at pattern recognition; • condition forecasting is the task of assessing the current and accumulated readings of monitoring systems for making decisions regarding either a specific element of the complex or the facilities. Thus, modern technology make it possible to arrange arbitrarily complex algorithms. However, to use the full potential that artificial neural networks, expert systems, and classical methods for identifying and diagnosing equipment it is necessary to have a conceptual development of the foundations of building systems for organizing maintenance and repair of complex energy equipment

TRANSITION TO CONVOLUTIONAL NEURAL NETWORKS IN RADAR PROBLEMS

2019 ◽  
pp. 96-99
Author(s):  
K. Maystrenko ◽  
A. Budilov ◽  
D. Afanasev
Keyword(s):  
Neural Networks ◽  
Pattern Recognition ◽  
Target Detection ◽  
Convolutional Neural Networks ◽  
Network Topology ◽  
Subject Areas ◽  
The Subject ◽  
Printed Materials ◽  
Hardware Costs

Goal. Identify trends and prospects for the development of radar in terms of the use of convolutional neural networks for target detection. Materials and methods. Analysis of relevant printed materials related to the subject areas of radar and convolutional neural networks. Results. The transition to convolutional neural networks in the field of radar is considered. A review of papers on the use of convolutional neural networks in pattern recognition problems, in particular, in the radar problem, is carried out. Hardware costs for the implementation of convolutional neural networks are analyzed. Conclusion. The conclusion is made about the need to create a methodology for selecting a network topology depending on the parameters of the radar task.

Design of a Robust Memristive Spiking Neuromorphic System with Unsupervised Learning in Hardware

2021 ◽  
Vol 17 (4) ◽  
pp. 1-26
Author(s):  
Md Musabbir Adnan ◽  
Sagarvarma Sayyaparaju ◽  
Samuel D. Brown ◽  
Mst Shamim Ara Shawkat ◽  
Catherine D. Schuman ◽  
...  
Keyword(s):  
Unsupervised Learning ◽  
Recognition Task ◽  
Single Layer ◽  
Process Variations ◽  
Spike Timing ◽  
System Level ◽  
Design Parameters ◽  
Digital Pulse ◽  
Neuromorphic System ◽  
The Impact

Spiking neural networks (SNN) offer a power efficient, biologically plausible learning paradigm by encoding information into spikes. The discovery of the memristor has accelerated the progress of spiking neuromorphic systems, as the intrinsic plasticity of the device makes it an ideal candidate to mimic a biological synapse. Despite providing a nanoscale form factor, non-volatility, and low-power operation, memristors suffer from device-level non-idealities, which impact system-level performance. To address these issues, this article presents a memristive crossbar-based neuromorphic system using unsupervised learning with twin-memristor synapses, fully digital pulse width modulated spike-timing-dependent plasticity, and homeostasis neurons. The implemented single-layer SNN was applied to a pattern-recognition task of classifying handwritten-digits. The performance of the system was analyzed by varying design parameters such as number of training epochs, neurons, and capacitors. Furthermore, the impact of memristor device non-idealities, such as device-switching mismatch, aging, failure, and process variations, were investigated and the resilience of the proposed system was demonstrated.

scholarly journals Scene Complexity: A New Perspective on Understanding the Scene Semantics of Remote Sensing and Designing Image-Adaptive Convolutional Neural Networks

2021 ◽  
Vol 13 (4) ◽  
pp. 742
Author(s):  
Jian Peng ◽  
Xiaoming Mei ◽  
Wenbo Li ◽  
Liang Hong ◽  
Bingyu Sun ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Neural Networks ◽  
Fundamental Problem ◽  
Semantic Representation ◽  
Feature Learning ◽  
Essential Elements ◽  
Complex Scene ◽  
Feature Representations ◽  
The Right ◽  
The Relationship

Scene understanding of remote sensing images is of great significance in various applications. Its fundamental problem is how to construct representative features. Various convolutional neural network architectures have been proposed for automatically learning features from images. However, is the current way of configuring the same architecture to learn all the data while ignoring the differences between images the right one? It seems to be contrary to our intuition: it is clear that some images are easier to recognize, and some are harder to recognize. This problem is the gap between the characteristics of the images and the learning features corresponding to specific network structures. Unfortunately, the literature so far lacks an analysis of the two. In this paper, we explore this problem from three aspects: we first build a visual-based evaluation pipeline of scene complexity to characterize the intrinsic differences between images; then, we analyze the relationship between semantic concepts and feature representations, i.e., the scalability and hierarchy of features which the essential elements in CNNs of different architectures, for remote sensing scenes of different complexity; thirdly, we introduce CAM, a visualization method that explains feature learning within neural networks, to analyze the relationship between scenes with different complexity and semantic feature representations. The experimental results show that a complex scene would need deeper and multi-scale features, whereas a simpler scene would need lower and single-scale features. Besides, the complex scene concept is more dependent on the joint semantic representation of multiple objects. Furthermore, we propose the framework of scene complexity prediction for an image and utilize it to design a depth and scale-adaptive model. It achieves higher performance but with fewer parameters than the original model, demonstrating the potential significance of scene complexity.

Sign in / Sign up

Export Citation Format

Share Document