FPGA Coprocessor for Simulation of Neural Networks Using Compressed Matrix Storage

2011 ◽  
pp. 255-275
Author(s):  
Jörg Bornschein
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Sparse Matrix ◽  
Receptive Fields ◽  
The State ◽  
Connectivity Matrix ◽  
Vector Product ◽  
Sparse Connectivity ◽  
Matrix Vector ◽  
Direct Implementation

An FPGA-based coprocessor has been implemented which simulates the dynamics of a large recurrent neural network composed of binary neurons. The design has been used for unsupervised learning of receptive fields. Since the number of neurons to be simulated (>104) exceeds the available FPGA logic capacity for direct implementation, a set of streaming processors has been designed. Given the state- and activity vectors of the neurons at time t and a sparse connectivity matrix, these streaming processors calculate the state- and activity vectors for time t + 1. The operation implemented by the streaming processors can be understood as a generalized form of a sparse matrix vector product (SpMxV). The largest dataset, the sparse connectivity matrix, is stored and processed in a compressed format to better utilize the available memory bandwidth.

scholarly journals Performance modeling of the sparse matrix–vector product via convolutional neural networks

2020 ◽  
Vol 76 (11) ◽  
pp. 8883-8900
Author(s):  
Maria Barreda ◽  
Manuel F. Dolz ◽  
M. Asunción Castaño ◽  
Pedro Alonso-Jordá ◽  
Enrique S. Quintana-Ortí
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Performance Modeling ◽  
Sparse Matrix ◽  
Vector Product ◽  
Matrix Vector

Location- and Person-Independent Activity Recognition with WiFi, Deep Neural Networks, and Reinforcement Learning

2021 ◽  
Vol 2 (1) ◽  
pp. 1-25
Author(s):  
Yongsen Ma ◽  
Sheheryar Arshad ◽  
Swetha Muniraju ◽  
Eric Torkildson ◽  
Enrico Rantala ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Reinforcement Learning ◽  
Activity Recognition ◽  
Deep Neural Networks ◽  
State Machine ◽  
Recognition Algorithm ◽  
The State ◽  
Neural Architecture ◽  
Learning Agent

In recent years, Channel State Information (CSI) measured by WiFi is widely used for human activity recognition. In this article, we propose a deep learning design for location- and person-independent activity recognition with WiFi. The proposed design consists of three Deep Neural Networks (DNNs): a 2D Convolutional Neural Network (CNN) as the recognition algorithm, a 1D CNN as the state machine, and a reinforcement learning agent for neural architecture search. The recognition algorithm learns location- and person-independent features from different perspectives of CSI data. The state machine learns temporal dependency information from history classification results. The reinforcement learning agent optimizes the neural architecture of the recognition algorithm using a Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM). The proposed design is evaluated in a lab environment with different WiFi device locations, antenna orientations, sitting/standing/walking locations/orientations, and multiple persons. The proposed design has 97% average accuracy when testing devices and persons are not seen during training. The proposed design is also evaluated by two public datasets with accuracy of 80% and 83%. The proposed design needs very little human efforts for ground truth labeling, feature engineering, signal processing, and tuning of learning parameters and hyperparameters.

scholarly journals A MEMORY EFFICIENT AND FAST SPARSE MATRIX VECTOR PRODUCT ON A GPU

2011 ◽  
Vol 116 ◽  
pp. 49-63 ◽  
Author(s):  
Adam Dziekonski ◽  
Adam Lamecki ◽  
Michal Mrozowski
Keyword(s):  
Sparse Matrix ◽  
Vector Product ◽  
Matrix Vector ◽  
Memory Efficient

Structured Pyramidal Neural Networks

2018 ◽  
Vol 28 (05) ◽  
pp. 1750021 ◽  
Author(s):  
Alessandra M. Soares ◽  
Bruno J. T. Fernandes ◽  
Carmelo J. A. Bastos-Filho
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Processing Time ◽  
Receptive Fields ◽  
Memory Capacity ◽  
The Other ◽  
Support Vector ◽  
Proposed Model ◽  
Novel Method ◽  
Original Approach

The Pyramidal Neural Networks (PNN) are an example of a successful recently proposed model inspired by the human visual system and deep learning theory. PNNs are applied to computer vision and based on the concept of receptive fields. This paper proposes a variation of PNN, named here as Structured Pyramidal Neural Network (SPNN). SPNN has self-adaptive variable receptive fields, while the original PNNs rely on the same size for the fields of all neurons, which limits the model since it is not possible to put more computing resources in a particular region of the image. Another limitation of the original approach is the need to define values for a reasonable number of parameters, which can turn difficult the application of PNNs in contexts in which the user does not have experience. On the other hand, SPNN has a fewer number of parameters. Its structure is determined using a novel method with Delaunay Triangulation and k-means clustering. SPNN achieved better results than PNNs and similar performance when compared to Convolutional Neural Network (CNN) and Support Vector Machine (SVM), but using lower memory capacity and processing time.

Sign in / Sign up

Export Citation Format

Share Document