Low-Cost and Fast Design of Precise Activation Functions in Neural Network

2019 ◽  
Author(s):  
Tsung-Chu Huang ◽  
Chun-Hao Chiang ◽  
Mo-Han Lin
Keyword(s):  
Neural Network ◽  
Low Cost ◽  
Activation Functions

scholarly journals Binary and Multiclass Text Classification by Means of Separable Convolutional Neural Network

Inventions ◽  
2021 ◽  
Vol 6 (4) ◽  
pp. 70
Author(s):  
Elena Solovyeva ◽  
Ali Abdullah
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Recurrent Neural Networks ◽  
Low Cost ◽  
Computational Cost ◽  
High Accuracy ◽  
Activation Functions ◽  
Fully Connected ◽  
Fully Connected Networks

In this paper, the structure of a separable convolutional neural network that consists of an embedding layer, separable convolutional layers, convolutional layer and global average pooling is represented for binary and multiclass text classifications. The advantage of the proposed structure is the absence of multiple fully connected layers, which is used to increase the classification accuracy but raises the computational cost. The combination of low-cost separable convolutional layers and a convolutional layer is proposed to gain high accuracy and, simultaneously, to reduce the complexity of neural classifiers. Advantages are demonstrated at binary and multiclass classifications of written texts by means of the proposed networks under the sigmoid and Softmax activation functions in convolutional layer. At binary and multiclass classifications, the accuracy obtained by separable convolutional neural networks is higher in comparison with some investigated types of recurrent neural networks and fully connected networks.

Low-Cost Hardware Implementation of Human Blood Identification Device Using Feed-Forward Artificial Neural Network on FPGA

2018 ◽  
Author(s):  
Rizki Eka Putri ◽  
Denny Darlis
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Low Cost ◽  
Image Resolution ◽  
Blood Type ◽  
Feed Forward ◽  
Testing Facility ◽  
System Input ◽  
Artificial Neural ◽  
Short Time

This article was under review for ICELTICS 2018 -- In the medical world there is still service dissatisfaction caused by lack of blood type testing facility. If the number of tested blood arise, a lot of problems will occur so that electronic devices are needed to determine the blood type accurately and in short time. In this research we implemented an Artificial Neural Network on Xilinx Spartan 3S1000 Field Programable Gate Array using XSA-3S Board to identify the blood type. This research uses blood sample image as system input. VHSIC Hardware Discription Language is the language to describe the algorithm. The algorithm used is feed-forward propagation of backpropagation neural network. There are 3 layers used in design, they are input, hidden1, and output. At hidden1layer has two neurons. In this study the accuracy of detection obtained are 92%, 92%, 92%, 90% and 86% for 32x32, 48x48, 64x64, 80x80, and 96x96 pixel blood image resolution, respectively.

scholarly journals Recurrent Neural Network for Human Activity Recognition in Embedded Systems Using PPG and Accelerometer Data

Electronics ◽  
2021 ◽  
Vol 10 (14) ◽  
pp. 1715
Author(s):  
Michele Alessandrini ◽  
Giorgio Biagetti ◽  
Paolo Crippa ◽  
Laura Falaschetti ◽  
Claudio Turchetti
Keyword(s):  
Neural Network ◽  
Embedded System ◽  
Activity Recognition ◽  
Human Activity ◽  
Recurrent Neural Network ◽  
Low Cost ◽  
Low Complexity ◽  
Human Activity Recognition ◽  
Motion Artifacts ◽  
Accelerometer Data

Photoplethysmography (PPG) is a common and practical technique to detect human activity and other physiological parameters and is commonly implemented in wearable devices. However, the PPG signal is often severely corrupted by motion artifacts. The aim of this paper is to address the human activity recognition (HAR) task directly on the device, implementing a recurrent neural network (RNN) in a low cost, low power microcontroller, ensuring the required performance in terms of accuracy and low complexity. To reach this goal, (i) we first develop an RNN, which integrates PPG and tri-axial accelerometer data, where these data can be used to compensate motion artifacts in PPG in order to accurately detect human activity; (ii) then, we port the RNN to an embedded device, Cloud-JAM L4, based on an STM32 microcontroller, optimizing it to maintain an accuracy of over 95% while requiring modest computational power and memory resources. The experimental results show that such a system can be effectively implemented on a constrained-resource system, allowing the design of a fully autonomous wearable embedded system for human activity recognition and logging.

scholarly journals End-to-end convolutional neural network enables COVID-19 detection from breath and cough audio: a pilot study

2021 ◽  
Vol 7 (2) ◽  
pp. 356-362
Author(s):  
Harry Coppock ◽  
Alex Gaskell ◽  
Panagiotis Tzirakis ◽  
Alice Baird ◽  
Lyn Jones ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Low Cost ◽  
Area Under The Curve ◽  
Alternative Form ◽  
Economic Damage ◽  
Audio Signals ◽  
Operating Characteristics ◽  
Data Set ◽  
Empirical Performance

BackgroundSince the emergence of COVID-19 in December 2019, multidisciplinary research teams have wrestled with how best to control the pandemic in light of its considerable physical, psychological and economic damage. Mass testing has been advocated as a potential remedy; however, mass testing using physical tests is a costly and hard-to-scale solution.MethodsThis study demonstrates the feasibility of an alternative form of COVID-19 detection, harnessing digital technology through the use of audio biomarkers and deep learning. Specifically, we show that a deep neural network based model can be trained to detect symptomatic and asymptomatic COVID-19 cases using breath and cough audio recordings.ResultsOur model, a custom convolutional neural network, demonstrates strong empirical performance on a data set consisting of 355 crowdsourced participants, achieving an area under the curve of the receiver operating characteristics of 0.846 on the task of COVID-19 classification.ConclusionThis study offers a proof of concept for diagnosing COVID-19 using cough and breath audio signals and motivates a comprehensive follow-up research study on a wider data sample, given the evident advantages of a low-cost, highly scalable digital COVID-19 diagnostic tool.

scholarly journals Architecture-Accuracy Co-optimization of ReRAM-based Low-cost Neural Network Processor

2020 ◽  
Author(s):  
Segi Lee ◽  
Sugil Lee ◽  
Jongeun Lee ◽  
Jong-Moon Choi ◽  
Do-Wan Kwon ◽  
...  
Keyword(s):  
Neural Network ◽  
Low Cost ◽  
Network Processor
Sign in / Sign up

Export Citation Format

Share Document