scholarly journals A Configurable Simulator for Neural Network Processors

2021 ◽  
Author(s):  
Jian Hu Jian Hu ◽  
Xianlong Zhang ◽  
Xiaohua Shi
Keyword(s):  
Neural Network ◽  
Energy Efficiency ◽  
Deep Learning ◽  
Optimization Algorithm ◽  
End Users ◽  
System Level ◽  
Human Beings ◽  
Network Processors ◽  
Learning Networks

Abstract Deep learning has achieved competing results comparing with human beings in many fields. Traditionally, deep learning networks are executed on CPUs and GPUs. In recent years, more and more Neural Network accelerators have been introduced in both academia and industry to improve the performance and energy efficiency for deep learning networks. In this paper, we introduce a flexible and configurable functional NN accelerator simulator, which could be configured to simulate u-architectures for different NN accelerators. The extensible and configurable simulator is helpful for system-level exploration of u-architecture, as well as operator optimization algorithm developments. We also integrated the simulator into the TVM compilation stack as an optional back-end. Users can use TVM to write operators and execute them on the simulator. The simulator is going to be open sourced.

scholarly journals RISC-V Virtual Platform-Based Convolutional Neural Network Accelerator Implemented in SystemC

Electronics ◽  
2021 ◽  
Vol 10 (13) ◽  
pp. 1514
Author(s):  
Seung-Ho Lim ◽  
WoonSik William Suh ◽  
Jin-Young Kim ◽  
Sang-Young Cho
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Network Model ◽  
Neural Network Model ◽  
Deep Neural Network ◽  
System Level ◽  
Neural Network Models ◽  
Data Set ◽  
Embedded Device ◽  
Virtual Platform

The optimization for hardware processor and system for performing deep learning operations such as Convolutional Neural Networks (CNN) in resource limited embedded devices are recent active research area. In order to perform an optimized deep neural network model using the limited computational unit and memory of an embedded device, it is necessary to quickly apply various configurations of hardware modules to various deep neural network models and find the optimal combination. The Electronic System Level (ESL) Simulator based on SystemC is very useful for rapid hardware modeling and verification. In this paper, we designed and implemented a Deep Learning Accelerator (DLA) that performs Deep Neural Network (DNN) operation based on the RISC-V Virtual Platform implemented in SystemC in order to enable rapid and diverse analysis of deep learning operations in an embedded device based on the RISC-V processor, which is a recently emerging embedded processor. The developed RISC-V based DLA prototype can analyze the hardware requirements according to the CNN data set through the configuration of the CNN DLA architecture, and it is possible to run RISC-V compiled software on the platform, can perform a real neural network model like Darknet. We performed the Darknet CNN model on the developed DLA prototype, and confirmed that computational overhead and inference errors can be analyzed with the DLA prototype developed by analyzing the DLA architecture for various data sets.

scholarly journals Hyperparameters optimization for ResNet and Xception in the purpose of diagnosing COVID-19

2021 ◽  
pp. 1-17
Author(s):  
Hania H. Farag ◽  
Lamiaa A. A. Said ◽  
Mohamed R. M. Rizk ◽  
Magdy Abd ElAzim Ahmed
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Random Search ◽  
Learning Networks ◽  
Residual Network ◽  
Global Pandemic ◽  
Search Optimization

COVID-19 has been considered as a global pandemic. Recently, researchers are using deep learning networks for medical diseases’ diagnosis. Some of these researches focuses on optimizing deep learning neural networks for enhancing the network accuracy. Optimizing the Convolutional Neural Network includes testing various networks which are obtained through manually configuring their hyperparameters, then the configuration with the highest accuracy is implemented. Each time a different database is used, a different combination of the hyperparameters is required. This paper introduces two COVID-19 diagnosing systems using both Residual Network and Xception Network optimized by random search in the purpose of finding optimal models that give better diagnosis rates for COVID-19. The proposed systems showed that hyperparameters tuning for the ResNet and the Xception Net using random search optimization give more accurate results than other techniques with accuracies 99.27536% and 100 % respectively. We can conclude that hyperparameters tuning using random search optimization for either the tuned Residual Network or the tuned Xception Network gives better accuracies than other techniques diagnosing COVID-19.

scholarly journals MFDNN: Multi-channel feature deep neural network algorithm to identify Covid19 chest X-ray images

2021 ◽  
Author(s):  
Liangrui Pan ◽  
boya ji ◽  
Xiaoqi wang ◽  
shaoliang peng
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Deep Neural Network ◽  
Test Accuracy ◽  
Learning Networks ◽  
X Ray ◽  
Network Algorithm ◽  
Life Saving ◽  
Chest X Ray ◽  
Neural Network Algorithm

The use of chest X-ray images (CXI) to detect Severe Acute Respiratory Syndrome Coronavirus 2 (SARS CoV-2) caused by Coronavirus Disease 2019 (COVID-19) is life-saving important for both patients and doctors. This research proposed a multi-channel feature deep neural network algorithm to screen people infected with COVID-19. The algorithm integrates data oversampling technology and a multi-channel feature deep neural network model to carry out the training process in an end-to-end manner. In the experiment, we used a publicly available CXI database with 10,192 Normal, 6012 Lung Opacity (Non-COVID lung infection), and 1345 Viral Pneumonia images. Compared with traditional deep learning models (Densenet201, ResNet50, VGG19, GoogLeNet), the MFDNN model obtains an average test accuracy of 93.19% in all data. Furthermore, in each type of screening, the precision, recall, and F1 Score of the MFDNN model are also better than traditional deep learning networks. Secondly, compared with the latest CoroDet model, the MFDNN algorithm is 1.91% higher than the CoroDet model in the experiment of detecting the four categories of COVID19 infected persons. Finally, our experimental code will be placed at https://github.com/panliangrui/covid19.

A Similarity-Based Object Classification Using Deep Neural Networks

2019 ◽  
pp. 197-219
Author(s):  
Parvathi R. ◽  
Pattabiraman V.
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Deep Neural Network ◽  
Search Algorithm ◽  
Random Projection ◽  
Learning Networks ◽  
Learning Models ◽  
External Conditions ◽  
And Training

This chapter proposes a hybrid method for classification of the objects based on deep neural network and a similarity-based search algorithm. The objects are pre-processed with external conditions. After pre-processing and training different deep learning networks with the object dataset, the authors compare the results to find the best model to improve the accuracy of the results based on the features of object images extracted from the feature vector layer of a neural network. RPFOREST (random projection forest) model is used to predict the approximate nearest images. ResNet50, InceptionV3, InceptionV4, and DenseNet169 models are trained with this dataset. A proposal for adaptive finetuning of the deep learning models by determining the number of layers required for finetuning with the help of the RPForest model is given, and this experiment is conducted using the Xception model.

Deep Learning-based Framework for Smart Sustainable Cities

2019 ◽  
Vol 15 (4) ◽  
pp. 76-107
Author(s):  
Nagarathna Ravi ◽  
Vimala Rani P ◽  
Rajesh Alias Harinarayan R ◽  
Mercy Shalinie S ◽  
Karthick Seshadri ◽  
...  
Keyword(s):  
Neural Network ◽  
Air Pollution ◽  
Deep Learning ◽  
Air Pollutants ◽  
Human Life ◽  
Deep Belief Network ◽  
Motor Vehicles ◽  
Human Beings ◽  
Long Term Effects ◽  
Belief Network

Pure air is vital for sustaining human life. Air pollution causes long-term effects on people. There is an urgent need for protecting people from its profound effects. In general, people are unaware of the levels to which they are exposed to air pollutants. Vehicles, burning various kinds of waste, and industrial gases are the top three onset agents of air pollution. Of these three top agents, human beings are exposed frequently to the pollutants due to motor vehicles. To aid in protecting people from vehicular air pollutants, this article proposes a framework that utilizes deep learning models. The framework utilizes a deep belief network to predict the levels of air pollutants along the paths people travel and also a comparison with the predictions made by a feed forward neural network and an extreme learning machine. When evaluating the deep belief neural network for the case study undertaken, a deep belief network was able to achieve a higher index of agreement and lower RMSE values.

scholarly journals Superresolution Reconstruction of Video Based on Efficient Subpixel Convolutional Neural Network for Urban Computing

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Jie Shen ◽  
Mengxi Xu ◽  
Xinyu Du ◽  
Yunbo Xiong
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Optical Flow ◽  
Video Surveillance ◽  
Reconstruction Method ◽  
Motion Information ◽  
Learning Networks ◽  
Urban Computing ◽  
Deep Convolution Network

Video surveillance is an important data source of urban computing and intelligence. The low resolution of many existing video surveillance devices affects the efficiency of urban computing and intelligence. Therefore, improving the resolution of video surveillance is one of the important tasks of urban computing and intelligence. In this paper, the resolution of video is improved by superresolution reconstruction based on a learning method. Different from the superresolution reconstruction of static images, the superresolution reconstruction of video is characterized by the application of motion information. However, there are few studies in this area so far. Aimed at fully exploring motion information to improve the superresolution of video, this paper proposes a superresolution reconstruction method based on an efficient subpixel convolutional neural network, where the optical flow is introduced in the deep learning network. Fusing the optical flow features between successive frames can compensate for information in frames and generate high-quality superresolution results. In addition, in order to improve the superresolution, a superpixel convolution layer is added after the deep convolution network. Finally, experimental evaluations demonstrate the satisfying performance of our method compared with previous methods and other deep learning networks; our method is more efficient.

scholarly journals MRI-based brain tumor segmentation using FPGA-accelerated neural network

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Siyu Xiong ◽  
Guoqing Wu ◽  
Xitian Fan ◽  
Xuan Feng ◽  
Zhongcheng Huang ◽  
...  
Keyword(s):  
Neural Network ◽  
Energy Efficiency ◽  
Deep Learning ◽  
Brain Tumor ◽  
Brain Tumors ◽  
Tumor Segmentation ◽  
Brain Tumor Segmentation ◽  
Cad Systems ◽  
Segmentation Accuracy ◽  
The Brain

Abstract Background Brain tumor segmentation is a challenging problem in medical image processing and analysis. It is a very time-consuming and error-prone task. In order to reduce the burden on physicians and improve the segmentation accuracy, the computer-aided detection (CAD) systems need to be developed. Due to the powerful feature learning ability of the deep learning technology, many deep learning-based methods have been applied to the brain tumor segmentation CAD systems and achieved satisfactory accuracy. However, deep learning neural networks have high computational complexity, and the brain tumor segmentation process consumes significant time. Therefore, in order to achieve the high segmentation accuracy of brain tumors and obtain the segmentation results efficiently, it is very demanding to speed up the segmentation process of brain tumors. Results Compared with traditional computing platforms, the proposed FPGA accelerator has greatly improved the speed and the power consumption. Based on the BraTS19 and BraTS20 dataset, our FPGA-based brain tumor segmentation accelerator is 5.21 and 44.47 times faster than the TITAN V GPU and the Xeon CPU. In addition, by comparing energy efficiency, our design can achieve 11.22 and 82.33 times energy efficiency than GPU and CPU, respectively. Conclusion We quantize and retrain the neural network for brain tumor segmentation and merge batch normalization layers to reduce the parameter size and computational complexity. The FPGA-based brain tumor segmentation accelerator is designed to map the quantized neural network model. The accelerator can increase the segmentation speed and reduce the power consumption on the basis of ensuring high accuracy which provides a new direction for the automatic segmentation and remote diagnosis of brain tumors.

scholarly journals Pesticide detection combining the Wasserstein generative adversarial network and the residual neural network based on terahertz spectroscopy

RSC Advances ◽  
2022 ◽  
Vol 12 (3) ◽  
pp. 1769-1776
Author(s):  
Ruizhao Yang ◽  
Yun Li ◽  
Binyi Qin ◽  
Di Zhao ◽  
Yongjin Gan ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Terahertz Spectroscopy ◽  
Learning Networks ◽  
Pesticide Detection ◽  
Generative Adversarial Network ◽  
Adversarial Network

We proposed a WGAN-ResNet method, which combines two deep learning networks, the Wasserstein generative adversarial network (WGAN) and residual neural network (ResNet), to detect carbendazim based on terahertz spectroscopy.

scholarly journals Convolutional neural network for image classification based on transfer learning technique

2021 ◽  
Author(s):  
Ghassan Mohammed Halawani
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Transfer Learning ◽  
Learning Networks ◽  
The Neural Network ◽  
Learning Technique ◽  
Common Architecture

The main purpose of this project is to modify a convolutional neural network for image classification, based on a deep-learning framework. A transfer learning technique is used by the MATLAB interface to Alex-Net to train and modify the parameters in the last two fully connected layers of Alex-Net with a new dataset to perform classifications of thousands of images. First, the general common architecture of most neural networks and their benefits are presented. The mathematical models and the role of each part in the neural network are explained in detail. Second, different neural networks are studied in terms of architecture, application, and the working method to highlight the strengths and weaknesses of each of neural network. The final part conducts a detailed study on one of the most powerful deep-learning networks in image classification – i.e. the convolutional neural network – and how it can be modified to suit different classification tasks by using transfer learning technique in MATLAB.

scholarly journals Image Classification in HTP Test Based on Convolutional Neural Network Model

2021 ◽  
Vol 2021 ◽  
pp. 1-8
Author(s):  
Lin Liu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Image Classification ◽  
Reliability And Validity ◽  
Feature Learning ◽  
Human Vision ◽  
Assessment Process ◽  
Learning Networks ◽  
Good Reliability

HTP test in psychometrics is a widely studied and applied psychological assessment technique. HTP test is a kind of projection test, which refers to the free expression of painting itself and its creativity. Therefore, the form of group psychological counselling is widely used in mental health education. Compared with traditional neural networks, deep learning networks have deeper and more network layers and can learn more complex processing functions. In this stage, image recognition technology can be used as an assistant of human vision. People can quickly get the information in the picture through retrieval. For example, you can take a picture of an object that is difficult to describe and quickly search the content related to it. Convolutional neural network, which is widely used in the image classification task of computer vision, can automatically complete feature learning on the data without manual feature extraction. Compared with the traditional test, the test can reflect the painting characteristics of different groups. After quantitative scoring, it has good reliability and validity. It has high application value in psychological evaluation, especially in the diagnosis of mental diseases. This paper focuses on the subjectivity of HTP evaluation. Convolutional neural network is a mature technology in deep learning. The traditional HTP assessment process relies on the experience of researchers to extract painting features and classification.

Sign in / Sign up

Export Citation Format

Share Document