scholarly journals A New Image Classification Approach via Improved MobileNet Models with Local Receptive Field Expansion in Shallow Layers

2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Wei Wang ◽  
Yiyang Hu ◽  
Ting Zou ◽  
Hongmei Liu ◽  
Jin Wang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Computational Complexity ◽  
Embedded Systems ◽  
Receptive Field ◽  
Image Classification ◽  
Classification Accuracy ◽  
Deep Neural Networks ◽  
Classification Approach ◽  
Dilated Convolution ◽  
Convolution Filters

Because deep neural networks (DNNs) are both memory-intensive and computation-intensive, they are difficult to apply to embedded systems with limited hardware resources. Therefore, DNN models need to be compressed and accelerated. By applying depthwise separable convolutions, MobileNet can decrease the number of parameters and computational complexity with less loss of classification precision. Based on MobileNet, 3 improved MobileNet models with local receptive field expansion in shallow layers, also called Dilated-MobileNet (Dilated Convolution MobileNet) models, are proposed, in which dilated convolutions are introduced into a specific convolutional layer of the MobileNet model. Without increasing the number of parameters, dilated convolutions are used to increase the receptive field of the convolution filters to obtain better classification accuracy. The experiments were performed on the Caltech-101, Caltech-256, and Tubingen animals with attribute datasets, respectively. The results show that Dilated-MobileNets can obtain up to 2% higher classification accuracy than MobileNet.

scholarly journals Privacy-Preserving Deep Neural Network Methods: Computational and Perceptual Methods—An Overview

Electronics ◽  
2021 ◽  
Vol 10 (11) ◽  
pp. 1367
Author(s):  
Raghida El El Saj ◽  
Ehsan Sedgh Sedgh Gooya ◽  
Ayman Alfalou ◽  
Mohamad Khalil
Keyword(s):  
Neural Networks ◽  
Classification Accuracy ◽  
Deep Neural Networks ◽  
Privacy Preserving ◽  
Sensitive Data ◽  
Encrypted Data ◽  
High Classification Accuracy ◽  
Hide Information ◽  
Network Methods ◽  
Cloud Environments

Privacy-preserving deep neural networks have become essential and have attracted the attention of many researchers due to the need to maintain the privacy and the confidentiality of personal and sensitive data. The importance of privacy-preserving networks has increased with the widespread use of neural networks as a service in unsecured cloud environments. Different methods have been proposed and developed to solve the privacy-preserving problem using deep neural networks on encrypted data. In this article, we reviewed some of the most relevant and well-known computational and perceptual image encryption methods. These methods as well as their results have been presented, compared, and the conditions of their use, the durability and robustness of some of them against attacks, have been discussed. Some of the mentioned methods have demonstrated an ability to hide information and make it difficult for adversaries to retrieve it while maintaining high classification accuracy. Based on the obtained results, it was suggested to develop and use some of the cited privacy-preserving methods in applications other than classification.

scholarly journals Natural Images Allow Universal Adversarial Attacks on Medical Image Classification Using Deep Neural Networks with Transfer Learning

2021 ◽  
Author(s):  
Akinori Minagi ◽  
Hokuto Hirano ◽  
Kazuhiro Takemoto
Keyword(s):  
Neural Networks ◽  
Image Classification ◽  
Transfer Learning ◽  
Medical Image ◽  
Deep Neural Networks ◽  
Disease Diagnosis ◽  
Natural Images ◽  
Fine Tuning ◽  
Security And Privacy ◽  
Medical Image Classification

Abstract Transfer learning from natural images is well used in deep neural networks (DNNs) for medical image classification to achieve computer-aided clinical diagnosis. Although the adversarial vulnerability of DNNs hinders practical applications owing to the high stakes of diagnosis, adversarial attacks are expected to be limited because training data — which are often required for adversarial attacks — are generally unavailable in terms of security and privacy preservation. Nevertheless, we hypothesized that adversarial attacks are also possible using natural images because pre-trained models do not change significantly after fine-tuning. We focused on three representative DNN-based medical image classification tasks (i.e., skin cancer, referable diabetic retinopathy, and pneumonia classifications) and investigated whether medical DNN models with transfer learning are vulnerable to universal adversarial perturbations (UAPs), generated using natural images. UAPs from natural images are useful for both non-targeted and targeted attacks. The performance of UAPs from natural images was significantly higher than that of random controls, although slightly lower than that of UAPs from training images. Vulnerability to UAPs from natural images was observed between different natural image datasets and between different model architectures. The use of transfer learning causes a security hole, which decreases the reliability and safety of computer-based disease diagnosis. Model training from random initialization (without transfer learning) reduced the performance of UAPs from natural images; however, it did not completely avoid vulnerability to UAPs. The vulnerability of UAPs from natural images will become a remarkable security threat.

scholarly journals Impact of Low Resolution on Image Recognition with Deep Neural Networks: An Experimental Study

2018 ◽  
Vol 28 (4) ◽  
pp. 735-744 ◽  
Author(s):  
Michał Koziarski ◽  
Bogusław Cyganek
Keyword(s):  
Neural Networks ◽  
Image Recognition ◽  
Classification Accuracy ◽  
Deep Neural Networks ◽  
Dynamic Range ◽  
Super Resolution ◽  
Image Resolution ◽  
Quality Data ◽  
Low Resolution ◽  
The Impact

Abstract Due to the advances made in recent years, methods based on deep neural networks have been able to achieve a state-of-the-art performance in various computer vision problems. In some tasks, such as image recognition, neural-based approaches have even been able to surpass human performance. However, the benchmarks on which neural networks achieve these impressive results usually consist of fairly high quality data. On the other hand, in practical applications we are often faced with images of low quality, affected by factors such as low resolution, presence of noise or a small dynamic range. It is unclear how resilient deep neural networks are to the presence of such factors. In this paper we experimentally evaluate the impact of low resolution on the classification accuracy of several notable neural architectures of recent years. Furthermore, we examine the possibility of improving neural networks’ performance in the task of low resolution image recognition by applying super-resolution prior to classification. The results of our experiments indicate that contemporary neural architectures remain significantly affected by low image resolution. By applying super-resolution prior to classification we were able to alleviate this issue to a large extent as long as the resolution of the images did not decrease too severely. However, in the case of very low resolution images the classification accuracy remained considerably affected.

A NEW SPECTRAL–SPATIAL JOINTED HYPERSPECTRAL IMAGE CLASSIFICATION APPROACH BASED ON FRACTAL DIMENSION ANALYSIS

Fractals ◽  
2019 ◽  
Vol 27 (05) ◽  
pp. 1950079
Author(s):  
JUNYING SU ◽  
YINGKUI LI ◽  
QINGWU HU
Keyword(s):  
Fractal Dimension ◽  
Image Classification ◽  
Classification Accuracy ◽  
Hyperspectral Image ◽  
Spatial Domain ◽  
Spectral Domain ◽  
Hyperspectral Image Classification ◽  
Self Similarity ◽  
Classification Approach ◽  
Image Set

To maximize the advantages of both spectral and spatial information, we introduce a new spectral–spatial jointed hyperspectral image classification approach based on fractal dimension (FD) analysis of spectral response curve (SRC) in spectral domain and extended morphological processing in spatial domain. This approach first calculates the FD image based on the whole SRC of the hyperspectral image and decomposes the SRC into segments to derive the FD images with each SRC segment. These FD images based on the segmented SRC are composited into a multidimensional FD image set in spectral domain. Then, the extended morphological profiles (EMPs) are derived from the image set through morphological open and close operations in spatial domain. Finally, all these EMPs and FD features are combined into one feature vector for a probabilistic support vector machine (SVM) classification. This approach was demonstrated using three hyperspectral images in urban areas of the university campus and downtown area of Pavia, Italy, and the Washington DC Mall area in the USA, respectively. We assessed the potential and performance of this approach by comparing with PCA-based method in hyperspectral image classification. Our results indicate that the classification accuracy of our proposed method is much higher than the accuracies of the classification methods based on the spectral or spatial domain alone, and similar to or slightly higher than the classification accuracy of PCA-based spectral–spatial jointed classification method. The proposed FD approach also provides a new self-similarity measure of land class in spectral domain, a unique property to represent hyperspectral self-similarity of SRC in hyperspectral imagery.

scholarly journals Deep neural networks are superior to dermatologists in melanoma image classification

2019 ◽  
Vol 119 ◽  
pp. 11-17 ◽  
Author(s):  
Titus J. Brinker ◽  
Achim Hekler ◽  
Alexander H. Enk ◽  
Carola Berking ◽  
Sebastian Haferkamp ◽  
...  
Keyword(s):  
Neural Networks ◽  
Image Classification ◽  
Deep Neural Networks

scholarly journals Utilizing Information Bottleneck to Evaluate the Capability of Deep Neural Networks for Image Classification

Entropy ◽  
2019 ◽  
Vol 21 (5) ◽  
pp. 456 ◽  
Author(s):  
Hao Cheng ◽  
Dongze Lian ◽  
Shenghua Gao ◽  
Yanlin Geng
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Model Selection ◽  
Image Classification ◽  
Transfer Learning ◽  
Deep Neural Networks ◽  
Classification Problem ◽  
Distribution Model ◽  
Classification Problems ◽  
Information Bottleneck

Inspired by the pioneering work of the information bottleneck (IB) principle for Deep Neural Networks’ (DNNs) analysis, we thoroughly study the relationship among the model accuracy, I ( X ; T ) and I ( T ; Y ) , where I ( X ; T ) and I ( T ; Y ) are the mutual information of DNN’s output T with input X and label Y. Then, we design an information plane-based framework to evaluate the capability of DNNs (including CNNs) for image classification. Instead of each hidden layer’s output, our framework focuses on the model output T. We successfully apply our framework to many application scenarios arising in deep learning and image classification problems, such as image classification with unbalanced data distribution, model selection, and transfer learning. The experimental results verify the effectiveness of the information plane-based framework: Our framework may facilitate a quick model selection and determine the number of samples needed for each class in the unbalanced classification problem. Furthermore, the framework explains the efficiency of transfer learning in the deep learning area.

Sign in / Sign up

Export Citation Format

Share Document