Black-Box Modeling of DC–DC Converters Based on Wavelet Convolutional Neural Networks

2021 ◽  
Vol 70 ◽  
pp. 1-9
Author(s):  
Gabriel Rojas-Duenas ◽  
Jordi-Roger Riba ◽  
Manuel Moreno-Eguilaz
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Black Box

Sanitizing hidden activations for improving adversarial robustness of convolutional neural networks

2021 ◽  
pp. 1-11
Author(s):  
Tianshi Mu ◽  
Kequan Lin ◽  
Huabing Zhang ◽  
Jian Wang
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
State Of The Art ◽  
Black Box ◽  
Experimental Results ◽  
Amplification Effect ◽  
Wide Range ◽  
Adversarial Examples

Deep learning is gaining significant traction in a wide range of areas. Whereas, recent studies have demonstrated that deep learning exhibits the fatal weakness on adversarial examples. Due to the black-box nature and un-transparency problem of deep learning, it is difficult to explain the reason for the existence of adversarial examples and also hard to defend against them. This study focuses on improving the adversarial robustness of convolutional neural networks. We first explore how adversarial examples behave inside the network through visualization. We find that adversarial examples produce perturbations in hidden activations, which forms an amplification effect to fool the network. Motivated by this observation, we propose an approach, termed as sanitizing hidden activations, to help the network correctly recognize adversarial examples by eliminating or reducing the perturbations in hidden activations. To demonstrate the effectiveness of our approach, we conduct experiments on three widely used datasets: MNIST, CIFAR-10 and ImageNet, and also compare with state-of-the-art defense techniques. The experimental results show that our sanitizing approach is more generalized to defend against different kinds of attacks and can effectively improve the adversarial robustness of convolutional neural networks.

Patch-Based Crack Detection in Black Box Images Using Convolutional Neural Networks

2019 ◽  
Vol 33 (3) ◽  
pp. 04019017 ◽  
Author(s):  
Somin Park ◽  
Seongdeok Bang ◽  
Hongjo Kim ◽  
Hyoungkwan Kim
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Crack Detection ◽  
Black Box

scholarly journals How Convolutional Neural Networks Diagnose Plant Disease

2019 ◽  
Vol 2019 ◽  
pp. 1-14 ◽  
Author(s):  
Yosuke Toda ◽  
Fumio Okura
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Plant Disease ◽  
Disease Diagnosis ◽  
Black Box ◽  
Plant Diseases ◽  
Training Dataset ◽  
Great Success ◽  
Human Decision

Deep learning with convolutional neural networks (CNNs) has achieved great success in the classification of various plant diseases. However, a limited number of studies have elucidated the process of inference, leaving it as an untouchable black box. Revealing the CNN to extract the learned feature as an interpretable form not only ensures its reliability but also enables the validation of the model authenticity and the training dataset by human intervention. In this study, a variety of neuron-wise and layer-wise visualization methods were applied using a CNN, trained with a publicly available plant disease image dataset. We showed that neural networks can capture the colors and textures of lesions specific to respective diseases upon diagnosis, which resembles human decision-making. While several visualization methods were used as they are, others had to be optimized to target a specific layer that fully captures the features to generate consequential outputs. Moreover, by interpreting the generated attention maps, we identified several layers that were not contributing to inference and removed such layers inside the network, decreasing the number of parameters by 75% without affecting the classification accuracy. The results provide an impetus for the CNN black box users in the field of plant science to better understand the diagnosis process and lead to further efficient use of deep learning for plant disease diagnosis.

scholarly journals Convolutional neural networks can decode eye movement data: A black box approach to predicting task from eye movements

2021 ◽  
Vol 21 (7) ◽  
pp. 9
Author(s):  
Zachary J. Cole ◽  
Karl M. Kuntzelman ◽  
Michael D. Dodd ◽  
Matthew R. Johnson
Keyword(s):  
Neural Networks ◽  
Eye Movements ◽  
Eye Movement ◽  
Convolutional Neural Networks ◽  
Black Box ◽  
Movement Data

scholarly journals Generalize Sentence Representation with Self-Inference

2020 ◽  
Vol 34 (05) ◽  
pp. 9394-9401
Author(s):  
Kai-Chou Yang ◽  
Hung-Yu Kao
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Networks ◽  
State Of The Art ◽  
Contextual Information ◽  
Interaction Space ◽  
Black Box ◽  
Experimental Results ◽  
Inference Process ◽  
Model Sets

In this paper, we propose Self Inference Neural Network (SINN), a simple yet efficient sentence encoder which leverages knowledge from recurrent and convolutional neural networks. SINN gathers semantic evidence in an interaction space which is subsequently fused by a shared vector gate to determine the most relevant mixture of contextual information. We evaluate the proposed method on four benchmarks among three NLP tasks. Experimental results demonstrate that our model sets a new state-of-the-art on MultiNLI, Scitail and is competitive on the remaining two datasets over all sentence encoding methods. The encoding and inference process in our model is highly interpretable. Through visualizations of the fusion component, we open the black box of our network and explore the applicability of the base encoding methods case by case.

scholarly journals Convolutional neural networks can decode eye movement data: A black box approach to predicting task from eye movements

2020 ◽  
Author(s):  
Zachary Jay Cole ◽  
Karl Kuntzelman ◽  
Michael D. Dodd ◽  
Matthew Johnson
Keyword(s):  
Neural Networks ◽  
Eye Movement ◽  
Convolutional Neural Networks ◽  
Pupil Size ◽  
General Pattern ◽  
Image Data ◽  
Black Box ◽  
Minimally Processed ◽  
Movement Data

Previous attempts to classify task from eye movement data have relied on model architectures designed to emulate theoretically defined cognitive processes, and/or data that has been processed into aggregate (e.g., fixations, saccades) or statistical (e.g., fixation density) features. _Black box_ convolutional neural networks (CNNs) are capable of identifying relevant features in raw and minimally processed data and images, but difficulty interpreting these model architectures has contributed to challenges in generalizing lab-trained CNNs to applied contexts. In the current study, a CNN classifier was used to classify task from two eye movement datasets (Exploratory and Confirmatory) in which participants searched, memorized, or rated indoor and outdoor scene images. The Exploratory dataset was used to tune the hyperparameters of the model, and the resulting model architecture was re-trained, validated, and tested on the Confirmatory dataset. The data were formatted into timelines (i.e., x-coordinate, y-coordinate, pupil size) and minimally processed images. To further understand the informational value of each component of the eye movement data, the timeline and image datasets were broken down into subsets with one or more components systematically removed. Classification of the timeline data consistently outperformed the image data. The Memorize condition was most often confused with Search and Rate. Pupil size was the least uniquely informative component when compared with the x- and y-coordinates. The general pattern of results for the Exploratory dataset was replicated in the Confirmatory dataset. Overall, the present study provides a practical and reliable black box solution to classifying task from eye movement data.

scholarly journals How Convolutional Neural Networks Diagnose Plant Disease

2019 ◽  
Vol 2019 ◽  
pp. 1-14 ◽  
Author(s):  
Yosuke Toda ◽  
Fumio Okura
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Plant Disease ◽  
Disease Diagnosis ◽  
Black Box ◽  
Plant Diseases ◽  
Training Dataset ◽  
Great Success ◽  
Human Decision

Deep learning with convolutional neural networks (CNNs) has achieved great success in the classification of various plant diseases. However, a limited number of studies have elucidated the process of inference, leaving it as an untouchable black box. Revealing the CNN to extract the learned feature as an interpretable form not only ensures its reliability but also enables the validation of the model authenticity and the training dataset by human intervention. In this study, a variety of neuron-wise and layer-wise visualization methods were applied using a CNN, trained with a publicly available plant disease image dataset. We showed that neural networks can capture the colors and textures of lesions specific to respective diseases upon diagnosis, which resembles human decision-making. While several visualization methods were used as they are, others had to be optimized to target a specific layer that fully captures the features to generate consequential outputs. Moreover, by interpreting the generated attention maps, we identified several layers that were not contributing to inference and removed such layers inside the network, decreasing the number of parameters by 75% without affecting the classification accuracy. The results provide an impetus for the CNN black box users in the field of plant science to better understand the diagnosis process and lead to further efficient use of deep learning for plant disease diagnosis.

Sign in / Sign up

Export Citation Format

Share Document