A novel quantum neural network based on multi-level activation function

2021 ◽  
Vol 18 (2) ◽  
pp. 025201
Author(s):  
Xu-Feng Niu ◽  
Wen-Ping Ma
Keyword(s):  
Neural Network ◽  
Activation Function ◽  
Quantum Neural Network ◽  
Multi Level

scholarly journals Optimized Activation for Quantum-Inspired Self-supervised Neural Network based Fully Automated Brain MR Image Segmentation

2020 ◽  
Author(s):  
Debanjan Konar ◽  
Siddhartha Bhattacharyya ◽  
Bijaya Ketan Panigrahi
Keyword(s):  
Neural Network ◽  
Image Segmentation ◽  
Network Models ◽  
Activation Function ◽  
Medical Image Segmentation ◽  
Data Repository ◽  
Dynamic Susceptibility ◽  
Neural Network Models ◽  
Promising Alternative ◽  
Multi Level

<div>The slow-convergence problem degrades the segmentation performance of the recently proposed Quantum-Inspired Self-supervised Neural Network models owing to lack of suitable tailoring of the inter-connection weights. Hence, incorporation of quantum-inspired meta-heuristics in the Quantum-Inspired Self-supervised Neural Network models optimizes their hyper-parameters and inter-connection weights. This paper is aimed at proposing an optimized version of a Quantum-Inspired Self-supervised Neural Network (QIS-Net) model for optimal</div><div>segmentation of brain Magnetic Resonance (MR) Imaging. The suggested Optimized Quantum-Inspired Self-supervised Neural Network (Opti-QISNet) model resembles the architecture of QIS-Net and its operations are leveraged to obtain optimal segmentation outcome. The optimized activation function employed in the presented model is referred to as Quantum-Inspired Optimized Multi-Level Sigmoidal (Opti-QSig) activation. The Opti-QSig activation function is optimized by three quantum-inspired meta-heuristics with fifitness evaluation using Otsu’s multi-level thresholding. Rigorous experiments have been conducted on Dynamic Susceptibility Contrast (DSC) brain MR images from Nature data repository. The experimental outcomes show that the proposed self-supervised Opti-QISNet model offffers a promising alternative to the deeply supervised neural network based architectures (UNet and FCNNs) in medical image segmentation and outperforms our recently developed models QIBDS Net and QIS-Net.</div>

scholarly journals Stability Analysis Based on Caputo-Type Fractional-Order Quantum Neural Networks

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Yumin Dong ◽  
Xiang Li ◽  
Wei Liao ◽  
Dong Hou
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Learning Algorithm ◽  
Activation Function ◽  
Linear Matrix ◽  
Mixed Delays ◽  
Sigmoid Function ◽  
Matrix Inequality ◽  
Fractional Quantum ◽  
Quantum Neural Network

In this paper, a quantum neural network with multilayer activation function is proposed by using multilayer Sigmoid function superposition and learning algorithm to adjust quantum interval. On this basis, the quasiuniform stability of fractional quantum neural networks with mixed delays is studied. According to the order of two different cases, the conditions of quasi uniform stability of networks are given by using the techniques of linear matrix inequality analysis, and the sufficiency of the conditions is proved. Finally, the feasibility of the conclusion is verified by experiments.

scholarly journals Optimized Activation for Quantum-Inspired Self-supervised Neural Network based Fully Automated Brain MR Image Segmentation

2020 ◽  
Author(s):  
Debanjan Konar ◽  
Siddhartha Bhattacharyya ◽  
Bijaya Ketan Panigrahi
Keyword(s):  
Neural Network ◽  
Image Segmentation ◽  
Network Models ◽  
Activation Function ◽  
Medical Image Segmentation ◽  
Data Repository ◽  
Dynamic Susceptibility ◽  
Neural Network Models ◽  
Promising Alternative ◽  
Multi Level

<div>The slow-convergence problem degrades the segmentation performance of the recently proposed Quantum-Inspired Self-supervised Neural Network models owing to lack of suitable tailoring of the inter-connection weights. Hence, incorporation of quantum-inspired meta-heuristics in the Quantum-Inspired Self-supervised Neural Network models optimizes their hyper-parameters and inter-connection weights. This paper is aimed at proposing an optimized version of a Quantum-Inspired Self-supervised Neural Network (QIS-Net) model for optimal</div><div>segmentation of brain Magnetic Resonance (MR) Imaging. The suggested Optimized Quantum-Inspired Self-supervised Neural Network (Opti-QISNet) model resembles the architecture of QIS-Net and its operations are leveraged to obtain optimal segmentation outcome. The optimized activation function employed in the presented model is referred to as Quantum-Inspired Optimized Multi-Level Sigmoidal (Opti-QSig) activation. The Opti-QSig activation function is optimized by three quantum-inspired meta-heuristics with fifitness evaluation using Otsu’s multi-level thresholding. Rigorous experiments have been conducted on Dynamic Susceptibility Contrast (DSC) brain MR images from Nature data repository. The experimental outcomes show that the proposed self-supervised Opti-QISNet model offffers a promising alternative to the deeply supervised neural network based architectures (UNet and FCNNs) in medical image segmentation and outperforms our recently developed models QIBDS Net and QIS-Net.</div>

SCORING MODELING BASED ON NEURAL NETWORKS FOR DETERMINING A BANK BORROWER'S RATING

2020 ◽  
Vol 2020 (10) ◽  
pp. 54-62
Author(s):  
Oleksii VASYLIEV ◽  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Statistical Data ◽  
Activation Function ◽  
Decision Making Process ◽  
Neural Network Architecture ◽  
Acceptable Accuracy ◽  
The Neural Network ◽  
Sigmoid Activation Function

The problem of applying neural networks to calculate ratings used in banking in the decision-making process on granting or not granting loans to borrowers is considered. The task is to determine the rating function of the borrower based on a set of statistical data on the effectiveness of loans provided by the bank. When constructing a regression model to calculate the rating function, it is necessary to know its general form. If so, the task is to calculate the parameters that are included in the expression for the rating function. In contrast to this approach, in the case of using neural networks, there is no need to specify the general form for the rating function. Instead, certain neural network architecture is chosen and parameters are calculated for it on the basis of statistical data. Importantly, the same neural network architecture can be used to process different sets of statistical data. The disadvantages of using neural networks include the need to calculate a large number of parameters. There is also no universal algorithm that would determine the optimal neural network architecture. As an example of the use of neural networks to determine the borrower's rating, a model system is considered, in which the borrower's rating is determined by a known non-analytical rating function. A neural network with two inner layers, which contain, respectively, three and two neurons and have a sigmoid activation function, is used for modeling. It is shown that the use of the neural network allows restoring the borrower's rating function with quite acceptable accuracy.

scholarly journals Prediction of Stress in Power Transformer Winding Conductors Using Artificial Neural Networks: Hyperparameter Analysis

Energies ◽  
2021 ◽  
Vol 14 (14) ◽  
pp. 4242
Author(s):  
Fausto Valencia ◽  
Hugo Arcos ◽  
Franklin Quilumba
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Finite Element ◽  
Power Transformer ◽  
Network Models ◽  
Activation Function ◽  
Neural Network Models ◽  
Transformer Winding ◽  
Artificial Neural ◽  
Femm Software

The purpose of this research is the evaluation of artificial neural network models in the prediction of stresses in a 400 MVA power transformer winding conductor caused by the circulation of fault currents. The models were compared considering the training, validation, and test data errors’ behavior. Different combinations of hyperparameters were analyzed based on the variation of architectures, optimizers, and activation functions. The data for the process was created from finite element simulations performed in the FEMM software. The design of the Artificial Neural Network was performed using the Keras framework. As a result, a model with one hidden layer was the best suited architecture for the problem at hand, with the optimizer Adam and the activation function ReLU. The final Artificial Neural Network model predictions were compared with the Finite Element Method results, showing good agreement but with a much shorter solution time.

Breast cancer diagnosis using multiple activation deep neural network

2021 ◽  
pp. 1063293X2110251
Author(s):  
K Vijayakumar ◽  
Vinod J Kadam ◽  
Sudhir Kumar Sharma
Keyword(s):  
Breast Cancer ◽  
Neural Network ◽  
Deep Neural Network ◽  
Breast Cancer Diagnosis ◽  
Activation Function ◽  
Linear Functions ◽  
Cancer Data ◽  
Final Layer ◽  
Improved Performance ◽  
Hidden Layer

Deep Neural Network (DNN) stands for multilayered Neural Network (NN) that is capable of progressively learn the more abstract and composite representations of the raw features of the input data received, with no need for any feature engineering. They are advanced NNs having repetitious hidden layers between the initial input and the final layer. The working principle of such a standard deep classifier is based on a hierarchy formed by the composition of linear functions and a defined nonlinear Activation Function (AF). It remains uncertain (not clear) how the DNN classifier can function so well. But it is clear from many studies that within DNN, the AF choice has a notable impact on the kinetics of training and the success of tasks. In the past few years, different AFs have been formulated. The choice of AF is still an area of active study. Hence, in this study, a novel deep Feed forward NN model with four AFs has been proposed for breast cancer classification: hidden layer 1: Swish, hidden layer, 2:-LeakyReLU, hidden layer 3: ReLU, and final output layer: naturally Sigmoidal. The purpose of the study is twofold. Firstly, this study is a step toward a more profound understanding of DNN with layer-wise different AFs. Secondly, research is also aimed to explore better DNN-based systems to build predictive models for breast cancer data with improved accuracy. Therefore, the benchmark UCI dataset WDBC was used for the validation of the framework and evaluated using a ten-fold CV method and various performance indicators. Multiple simulations and outcomes of the experimentations have shown that the proposed solution performs in a better way than the Sigmoid, ReLU, and LeakyReLU and Swish activation DNN in terms of different parameters. This analysis contributes to producing an expert and precise clinical dataset classification method for breast cancer. Furthermore, the model also achieved improved performance compared to many established state-of-the-art algorithms/models.

Sign in / Sign up

Export Citation Format

Share Document