scholarly journals Evolving Deep Architecture Generation with Residual Connections for Image Classification Using Particle Swarm Optimization

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 7936
Author(s):  
Tom Lawrence ◽  
Li Zhang ◽  
Kay Rogage ◽  
Chee Peng Lim
Keyword(s):  
Particle Swarm Optimization ◽  
Network Architecture ◽  
Particle Swarm ◽  
Swarm Optimization ◽  
Encoding Scheme ◽  
Fine Grained ◽  
Deep Architecture ◽  
Proposed Model ◽  
Architecture Generation ◽  
Important Design

Automated deep neural architecture generation has gained increasing attention. However, exiting studies either optimize important design choices, without taking advantage of modern strategies such as residual/dense connections, or they optimize residual/dense networks but reduce search space by eliminating fine-grained network setting choices. To address the aforementioned weaknesses, we propose a novel particle swarm optimization (PSO)-based deep architecture generation algorithm, to devise deep networks with residual connections, whilst performing a thorough search which optimizes important design choices. A PSO variant is proposed which incorporates a new encoding scheme and a new search mechanism guided by non-uniformly randomly selected neighboring and global promising solutions for the search of optimal architectures. Specifically, the proposed encoding scheme is able to describe convolutional neural network architecture configurations with residual connections. Evaluated using benchmark datasets, the proposed model outperforms existing state-of-the-art methods for architecture generation. Owing to the guidance of diverse non-uniformly selected neighboring promising solutions in combination with the swarm leader at fine-grained and global levels, the proposed model produces a rich assortment of residual architectures with great diversity. Our devised networks show better capabilities in tackling vanishing gradients with up to 4.34% improvement of mean accuracy in comparison with those of existing studies.

scholarly journals Continuous Particle Swarm Optimization-Based Deep Learning Architecture Search for Hyperspectral Image Classification

2021 ◽  
Vol 13 (6) ◽  
pp. 1082
Author(s):  
Xiaobo Liu ◽  
Chaochao Zhang ◽  
Zhihua Cai ◽  
Jianfeng Yang ◽  
Zhilang Zhou ◽  
...  
Keyword(s):  
Particle Swarm Optimization ◽  
Hyperspectral Image ◽  
Particle Swarm ◽  
Deep Convolutional Neural Networks ◽  
Swarm Optimization ◽  
Deep Architecture ◽  
Training Samples ◽  
Architecture Generation ◽  
Limited Training Samples ◽  
Encoding Strategy

Deep convolutional neural networks (CNNs) are widely used in hyperspectral image (HSI) classification. However, the most successful CNN architectures are handcrafted, which need professional knowledge and consume a very significant amount of time. To automatically design cell-based CNN architectures for HSI classification, we propose an efficient continuous evolutionary method, named CPSO-Net, which can dramatically accelerate optimal architecture generation by the optimization of weight-sharing parameters. First, a SuperNet with all candidate operations is maintained to share the parameters for all individuals and optimized by collecting the gradients of all individuals in the population. Second, a novel direct encoding strategy is devised to encode architectures into particles, which inherit the parameters from the SuperNet. Then, particle swarm optimization is used to search for the optimal deep architecture from the particle swarm. Furthermore, experiments with limited training samples based on four widely used biased and unbiased hyperspectral datasets showed that our proposed method achieves good performance comparable to the state-of-the-art HSI classification methods.

scholarly journals Neural Network Approach for Global Solar Irradiance Prediction at Extremely Short-Time-Intervals Using Particle Swarm Optimization Algorithm

Energies ◽  
2021 ◽  
Vol 14 (4) ◽  
pp. 1213
Author(s):  
Ahmed Aljanad ◽  
Nadia M. L. Tan ◽  
Vassilios G. Agelidis ◽  
Hussain Shareef
Keyword(s):  
Neural Networks ◽  
Particle Swarm Optimization ◽  
Solar Irradiance ◽  
Particle Swarm ◽  
Time Interval ◽  
Time Intervals ◽  
Swarm Optimization ◽  
Backpropagation Neural Networks ◽  
Proposed Model ◽  
Short Time

Hourly global solar irradiance (GSR) data are required for sizing, planning, and modeling of solar photovoltaic farms. However, operating and controlling such farms exposed to varying environmental conditions, such as fast passing clouds, necessitates GSR data to be available for very short time intervals. Classical backpropagation neural networks do not perform satisfactorily when predicting parameters within short intervals. This paper proposes a hybrid backpropagation neural networks based on particle swarm optimization. The particle swarm algorithm is used as an optimization algorithm within the backpropagation neural networks to optimize the number of hidden layers and neurons used and its learning rate. The proposed model can be used as a reliable model in predicting changes in the solar irradiance during short time interval in tropical regions such as Malaysia and other regions. Actual global solar irradiance data of 5-s and 1-min intervals, recorded by weather stations, are applied to train and test the proposed algorithm. Moreover, to ensure the adaptability and robustness of the proposed technique, two different cases are evaluated using 1-day and 3-days profiles, for two different time intervals of 1-min and 5-s each. A set of statistical error indices have been introduced to evaluate the performance of the proposed algorithm. From the results obtained, the 3-days profile’s performance evaluation of the BPNN-PSO are 1.7078 of RMSE, 0.7537 of MAE, 0.0292 of MSE, and 31.4348 of MAPE (%), at 5-s time interval, where the obtained results of 1-min interval are 0.6566 of RMSE, 0.2754 of MAE, 0.0043 of MSE, and 1.4732 of MAPE (%). The results revealed that proposed model outperformed the standalone backpropagation neural networks method in predicting global solar irradiance values for extremely short-time intervals. In addition to that, the proposed model exhibited high level of predictability compared to other existing models.

Adaptive particle swarm optimization algorithm based long short-term memory networks for sentiment analysis

2021 ◽  
pp. 1-17
Author(s):  
J. Shobana ◽  
M. Murali
Keyword(s):  
Particle Swarm Optimization ◽  
Sentiment Analysis ◽  
Language Processing ◽  
Short Term Memory ◽  
Contextual Information ◽  
Particle Swarm ◽  
Pso Algorithm ◽  
Swarm Optimization ◽  
Adaptive Particle Swarm Optimization ◽  
Proposed Model

Text Sentiment analysis is the process of predicting whether a segment of text has opinionated or objective content and analyzing the polarity of the text’s sentiment. Understanding the needs and behavior of the target customer plays a vital role in the success of the business so the sentiment analysis process would help the marketer to improve the quality of the product as well as a shopper to buy the correct product. Due to its automatic learning capability, deep learning is the current research interest in Natural language processing. Skip-gram architecture is used in the proposed model for better extraction of the semantic relationships as well as contextual information of words. However, the main contribution of this work is Adaptive Particle Swarm Optimization (APSO) algorithm based LSTM for sentiment analysis. LSTM is used in the proposed model for understanding complex patterns in textual data. To improve the performance of the LSTM, weight parameters are enhanced by presenting the Adaptive PSO algorithm. Opposition based learning (OBL) method combined with PSO algorithm becomes the Adaptive Particle Swarm Optimization (APSO) classifier which assists LSTM in selecting optimal weight for the environment in less number of iterations. So APSO - LSTM ‘s ability in adjusting the attributes such as optimal weights and learning rates combined with the good hyper parameter choices leads to improved accuracy and reduces losses. Extensive experiments were conducted on four datasets proved that our proposed APSO-LSTM model secured higher accuracy over the classical methods such as traditional LSTM, ANN, and SVM. According to simulation results, the proposed model is outperforming other existing models.

scholarly journals A Multiobjective Allocation Model for Emergency Resources That Balance Efficiency and Fairness

2018 ◽  
Vol 2018 ◽  
pp. 1-8 ◽  
Author(s):  
Yanyan Wang ◽  
Baiqing Sun
Keyword(s):  
Resource Allocation ◽  
Particle Swarm Optimization ◽  
Particle Swarm ◽  
Allocation Model ◽  
Swarm Optimization ◽  
Emergency Relief ◽  
Resource Allocation Model ◽  
Proposed Model ◽  
Emergency Resource

Efficiency and fairness are two important goals of disaster rescue. However, the existing models usually unilaterally consider the efficiency or fairness of resource allocation. Based on this, a multiobjective emergency resource allocation model that can balance efficiency and fairness is proposed. The object of the proposed model is to minimize the total allocating costs of resources and the total losses caused by insufficient resources. Then the particle swarm optimization is applied to solve the model. Finally, a computational example is conducted based on the emergency relief resource allocation after Ya’an earthquake in China to verify the applicability of the proposed model.

scholarly journals Novel Ensemble Approach of Deep Learning Neural Network (DLNN) Model and Particle Swarm Optimization (PSO) Algorithm for Prediction of Gully Erosion Susceptibility

Sensors ◽  
2020 ◽  
Vol 20 (19) ◽  
pp. 5609 ◽  
Author(s):  
Shahab S. Band ◽  
Saeid Janizadeh ◽  
Subodh Chandra Pal ◽  
Asish Saha ◽  
Rabin Chakrabortty ◽  
...  
Keyword(s):  
Neural Network ◽  
Particle Swarm Optimization ◽  
Deep Learning ◽  
Particle Swarm ◽  
Pso Algorithm ◽  
Gully Erosion ◽  
Slope Aspect ◽  
Swarm Optimization ◽  
Proposed Model ◽  
Deep Learning Neural Network

This study aims to evaluate a new approach in modeling gully erosion susceptibility (GES) based on a deep learning neural network (DLNN) model and an ensemble particle swarm optimization (PSO) algorithm with DLNN (PSO-DLNN), comparing these approaches with common artificial neural network (ANN) and support vector machine (SVM) models in Shirahan watershed, Iran. For this purpose, 13 independent variables affecting GES in the study area, namely, altitude, slope, aspect, plan curvature, profile curvature, drainage density, distance from a river, land use, soil, lithology, rainfall, stream power index (SPI), and topographic wetness index (TWI), were prepared. A total of 132 gully erosion locations were identified during field visits. To implement the proposed model, the dataset was divided into the two categories of training (70%) and testing (30%). The results indicate that the area under the curve (AUC) value from receiver operating characteristic (ROC) considering the testing datasets of PSO-DLNN is 0.89, which indicates superb accuracy. The rest of the models are associated with optimal accuracy and have similar results to the PSO-DLNN model; the AUC values from ROC of DLNN, SVM, and ANN for the testing datasets are 0.87, 0.85, and 0.84, respectively. The efficiency of the proposed model in terms of prediction of GES was increased. Therefore, it can be concluded that the DLNN model and its ensemble with the PSO algorithm can be used as a novel and practical method to predict gully erosion susceptibility, which can help planners and managers to manage and reduce the risk of this phenomenon.

Markov Chain-Like Model for Prediction Service Based on Improved Hierarchical Particle Swarm Optimization Cluster Algorithm

2016 ◽  
Vol 26 (04) ◽  
pp. 653-674 ◽  
Author(s):  
Zhifang Liao ◽  
Min Liu ◽  
Tianhui Song ◽  
Li Kuang ◽  
Yan Zhang ◽  
...  
Keyword(s):  
Particle Swarm Optimization ◽  
Markov Chain ◽  
Clustering Algorithms ◽  
Particle Swarm ◽  
Heterogeneous Data ◽  
Swarm Optimization ◽  
Log Data ◽  
Web Log ◽  
Proposed Model ◽  
The Web

Since web pages visited by users contain a variety of data resources and the clustering algorithms frequently used for web data do not take the heterogeneous nature into account when processing the heterogeneous data, this paper proposes a new algorithm, namely IHPSOC algorithm, to cluster web log data on the basis of web log mining. Based on particle swarm optimization (PSO), IHPSOC algorithm clusters the web log data through particle swarm iteration. Based on clustering results, this paper establishes Markov chain-like models which create a corresponding Markov chain for users in each different category so as to predict the web resources in users’ need. The results of the experiments show that the proposed model gives better predication.

scholarly journals Optimizing shipping routes to minimize cost using particle swarm optimization

2020 ◽  
Vol 1 (1) ◽  
pp. 53
Author(s):  
Annur Rahman ◽  
Hayati Mukti Asih
Keyword(s):  
Particle Swarm Optimization ◽  
Traveling Salesman Problem ◽  
Particle Swarm ◽  
Transportation Cost ◽  
Traveling Salesman ◽  
Swarm Optimization ◽  
Proposed Model ◽  
Economic Process ◽  
High Transportation Cost ◽  
Number Of Iterations

Product shipping is important in the economic process in the company. Efficient product shipping routes should provide low transportation costs. This study based on a case company of CV. Kayana, a distributor of “Sari Roti”, has 4 motorbikes and 2 cars. Each vehicle has their own shipping routes. Nowadays, high distance for each route results on high transportation cost. Therefore, the objective of this study to minimize the distance and cost of product shipping by developing shipping algorithm using Particle Swarm Optimization (PSO) for Traveling Salesman Problem (TSP). The MATLAB software was employed to solve this problem. The solution is obtained by varying the amount of particles and number of iterations. Experimental results proved that the developed PSO is enough effective and efficient to solve shipping routes problem. The results show the proposed model have lower distance and transportation cost. It helps the company in determining the routes for product shipping with minimum transportation cost.

COVID-19: risk prediction through nature inspired algorithm

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Narinder Singh ◽  
S.B. Singh ◽  
Essam H. Houssein ◽  
Muhammad Ahmad
Keyword(s):  
Particle Swarm Optimization ◽  
Risk Prediction ◽  
Particle Swarm ◽  
Physical Contact ◽  
Swarm Optimization ◽  
Content Type ◽  
Proposed Model ◽  
Nature Inspired Algorithm ◽  
Future Prediction ◽  
Sine Cosine Algorithm

Purpose The purpose of this study to investigate the effects and possible future prediction of COVID-19. The dataset considered in this study to investigate the effects and possible future prediction of COVID-19 is constrained as follows: age, gender, systolic blood pressure, HDL-cholesterol, diabetes and its medication, does the patient suffered from heart disease or took anti-cough agent food or sensitive to cough related issues and any other chronic kidney disease, physical contact with foreign returns and social distance for the prediction of the risk of COVID-19. Design/methodology/approach This work implemented a meta-heuristic algorithm on the aforementioned dataset for possible analysis of the risk of being infected with COVID-19. The authors proposed a simple yet effective Risk Prediction through Nature Inspired Hybrid Particle Swarm Optimization and Sine Cosine Algorithm (HPSOSCA), particle swarm optimization (PSO), and sine cosine algorithm (SCA) algorithms. Findings The simulated results on different cases discussed in the dataset section reveal which category of individuals may happen to have the disease and of what level. The experimental results reveal that the proposed model can predict the percentage of risk with an overall accuracy of 88.63%, sensitivity (87.23%), specificity (89.02%), precision (69.49%), recall (87.23%), f_measure (77.36%) and Gmean (88.12%) with 41 and 146 true positive and negative, 18 and 6 false positive and negative cases, respectively. The proposed model provides a quite stable prediction of risk for COVID-19 on different categories of individuals. Originality/value The work for the very first time developed a novel HPSOSCA model based on PSO and SCA for the prediction of COVID-19 disease. The convergence rate of the proposed model is too high as compared to the literature. It also produces a better accuracy in a computationally efficient fashion. The obtained outputs are as follows: accuracy (88.63%), sensitivity (87.23%), specificity (89.02%), precision (69.49%), recall (87.23%), f_measure (77.36%), Gmean (88.12%), Tp (41), Tn (146), Fb (18) and Fn (06). The recommendations to reduce disease outbreaks are as follow: to control this epidemic in various regions, it is important to appropriately manage patients suspected of having the disease, immediately identify and isolate the source of infection, cut off the transmission route and prevent viral transmission from these potential patients or virus carriers.

scholarly journals Multi-modal prediction of breast cancer using particle swarm optimization with non-dominating sorting

2020 ◽  
Vol 16 (11) ◽  
pp. 155014772097150
Author(s):  
Vijayalakshmi S ◽  
John A ◽  
Sunder R ◽  
Senthilkumar Mohan ◽  
Sweta Bhattacharya ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Particle Swarm Optimization ◽  
Density Estimation ◽  
Kernel Density Estimation ◽  
Particle Swarm ◽  
Kernel Density ◽  
Swarm Optimization ◽  
Cancer Prediction ◽  
Proposed Model ◽  
Sensitivity Specificity

Cancer is enlisted as the second leading reason for death across the world wherein almost one person out of six dies of cancer. Breast cancer is one of the most common forms of cancer predominant in women having the second highest mortality rate in the world. Various scientific studies have been conducted to combat this disease, and machine learning approaches have been an extremely popular choice. Particle swarm optimization has been identified as one of the most powerful and efficient technique for the diagnosis of breast cancer guiding physicians towards timely and accurate treatment. It is also pertinent to mention that multi-modal prediction methods are used to make decisions depending upon different scenarios and aspects whereas the non-dominating sorting feature is useful to sort different objects based on differing requirements. The main novelty of this work is multi-modal prediction algorithm for breast cancer prediction is proposed. The work encompasses the use of particle swarm optimization, non-dominating sorting and multi-classifier techniques, namely, k-nearest neighbour method, fast decision tree and kernel density estimation. Finally, Bayes’ theorem is implemented for revising the results to achieve optimum accuracy in the breast cancer prediction. The proposed particle swarm optimization and non-domination sorting with classifier technique model helps to select the most significant features relevant to breast cancer predictions. The selected features design the objective of the problem model. The proposed model is implemented on the WBCD and WDBC breast cancer data sets publicly available from the UCI machine learning data repository. The metrics considered are sensitivity, specificity, accuracy and time complexity. The experimental results of the study using measures such as sensitivity, specificity, accuracy and time complexity. The experimental results of the study are evaluated against the state-of-the-art algorithms, namely, genetic algorithm kernel density estimation and particle swarm optimization kernel density estimation wherein the results justify the superiority of the proposed model.

An Intelligent Network Intrusion Detection System Using Particle Swarm Optimization (PSO) and Deep Network Networks (DNN)

2021 ◽  
Vol 12 (2) ◽  
pp. 57-73
Author(s):  
Preethi D. ◽  
Neelu Khare
Keyword(s):  
Feature Selection ◽  
Particle Swarm Optimization ◽  
Intrusion Detection ◽  
Intrusion Detection System ◽  
Detection System ◽  
Particle Swarm ◽  
Network Intrusion Detection ◽  
Swarm Optimization ◽  
Network Intrusion ◽  
Proposed Model

Network intrusion detection system (NIDS) plays a major role in ensuring network security. In this paper, the authors propose a PSO-DNN-based intrusion detection system. The correlation-based feature selection (CFS) applied for feature selection with particle swarm optimization (PSO) as search method and deep neural networks (DNN) for classification of network intrusions. The Adam optimizer is applied for optimizing the learning rate, and softmax classifier is used for classification. The experimentations were duly conducted on the standard benchmark NSL-KDD dataset. The proposed model is validated using 10-fold cross-validation and evaluated using the performance metrics such as accuracy, precision, recall, and F1-score. Also, the results are also compared with DNN and CFS+DNN. The experimental results show that the proposed model performs better compared with other methods considered for comparison.

Sign in / Sign up

Export Citation Format

Share Document