scholarly journals Electricity-theft detection in smart grids based on deep learning

2021 ◽  
Vol 10 (4) ◽  
pp. 2285-2292
Author(s):  
Noor Mahmoud Ibrahim ◽  
Sufyan T. Faraj Al-Janabi ◽  
Belal Al-Khateeb
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Smart Grids ◽  
High Performance ◽  
Electricity Consumption ◽  
Sequential Model ◽  
Electricity Theft ◽  
Learning Techniques ◽  
Blue Monkey

lectricity theft is a major concern for utilities. The smart grid (SG) infrastructure generates a massive amount of data, including the power consumption of individual users. Utilizing this data, machine learning, and deep learning techniques can accurately identify electricity theft users. A convolutional neural network (CNN) model for automatic electricity theft detection is presented. This work considers experimentation to find the best configuration of the sequential model (SM) for classifying and identifying electricity theft. The best performance has been obtained in two layers with the first layer consists of 128 nodes and the second layer is 64 nodes. The accuracy reached up to 0.92. This enables the design of high-performance electricity signal classifiers that can be used in several applications. Designing electricity signals classifiers has been achieved using a CNN and the data extracted from the electricity consumption dataset using an SM. In addition, the blue monkey (BM) algorithm is used to reduce the features in the dataset. In this respect, the focusing of this work is to reduce the features in the dataset to obtain high-performance electricity signals classifier models.

scholarly journals Detection and Severity Evaluation of Combined Rail Defects Using Deep Learning

Vibration ◽  
2021 ◽  
Vol 4 (2) ◽  
pp. 341-356
Author(s):  
Jessada Sresakoolchai ◽  
Sakdirat Kaewunruen
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Mean Absolute Error ◽  
Absolute Error ◽  
Machine Learning Techniques ◽  
Rolling Stock ◽  
Raw Data ◽  
Learning Techniques ◽  
Combined Defects

Various techniques have been developed to detect railway defects. One of the popular techniques is machine learning. This unprecedented study applies deep learning, which is a branch of machine learning techniques, to detect and evaluate the severity of rail combined defects. The combined defects in the study are settlement and dipped joint. Features used to detect and evaluate the severity of combined defects are axle box accelerations simulated using a verified rolling stock dynamic behavior simulation called D-Track. A total of 1650 simulations are run to generate numerical data. Deep learning techniques used in the study are deep neural network (DNN), convolutional neural network (CNN), and recurrent neural network (RNN). Simulated data are used in two ways: simplified data and raw data. Simplified data are used to develop the DNN model, while raw data are used to develop the CNN and RNN model. For simplified data, features are extracted from raw data, which are the weight of rolling stock, the speed of rolling stock, and three peak and bottom accelerations from two wheels of rolling stock. In total, there are 14 features used as simplified data for developing the DNN model. For raw data, time-domain accelerations are used directly to develop the CNN and RNN models without processing and data extraction. Hyperparameter tuning is performed to ensure that the performance of each model is optimized. Grid search is used for performing hyperparameter tuning. To detect the combined defects, the study proposes two approaches. The first approach uses one model to detect settlement and dipped joint, and the second approach uses two models to detect settlement and dipped joint separately. The results show that the CNN models of both approaches provide the same accuracy of 99%, so one model is good enough to detect settlement and dipped joint. To evaluate the severity of the combined defects, the study applies classification and regression concepts. Classification is used to evaluate the severity by categorizing defects into light, medium, and severe classes, and regression is used to estimate the size of defects. From the study, the CNN model is suitable for evaluating dipped joint severity with an accuracy of 84% and mean absolute error (MAE) of 1.25 mm, and the RNN model is suitable for evaluating settlement severity with an accuracy of 99% and mean absolute error (MAE) of 1.58 mm.

scholarly journals Deep Learning Assisted Neonatal Cry Classification via Support Vector Machine Models

2021 ◽  
Vol 9 ◽  
Author(s):  
Ashwini K ◽  
P. M. Durai Raj Vincent ◽  
Kathiravan Srinivasan ◽  
Chuan-Yu Chang
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Support Vector Machine ◽  
Feature Extraction ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Support Vector ◽  
Svm Classifier ◽  
Infant Cry ◽  
Learning Techniques

Neonatal infants communicate with us through cries. The infant cry signals have distinct patterns depending on the purpose of the cries. Preprocessing, feature extraction, and feature selection need expert attention and take much effort in audio signals in recent days. In deep learning techniques, it automatically extracts and selects the most important features. For this, it requires an enormous amount of data for effective classification. This work mainly discriminates the neonatal cries into pain, hunger, and sleepiness. The neonatal cry auditory signals are transformed into a spectrogram image by utilizing the short-time Fourier transform (STFT) technique. The deep convolutional neural network (DCNN) technique takes the spectrogram images for input. The features are obtained from the convolutional neural network and are passed to the support vector machine (SVM) classifier. Machine learning technique classifies neonatal cries. This work combines the advantages of machine learning and deep learning techniques to get the best results even with a moderate number of data samples. The experimental result shows that CNN-based feature extraction and SVM classifier provides promising results. While comparing the SVM-based kernel techniques, namely radial basis function (RBF), linear and polynomial, it is found that SVM-RBF provides the highest accuracy of kernel-based infant cry classification system provides 88.89% accuracy.

scholarly journals A rough set theory and deep learning based predictive system for gender recognition using audio speech

2021 ◽  
Author(s):  
Ghazaala Yasmin ◽  
ASIT KUMAR DAS ◽  
Janmenjoy Nayak ◽  
S Vimal ◽  
Soumi Dutta
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Set Theory ◽  
Rough Set ◽  
Gender Discrimination ◽  
Rough Set Theory ◽  
Recognition System ◽  
Gender Recognition ◽  
Learning Techniques

Abstract Speech is one of the most delicate medium through which gender of the speakers can easily be identified. Though the related research has shown very good progress in machine learning but recently, deep learning has imparted a very good research area to explore the deficiency of gender discrimination using traditional machine learning techniques. In deep learning techniques, the speech features are automatically generated by the reinforcement learning from the raw data which have more discriminating power than the human generated features. But in some practical situations like gender recognition, it is observed that combination of both types of features sometimes provides comparatively better performance. In the proposed work, we have initially extracted and selected some informative and precise acoustic features relevant to gender recognition using entropy based information theory and Rough Set Theory (RST). Next, the audio speech signals are directly fed into the deep neural network model consists of Convolution Neural Network (CNN) and Gated Recurrent Unit network (GRUN) for extracting features useful for gender recognition. The RST selects precise and informative features, CNN extracts the locally encoded important features, and GRUN reduces the vanishing gradient and exploding gradient problems. Finally, a hybrid gender recognition system is developed combining both generated feature vectors. The developed model has been tested with five bench mark and a simulated dataset to evaluate its performance and it is observed that combined feature vector provides more effective gender recognition system specially when transgender is considered as a gender type together with male and female.

A Study on Brain Tumor Detection and Segmentation Using Deep Learning Techniques

2020 ◽  
Vol 17 (4) ◽  
pp. 1925-1930
Author(s):  
Ambeshwar Kumar ◽  
R. Manikandan ◽  
Robbi Rahim
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Brain Tumor ◽  
Tumor Detection ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Learning Techniques ◽  
Convolution Algorithm ◽  
The Brain

It’s a new era technology in the field of medical engineering giving awareness about the various healthcare features. Deep learning is a part of machine learning, it is capable of handling high dimensional data and is efficient in concentrating on the right features. Tumor is an unbelievably complex disease: a multifaceted cell has more than hundred billion cells; each cell acquires mutation exclusively. Detection of tumor particles in experiment is easily done by MRI or CT. Brain tumors can also be detected by MRI, however, deep learning techniques give a better approach to segment the brain tumor images. Deep Learning models are imprecisely encouraged by information handling and communication designs in biological nervous system. Classification plays an significant role in brain tumor detection. Neural network is creating a well-organized rule for classification. To accomplish medical image data, neural network is trained to use the Convolution algorithm. Multilayer perceptron is intended for identification of a image. In this study article, the brain images are categorized into two types: normal and abnormal. This article emphasize the importance of classification and feature selection approach for predicting the brain tumor. This classification is done by machine learning techniques like Artificial Neural Networks, Support Vector Machine and Deep Neural Network. It could be noted that more than one technique can be applied for the segmentation of tumor. The several samples of brain tumor images are classified using deep learning algorithms, convolution neural network and multi-layer perceptron.

scholarly journals COMPARATIVE ANALYSIS AND EVALUATION OF THE APPLICATION OF DEEP LEARNING TECHNIQUES TO CYBERSECURITY DATASETS

10.6036/10007 ◽  
2021 ◽  
Vol 96 (5) ◽  
pp. 528-533
Author(s):  
XAVIER LARRIVA NOVO ◽  
MARIO VEGA BARBAS ◽  
VICTOR VILLAGRA ◽  
JULIO BERROCAL
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
High Performance ◽  
New Technologies ◽  
Short Term Memory ◽  
Machine Learning Techniques ◽  
Short Term ◽  
Term Memory ◽  
Learning Techniques ◽  
Long Short Term Memory

Cybersecurity has stood out in recent years with the aim of protecting information systems. Different methods, techniques and tools have been used to make the most of the existing vulnerabilities in these systems. Therefore, it is essential to develop and improve new technologies, as well as intrusion detection systems that allow detecting possible threats. However, the use of these technologies requires highly qualified cybersecurity personnel to analyze the results and reduce the large number of false positives that these technologies presents in their results. Therefore, this generates the need to research and develop new high-performance cybersecurity systems that allow efficient analysis and resolution of these results. This research presents the application of machine learning techniques to classify real traffic, in order to identify possible attacks. The study has been carried out using machine learning tools applying deep learning algorithms such as multi-layer perceptron and long-short-term-memory. Additionally, this document presents a comparison between the results obtained by applying the aforementioned algorithms and algorithms that are not deep learning, such as: random forest and decision tree. Finally, the results obtained are presented, showing that the long-short-term-memory algorithm is the one that provides the best results in relation to precision and logarithmic loss.

scholarly journals Comparison of machine learning and deep learning techniques in promoter prediction across diverse species

2021 ◽  
Vol 7 ◽  
pp. e365
Author(s):  
Nikita Bhandari ◽  
Satyajeet Khare ◽  
Rahee Walambe ◽  
Ketan Kotecha
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Short Term Memory ◽  
Regulatory Elements ◽  
Gene Promoters ◽  
Promoter Prediction ◽  
Promoter Sequences ◽  
Learning Techniques

Gene promoters are the key DNA regulatory elements positioned around the transcription start sites and are responsible for regulating gene transcription process. Various alignment-based, signal-based and content-based approaches are reported for the prediction of promoters. However, since all promoter sequences do not show explicit features, the prediction performance of these techniques is poor. Therefore, many machine learning and deep learning models have been proposed for promoter prediction. In this work, we studied methods for vector encoding and promoter classification using genome sequences of three distinct higher eukaryotes viz. yeast (Saccharomyces cerevisiae), A. thaliana (plant) and human (Homo sapiens). We compared one-hot vector encoding method with frequency-based tokenization (FBT) for data pre-processing on 1-D Convolutional Neural Network (CNN) model. We found that FBT gives a shorter input dimension reducing the training time without affecting the sensitivity and specificity of classification. We employed the deep learning techniques, mainly CNN and recurrent neural network with Long Short Term Memory (LSTM) and random forest (RF) classifier for promoter classification at k-mer sizes of 2, 4 and 8. We found CNN to be superior in classification of promoters from non-promoter sequences (binary classification) as well as species-specific classification of promoter sequences (multiclass classification). In summary, the contribution of this work lies in the use of synthetic shuffled negative dataset and frequency-based tokenization for pre-processing. This study provides a comprehensive and generic framework for classification tasks in genomic applications and can be extended to various classification problems.

Deep Learning Approaches for Textual Sentiment Analysis

2020 ◽  
pp. 171-182 ◽  
Author(s):  
Tamanna Sharma ◽  
Anu Bajaj ◽  
Om Prakash Sangwan
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Natural Language Processing ◽  
Natural Language ◽  
Sentiment Analysis ◽  
Language Processing ◽  
Machine Learning Techniques ◽  
Computational Technique ◽  
Learning Techniques

Sentiment analysis is computational measurement of attitude, opinions, and emotions (like positive/negative) with the help of text mining and natural language processing of words and phrases. Incorporation of machine learning techniques with natural language processing helps in analysing and predicting the sentiments in more precise manner. But sometimes, machine learning techniques are incapable in predicting sentiments due to unavailability of labelled data. To overcome this problem, an advanced computational technique called deep learning comes into play. This chapter highlights latest studies regarding use of deep learning techniques like convolutional neural network, recurrent neural network, etc. in sentiment analysis.

scholarly journals Fault Diagnosis of Gearbox using Machine Learning and Deep Learning Techniques

2019 ◽  
Vol 9 (1) ◽  
pp. 3940-3943
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Fault Diagnosis ◽  
Maintenance Cost ◽  
Support Vector ◽  
Machine Condition Monitoring ◽  
Learning Techniques ◽  
Catastrophic Failures ◽  
Better Than

Gearbox is an important component used for automobiles, machine tools, industries etc. Failure of any component in gearbox will cause huge maintenance cost and production loss. Failure should be detected as early as possible in order to avoid sudden breakdown which even cause catastrophic failures. Vibration signals are used for machine condition monitoring for predictive maintenance and efficiently predicts fault in the gearbox. In this paper signals from vibration is used for diagnosis of gearbox fault. The experiment uses four different conditions of gearbox in four different load conditions. Then statistical feature extraction is done and obtained result is given to Decision Tree, Support Vector Machine (SVM), Convolutional Neural Network (CNN) and Deep Neural Network (DNN) for fault diagnosis. The efficiency of these four techniques is compared and shows that machine learning is better than deep learning in gearbox fault diagnosis.

scholarly journals Machine Learning in Agriculture Application: Algorithms and Techniques

2020 ◽  
Vol 9 (6) ◽  
pp. 1140-1146
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
High Performance ◽  
Network Models ◽  
Processing Technique ◽  
Machine Learning Techniques ◽  
Image Processing Technique ◽  
Neural Network Models ◽  
Survey Paper ◽  
Learning Techniques

Machine learning techniques with high performance computing technologies can create various new opportunities in the agriculture domain. This paper does comprehensivereview of various papers which are concentrating on machine learning (ML) and deep learning application in agriculture. This paper is categorized into three sections a) Yield prediction using machine learning technique b) Price prediction c) Leaf disease detection using neural networks. In this paper we study the comparison of neural network models with existing models. The findings of this survey paper indicate Deep learning models give high accuracy and outperform traditional image processing technique and ML techniques outperforms various traditional techniques in prediction.

Deep Learning Approach for Extracting Catch Phrases from Legal Documents

2020 ◽  
pp. 143-158
Author(s):  
Kayalvizhi S. ◽  
Thenmozhi D.
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Deep Learning ◽  
Statistical Methods ◽  
Deep Neural Network ◽  
Mean Average Precision ◽  
Machine Learning Techniques ◽  
Learning Approach ◽  
Legal Documents ◽  
Learning Techniques

Catch phrases are the important phrases that precisely explain the document. They represent the context of the whole document. They can also be used to retrieve relevant prior cases by the judges and lawyers for assuring justice in the domain of law. Currently, catch phrases are extracted using statistical methods, machine learning techniques, and deep learning techniques. The authors propose a sequence to sequence (Seq2Seq) deep neural network to extract catch phrases from legal documents. They have employed several layers, namely embedding layer, encoder-decoder layer, projection layer, and loss layer to build the deep neural network. The methodology is evaluated on IRLeD@FIRE-2017 dataset and the method has obtained 0.787 and 0.607 as mean average precision and recall scores respectively. Results show that the proposed method outperforms the existing systems.

Sign in / Sign up

Export Citation Format

Share Document