scholarly journals A Demand-Side Load Event Detection Algorithm Based on Wide-Deep Neural Networks and Randomized Sparse Backpropagation

2021 ◽  
Vol 9 ◽  
Author(s):  
Chen Li ◽  
Gaoqi Liang ◽  
Huan Zhao ◽  
Guo Chen
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Deep Learning ◽  
Event Detection ◽  
Detection Algorithm ◽  
Demand Side ◽  
Rule Based ◽  
Detection Algorithms ◽  
Deep Model ◽  
Conventional Machine

Event detection is an important application in demand-side management. Precise event detection algorithms can improve the accuracy of non-intrusive load monitoring (NILM) and energy disaggregation models. Existing event detection algorithms can be divided into four categories: rule-based, statistics-based, conventional machine learning, and deep learning. The rule-based approach entails hand-crafted feature engineering and carefully calibrated thresholds; the accuracies of statistics-based and conventional machine learning methods are inferior to the deep learning algorithms due to their limited ability to extract complex features. Deep learning models require a long training time and are hard to interpret. This paper proposes a novel algorithm for load event detection in smart homes based on wide and deep learning that combines the convolutional neural network (CNN) and the soft-max regression (SMR). The deep model extracts the power time series patterns and the wide model utilizes the percentile information of the power time series. A randomized sparse backpropagation (RSB) algorithm for weight filters is proposed to improve the robustness of the standard wide-deep model. Compared to the standard wide-deep, pure CNN, and SMR models, the hybrid wide-deep model powered by RSB demonstrates its superiority in terms of accuracy, convergence speed, and robustness.

scholarly journals Posture Recognition Using Ensemble Deep Models under Various Home Environments

2020 ◽  
Vol 10 (4) ◽  
pp. 1287
Author(s):  
Yeong-Hyeon Byeon ◽  
Jae-Yeon Lee ◽  
Do-Hyung Kim ◽  
Keun-Chang Kwak
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Elderly People ◽  
The Body ◽  
Living Alone ◽  
Home Environments ◽  
Deep Model ◽  
Combination Methods ◽  
Conventional Machine ◽  
Posture Recognition

This paper is concerned with posture recognition using ensemble convolutional neural networks (CNNs) in home environments. With the increasing number of elderly people living alone at home, posture recognition is very important for helping elderly people cope with sudden danger. Traditionally, to recognize posture, it was necessary to obtain the coordinates of the body points, depth, frame information of video, and so on. In conventional machine learning, there is a limitation in recognizing posture directly using only an image. However, with advancements in the latest deep learning, it is possible to achieve good performance in posture recognition using only an image. Thus, we performed experiments based on VGGNet, ResNet, DenseNet, InceptionResNet, and Xception as pre-trained CNNs using five types of preprocessing. On the basis of these deep learning methods, we finally present the ensemble deep model combined by majority and average methods. The experiments were performed by a posture database constructed at the Electronics and Telecommunications Research Institute (ETRI), Korea. This database consists of 51,000 images with 10 postures from 51 home environments. The experimental results reveal that the ensemble system by InceptionResNetV2s with five types of preprocessing shows good performance in comparison to other combination methods and the pre-trained CNN itself.

Deep Learning for text in limted data settings

2020 ◽  
Author(s):  
Pathikkumar Patel ◽  
Bhargav Lad ◽  
Jinan Fiaidhi
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Deep Learning ◽  
Sentiment Analysis ◽  
Transfer Learning ◽  
Text Classification ◽  
State Of The Art ◽  
Time Series Forecasting ◽  
Text Data ◽  
Performance Levels

During the last few years, RNN models have been extensively used and they have proven to be better for sequence and text data. RNNs have achieved state-of-the-art performance levels in several applications such as text classification, sequence to sequence modelling and time series forecasting. In this article we will review different Machine Learning and Deep Learning based approaches for text data and look at the results obtained from these methods. This work also explores the use of transfer learning in NLP and how it affects the performance of models on a specific application of sentiment analysis.

Transfer learning based convolution neural net for authentication and classification of emotions from natural and stimulated speech signals

2021 ◽  
pp. 1-12
Author(s):  
Mukul Kumar ◽  
Nipun Katyal ◽  
Nersisson Ruban ◽  
Elena Lyakso ◽  
A. Mary Mekala ◽  
...  
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Transfer Learning ◽  
Research Work ◽  
Oral Communication ◽  
Neural Net ◽  
Emotion Classification ◽  
Style Transfer ◽  
Conventional Machine ◽  
Neural Network Algorithm

Over the years the need for differentiating various emotions from oral communication plays an important role in emotion based studies. There have been different algorithms to classify the kinds of emotion. Although there is no measure of fidelity of the emotion under consideration, which is primarily due to the reason that most of the readily available datasets that are annotated are produced by actors and not generated in real-world scenarios. Therefore, the predicted emotion lacks an important aspect called authenticity, which is whether an emotion is actual or stimulated. In this research work, we have developed a transfer learning and style transfer based hybrid convolutional neural network algorithm to classify the emotion as well as the fidelity of the emotion. The model is trained on features extracted from a dataset that contains stimulated as well as actual utterances. We have compared the developed algorithm with conventional machine learning and deep learning techniques by few metrics like accuracy, Precision, Recall and F1 score. The developed model performs much better than the conventional machine learning and deep learning models. The research aims to dive deeper into human emotion and make a model that understands it like humans do with precision, recall, F1 score values of 0.994, 0.996, 0.995 for speech authenticity and 0.992, 0.989, 0.99 for speech emotion classification respectively.

scholarly journals Pedestrian detection algorithm in traffic scene based on weakly supervised hierarchical deep model

2016 ◽  
Vol 14 (1) ◽  
pp. 172988141769231 ◽  
Author(s):  
Yingfeng Cai ◽  
Youguo He ◽  
Hai Wang ◽  
Xiaoqiang Sun ◽  
Long Chen ◽  
...  
Keyword(s):  
Deep Learning ◽  
Pedestrian Detection ◽  
Recognition Rate ◽  
Detection Algorithm ◽  
Training Methods ◽  
Two Dimensional ◽  
Data Set ◽  
Deep Model ◽  
Unsupervised Training ◽  
Weakly Supervised

The emergence and development of deep learning theory in machine learning field provide new method for visual-based pedestrian recognition technology. To achieve better performance in this application, an improved weakly supervised hierarchical deep learning pedestrian recognition algorithm with two-dimensional deep belief networks is proposed. The improvements are made by taking into consideration the weaknesses of structure and training methods of existing classifiers. First, traditional one-dimensional deep belief network is expanded to two-dimensional that allows image matrix to be loaded directly to preserve more information of a sample space. Then, a determination regularization term with small weight is added to the traditional unsupervised training objective function. By this modification, original unsupervised training is transformed to weakly supervised training. Subsequently, that gives the extracted features discrimination ability. Multiple sets of comparative experiments show that the performance of the proposed algorithm is better than other deep learning algorithms in recognition rate and outperforms most of the existing state-of-the-art methods in non-occlusion pedestrian data set while performs fair in weakly and heavily occlusion data set.

scholarly journals Implementation of IoT Framework with Data Analysis Using Deep Learning Methods for Occupancy Prediction in a Building

2021 ◽  
Vol 13 (3) ◽  
pp. 67
Author(s):  
Eric Hitimana ◽  
Gaurav Bajpai ◽  
Richard Musabe ◽  
Louis Sibomana ◽  
Jayavel Kayalvizhi
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Deep Learning ◽  
Time Series Data ◽  
Multivariate Time Series ◽  
Machine Learning Algorithms ◽  
Series Data ◽  
Support Vector ◽  
Human Beings ◽  
Feed Forward Network

Many countries worldwide face challenges in controlling building incidence prevention measures for fire disasters. The most critical issues are the localization, identification, detection of the room occupant. Internet of Things (IoT) along with machine learning proved the increase of the smartness of the building by providing real-time data acquisition using sensors and actuators for prediction mechanisms. This paper proposes the implementation of an IoT framework to capture indoor environmental parameters for occupancy multivariate time-series data. The application of the Long Short Term Memory (LSTM) Deep Learning algorithm is used to infer the knowledge of the presence of human beings. An experiment is conducted in an office room using multivariate time-series as predictors in the regression forecasting problem. The results obtained demonstrate that with the developed system it is possible to obtain, process, and store environmental information. The information collected was applied to the LSTM algorithm and compared with other machine learning algorithms. The compared algorithms are Support Vector Machine, Naïve Bayes Network, and Multilayer Perceptron Feed-Forward Network. The outcomes based on the parametric calibrations demonstrate that LSTM performs better in the context of the proposed application.

scholarly journals STABILIZATION OF SENTINEL-1 SAR TIME-SERIES USING CLIMATE AND FOREST STRUCTURE DATA FOR EARLY TROPICAL DEFORESTATION DETECTION

2020 ◽  
Vol V-3-2020 ◽  
pp. 89-96
Author(s):  
J. Doblas ◽  
A. Carneiro ◽  
Y. Shimabukuro ◽  
S. Sant’Anna ◽  
L. Aragão ◽  
...  
Keyword(s):  
Time Series ◽  
Forest Structure ◽  
Detection Algorithm ◽  
Structure Information ◽  
Detection Algorithms ◽  
Alternative State ◽  
Level Data ◽  
Relevant Variables ◽  
Long Time ◽  
Omission Errors

Abstract. In this study we analyse the factors of variability of Sentinel-1 C-band radar backscattering over tropical rainforests, and propose a method to reduce the effects of this variability on deforestation detection algorithms. To do so, we developed a random forest regression model that relates Sentinel-1 gamma nought values with local climatological data and forest structure information. The model was trained using long time-series of 26 relevant variables, sampled over 6 undisturbed tropical forests areas. The resulting model explained 71.64% and 73.28% of the SAR signal variability for VV and VH polarizations, respectively. Once the best model for every polarization was selected, it was used to stabilize extracted pixel-level data of forested and non-deforested areas, which resulted on a 10 to 14% reduction of time-series variability, in terms of standard deviation. Then a statistically robust deforestation detection algorithm was applied to the stabilized time-series. The results show that the proposed method reduced the rate of false positives on both polarizations, especially on VV (from 21% to 2%, α=0.01). Meanwhile, the omission errors increased on both polarizations (from 27% to 37% in VV and from 27% to 33% on VV, α=0.01). The proposed method yielded slightly better results when compared with an alternative state-of-the-art approach (spatial normalization).

Combing empirical matched field processing at IMS station SPITS and convolutional neural networks for calving event detection in Svalbard

2021 ◽  
Author(s):  
Andreas Köhler ◽  
Steffen Mæland
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Time Series ◽  
Convolutional Neural Networks ◽  
Event Detection ◽  
The Arctic ◽  
Beam Power ◽  
Seismic Events ◽  
Tidewater Glaciers ◽  
Seismic Arrays

<p>We combine the empirical matched field (EMF) method and machine learning using Convolutional Neural Networks (CNNs) for calving event detection at the IMS station SPITS and GSN station KBS on the Arctic Archipelago of Svalbard. EMF detection with seismic arrays seeks to identify all signals similar to a single template generated by seismic events in a confined target region. In contrast to master event cross-correlation detectors, the detection statistic is not the waveform similarity, but the array beam power obtained using empirical phase delays (steering parameters) between the array stations. Unlike common delay-and-sum beamforming, the steering parameters do not need to represent a plane wave and are directly computed from the template signal without assuming a particular apparent velocity and back-azimuth. As for all detectors, the false alarms rate depends strongly on the beam power threshold setting and therefore needs appropriate tuning or alternatively post-processing. Here, we combine the EMF detector using a low detection threshold with a post-detection classification step. The classifier uses spectrograms of single-station three-component records and state-of-the-art CNNs pre-trained for image recognition. Spectrograms of three-component seismic data are hereby combined as RGB images. We apply the methodology to detect calving events at tidewater glaciers in the Kongsfjord region in Northwestern Svalbard. The EMF detector uses data of the SPITS array, at about 100 km distance to the glaciers, while the CNN classifier processes data from the single three-component station KBS at 15 km distance using time windows where the event is expected according to the EMF detection. The EMF detector combines templates for the P and for the S wave onsets of a confirmed, large calving event. The CNN spectrogram classifier is trained using classes of confirmed calving signals from four different glaciers in the Kongsfjord region, seismic noise examples, and regional tectonic seismic events. By splitting the data into training and test data set, the CNN classifier yields a recognition rate of 89% on average. This is encouragingly high given the complex nature of calving signals and their visually similar waveforms. Subsequently, we process continuous data of 6 months in 2016 using the EMF-CNN method to produce a time series of glacier calving. About 90% of the confirmed calving signals used for the CNN training are detected by EMF processing, and around 80% are assigned to the correct glacier after CNN classification. Such calving time series allow us to estimate and monitor ice loss at tidewater glaciers which in turn can help to better understand the impact of climate change in Polar regions. Combining the superior detection capability of (less common) seismic arrays at a larger source distance with a powerful machine learning classifier at single three-component stations closer to the source, is a promising approach not only for environmental monitoring, but also for event detection and classification in a CTBTO verification context.</p>

Deep Learning and Medical Imaging

2019 ◽  
pp. 101-147
Author(s):  
Nourhan Mohamed Zayed ◽  
Heba A. Elnemr
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Medical Imaging ◽  
Medical Image Analysis ◽  
Future Research ◽  
Research Directions ◽  
Conventional Machine ◽  
Future Research Directions ◽  
Nested Hierarchy ◽  
Great Potency

Deep learning (DL) is a special type of machine learning that attains great potency and flexibility by learning to represent input raw data as a nested hierarchy of essences and representations. DL consists of more layers than conventional machine learning that permit higher levels of abstractions and improved prediction from data. More abstract representations computed in terms of less abstract ones. The goal of this chapter is to present an intensive survey of existing literature on DL techniques over the last years especially in the medical imaging analysis field. All these techniques and algorithms have their points of interest and constraints. Thus, analysis of various techniques and transformations, submitted prior in writing, for plan and utilization of DL methods from medical image analysis prospective will be discussed. The authors provide future research directions in DL area and set trends and identify challenges in the medical imaging field. Furthermore, as quantity of medicinal application demands increase, an extended study and investigation in DL area becomes very significant.

scholarly journals Content Noise Detection Model Using Deep Learning in Web Forums

2020 ◽  
Vol 12 (12) ◽  
pp. 5074
Author(s):  
Jiyoung Woo ◽  
Jaeseok Yun
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Learning Model ◽  
Detection Model ◽  
Proposed Model ◽  
Web Forum ◽  
Web Forums ◽  
Conventional Machine ◽  
Text Features ◽  
Deep Learning Model

Spam posts in web forum discussions cause user inconvenience and lower the value of the web forum as an open source of user opinion. In this regard, as the importance of a web post is evaluated in terms of the number of involved authors, noise distorts the analysis results by adding unnecessary data to the opinion analysis. Here, in this work, an automatic detection model for spam posts in web forums using both conventional machine learning and deep learning is proposed. To automatically differentiate between normal posts and spam, evaluators were asked to recognize spam posts in advance. To construct the machine learning-based model, text features from posted content using text mining techniques from the perspective of linguistics were extracted, and supervised learning was performed to distinguish content noise from normal posts. For the deep learning model, raw text including and excluding special characters was utilized. A comparison analysis on deep neural networks using the two different recurrent neural network (RNN) models of the simple RNN and long short-term memory (LSTM) network was also performed. Furthermore, the proposed model was applied to two web forums. The experimental results indicate that the deep learning model affords significant improvements over the accuracy of conventional machine learning associated with text features. The accuracy of the proposed model using LSTM reaches 98.56%, and the precision and recall of the noise class reach 99% and 99.53%, respectively.

Sign in / Sign up

Export Citation Format

Share Document