scholarly journals Deep Learning Control for Digital Feedback Systems: Improved Performance with Robustness against Parameter Change

Electronics ◽  
2021 ◽  
Vol 10 (11) ◽  
pp. 1245
Author(s):  
Nuha A. S. Alwan ◽  
Zahir M. Hussain
Keyword(s):  
Deep Learning ◽  
Reference Signal ◽  
Training Data ◽  
Future Research ◽  
Digital Control System ◽  
Parameter Change ◽  
Feedback Systems ◽  
Unit Step ◽  
System Output ◽  
Improved Performance

Training data for a deep learning (DL) neural network (NN) controller are obtained from the input and output signals of a conventional digital controller that is designed to provide the suitable control signal to a specified plant within a feedback digital control system. It is found that if the DL controller is sufficiently deep (four hidden layers), it can outperform the conventional controller in terms of settling time of the system output transient response to a unit-step reference signal. That is, the DL controller introduces a damping effect. Moreover, it does not need to be retrained to operate with a reference signal of different magnitude, or under system parameter change. Such properties make the DL control more attractive for applications that may undergo parameter variation, such as sensor networks. The promising results of robustness against parameter changes are calling for future research in the direction of robust DL control.

scholarly journals Deep Learning Control for Digital Feedback Systems: Improved Performance with Robustness against Parameter Change

2021 ◽  
Author(s):  
Nuha A. S. Alwan ◽  
Zahir M. Hussain
Keyword(s):  
Deep Learning ◽  
Reference Signal ◽  
Training Data ◽  
Digital Controller ◽  
Digital Control System ◽  
Parameter Change ◽  
Feedback Systems ◽  
Unit Step ◽  
System Output ◽  
Improved Performance

Training data for a deep learning (DL) neural network (NN) controller are obtained from the input and output signals of a conventional digital controller that is designed to provide the suitable control signal to a specified plant within a feedback digital control system. It is found that if the DL controller is sufficiently deep (four hidden layers), it can outperform the conventional controller in terms of settling time of the system output transient response to a unit-step reference signal. That is, the DL controller introduces a damping effect. Moreover, it does not need to be retrained to operate with a reference signal of different magnitude, or under system parameter change. Such properties make the DL control more attractive for applications that may undergo parameter variation, like sensor networks.

scholarly journals Examining Deep Learning Architectures for Crime Classification and Prediction

Forecasting ◽  
2021 ◽  
Vol 3 (4) ◽  
pp. 741-762
Author(s):  
Panagiotis Stalidis ◽  
Theodoros Semertzidis ◽  
Petros Daras
Keyword(s):  
Deep Learning ◽  
State Of The Art ◽  
Open Data ◽  
Training Data ◽  
Crime Prediction ◽  
Crime Types ◽  
Improved Performance ◽  
Learning Architectures ◽  
And Training ◽  
Crime Classification

In this paper, a detailed study on crime classification and prediction using deep learning architectures is presented. We examine the effectiveness of deep learning algorithms in this domain and provide recommendations for designing and training deep learning systems for predicting crime areas, using open data from police reports. Having time-series of crime types per location as training data, a comparative study of 10 state-of-the-art methods against 3 different deep learning configurations is conducted. In our experiments with 5 publicly available datasets, we demonstrate that the deep learning-based methods consistently outperform the existing best-performing methods. Moreover, we evaluate the effectiveness of different parameters in the deep learning architectures and give insights for configuring them to achieve improved performance in crime classification and finally crime prediction.

scholarly journals Representation Learning for Motor Imagery Recognition with Deep Neural Network

Electronics ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 112
Author(s):  
Fangzhou Xu ◽  
Fenqi Rong ◽  
Yunjing Miao ◽  
Yanan Sun ◽  
Gege Dong ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Motor Imagery ◽  
Learning Algorithm ◽  
Representation Learning ◽  
Training Data ◽  
Gradient Boosting ◽  
Future Research ◽  
Deep Learning Algorithm ◽  
The Brain

This study describes a method for classifying electrocorticograms (ECoGs) based on motor imagery (MI) on the brain–computer interface (BCI) system. This method is different from the traditional feature extraction and classification method. In this paper, the proposed method employs the deep learning algorithm for extracting features and the traditional algorithm for classification. Specifically, we mainly use the convolution neural network (CNN) to extract the features from the training data and then classify those features by combing with the gradient boosting (GB) algorithm. The comprehensive study with CNN and GB algorithms will profoundly help us to obtain more feature information from brain activities, enabling us to obtain the classification results from human body actions. The performance of the proposed framework has been evaluated on the dataset I of BCI Competition III. Furthermore, the combination of deep learning and traditional algorithms provides some ideas for future research with the BCI systems.

scholarly journals Weak Supervision for Fake News Detection via Reinforcement Learning

2020 ◽  
Vol 34 (01) ◽  
pp. 516-523 ◽  
Author(s):  
Yaqing Wang ◽  
Weifeng Yang ◽  
Fenglong Ma ◽  
Jin Xu ◽  
Bin Zhong ◽  
...  
Keyword(s):  
Social Media ◽  
Deep Learning ◽  
Reinforcement Learning ◽  
Primary Source ◽  
Training Data ◽  
Fake News ◽  
High Quality ◽  
Weak Supervision ◽  
Social Media Platforms ◽  
Improved Performance

Today social media has become the primary source for news. Via social media platforms, fake news travel at unprecedented speeds, reach global audiences and put users and communities at great risk. Therefore, it is extremely important to detect fake news as early as possible. Recently, deep learning based approaches have shown improved performance in fake news detection. However, the training of such models requires a large amount of labeled data, but manual annotation is time-consuming and expensive. Moreover, due to the dynamic nature of news, annotated samples may become outdated quickly and cannot represent the news articles on newly emerged events. Therefore, how to obtain fresh and high-quality labeled samples is the major challenge in employing deep learning models for fake news detection. In order to tackle this challenge, we propose a reinforced weakly-supervised fake news detection framework, i.e., WeFEND, which can leverage users' reports as weak supervision to enlarge the amount of training data for fake news detection. The proposed framework consists of three main components: the annotator, the reinforced selector and the fake news detector. The annotator can automatically assign weak labels for unlabeled news based on users' reports. The reinforced selector using reinforcement learning techniques chooses high-quality samples from the weakly labeled data and filters out those low-quality ones that may degrade the detector's prediction performance. The fake news detector aims to identify fake news based on the news content. We tested the proposed framework on a large collection of news articles published via WeChat official accounts and associated user reports. Extensive experiments on this dataset show that the proposed WeFEND model achieves the best performance compared with the state-of-the-art methods.

scholarly journals Deep Learning on 1-D Biosignals: a Taxonomy-based Survey

2018 ◽  
Vol 27 (01) ◽  
pp. 098-109 ◽  
Author(s):  
Nagarajan Ganapathy ◽  
Ramakrishnan Swaminathan ◽  
Thomas Deserno
Keyword(s):  
Deep Learning ◽  
Electrodermal Activity ◽  
Ground Truth ◽  
Training Data ◽  
Future Research ◽  
Learning Models ◽  
Restricted Boltzmann Machines ◽  
Ground Truth Data ◽  
Large Variability ◽  
Learning Techniques

Objectives: Deep learning models such as convolutional neural networks (CNNs) have been applied successfully to medical imaging, but biomedical signal analysis has yet to fully benefit from this novel approach. Our survey aims at (i) reviewing deep learning techniques for biosignal analysis in computer- aided diagnosis; and (ii) deriving a taxonomy for organizing the growing number of applications in the field. Methods: A comprehensive literature research was performed using PubMed, Scopus, and ACM. Deep learning models were classified with respect to the (i) origin, (ii) dimension, and (iii) type of the biosignal as input to the deep learning model; (iv) the goal of the application; (v) the size and (vi) type of ground truth data; (vii) the type and (viii) schedule of learning the network; and (ix) the topology of the model. Results: Between January 2010 and December 2017, a total 71 papers were published on the topic. The majority (n = 36) of papers are on electrocariography (ECG) signals. Most applications (n = 25) aim at detection of patterns, while only a few (n = 6) at predection of events. Out of 36 ECG-based works, many (n = 17) relate to multi-lead ECG. Other biosignals that have been identified in the survey are electromyography, phonocardiography, photoplethysmography, electrooculography, continuous glucose monitoring, acoustic respiratory signal, blood pressure, and electrodermal activity signal, while ballistocardiography or seismocardiography have yet to be analyzed using deep learning techniques. In supervised and unsupervised applications, CNNs and restricted Boltzmann machines are the most and least frequently used, (n = 34) and (n = 15), respectively. Conclusion: Our key-code classification of relevant papers was used to cluster the approaches that have been published to date and demonstrated a large variability of research with respect to data, application, and network topology. Future research is expected to focus on the standardization of deep learning architectures and on the optimization of the network parameters to increase performance and robustness. Furthermore, application-driven approaches and updated training data from mobile recordings are needed.

scholarly journals Sequence-to-function deep learning frameworks for engineered riboregulators

2020 ◽  
Vol 11 (1) ◽  
Author(s):  
Jacqueline A. Valeri ◽  
Katherine M. Collins ◽  
Pradeep Ramesh ◽  
Miguel A. Alcantar ◽  
Bianca A. Lepe ◽  
...  
Keyword(s):  
Computer Vision ◽  
Deep Learning ◽  
Nucleic Acid ◽  
Language Processing ◽  
Training Data ◽  
Design Rules ◽  
Improved Performance ◽  
Circuit Components ◽  
Learning Frameworks ◽  
Learning Architectures

Abstract While synthetic biology has revolutionized our approaches to medicine, agriculture, and energy, the design of completely novel biological circuit components beyond naturally-derived templates remains challenging due to poorly understood design rules. Toehold switches, which are programmable nucleic acid sensors, face an analogous design bottleneck; our limited understanding of how sequence impacts functionality often necessitates expensive, time-consuming screens to identify effective switches. Here, we introduce Sequence-based Toehold Optimization and Redesign Model (STORM) and Nucleic-Acid Speech (NuSpeak), two orthogonal and synergistic deep learning architectures to characterize and optimize toeholds. Applying techniques from computer vision and natural language processing, we ‘un-box’ our models using convolutional filters, attention maps, and in silico mutagenesis. Through transfer-learning, we redesign sub-optimal toehold sensors, even with sparse training data, experimentally validating their improved performance. This work provides sequence-to-function deep learning frameworks for toehold selection and design, augmenting our ability to construct potent biological circuit components and precision diagnostics.

Clinical dilemmas of routine outcome monitoring and clinical feedback: a qualitative study of patient experiences

2020 ◽  
Author(s):  
Stig Magne Solstad ◽  
Gøril Kleiven Solberg ◽  
Louis George Castonguay ◽  
Christian Moltu
Keyword(s):  
Mental Health ◽  
Clinical Skill ◽  
Routine Outcome Monitoring ◽  
Future Research ◽  
Successful Implementation ◽  
Basic Training ◽  
Feedback Systems ◽  
Clinical Encounters ◽  
Outcome Monitoring ◽  
Clinical Feedback

Purpose: Routine outcome monitoring (ROM) and clinical feedback systems (CFS) are becoming prevalent in mental health services. The field faces several challenges to successful implementation. The purpose of this study is to gain a better understanding of these challenges by exploring the patient perspective. Method: We report the findings from a qualitative, video assisted interview study of 12 patients from a Norwegian mental health outpatient clinic using ROM/CFS. Results: Our analysis resulted in three pairs of opposing experiences with using ROM/CFS: 1) Explicit vs. implicit use of CFS information, 2) CFS directing focus towards- vs. directing focus away from therapeutic topics and 3) Giving vs. receiving feedback. None of these were intrinsically helpful or hindering. Participants had vastly differing preferences for how to use ROM/CFS in clinical encounters, but all needed the information to be used in a meaningful way by their therapists. If not, ROM/CFS was at risk of becoming meaningless and hindering for therapy. Conclusion: These findings confirm and provide further nuance to previous research. We propose to consider ROM/CFS a clinical skill that should be a part of basic training for therapists. How to use and implement ROM/CFS skillfully should also be the focus of future research.

Android Malware Detection Techniques: A Literature Review

2020 ◽  
Vol 14 ◽  
Author(s):  
Meghna Dhalaria ◽  
Ekta Gandotra
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Malware Detection ◽  
Future Research ◽  
Android Malware ◽  
Detection Techniques ◽  
Android Malware Detection ◽  
Future Research Directions ◽  
To Come ◽  
Tools And Techniques

Purpose: This paper provides the basics of Android malware, its evolution and tools and techniques for malware analysis. Its main aim is to present a review of the literature on Android malware detection using machine learning and deep learning and identify the research gaps. It provides the insights obtained through literature and future research directions which could help researchers to come up with robust and accurate techniques for classification of Android malware. Design/Methodology/Approach: This paper provides a review of the basics of Android malware, its evolution timeline and detection techniques. It includes the tools and techniques for analyzing the Android malware statically and dynamically for extracting features and finally classifying these using machine learning and deep learning algorithms. Findings: The number of Android users is expanding very fast due to the popularity of Android devices. As a result, there are more risks to Android users due to the exponential growth of Android malware. On-going research aims to overcome the constraints of earlier approaches for malware detection. As the evolving malware are complex and sophisticated, earlier approaches like signature based and machine learning based are not able to identify these timely and accurately. The findings from the review shows various limitations of earlier techniques i.e. requires more detection time, high false positive and false negative rate, low accuracy in detecting sophisticated malware and less flexible. Originality/value: This paper provides a systematic and comprehensive review on the tools and techniques being employed for analysis, classification and identification of Android malicious applications. It includes the timeline of Android malware evolution, tools and techniques for analyzing these statically and dynamically for the purpose of extracting features and finally using these features for their detection and classification using machine learning and deep learning algorithms. On the basis of the detailed literature review, various research gaps are listed. The paper also provides future research directions and insights which could help researchers to come up with innovative and robust techniques for detecting and classifying the Android malware.

scholarly journals Siamese Reconstruction Network: Accurate Image Reconstruction from Human Brain Activity by Learning to Compare

2019 ◽  
Vol 9 (22) ◽  
pp. 4749
Author(s):  
Lingyun Jiang ◽  
Kai Qiao ◽  
Linyuan Wang ◽  
Chi Zhang ◽  
Jian Chen ◽  
...  
Keyword(s):  
Deep Learning ◽  
Human Brain ◽  
Brain Activity ◽  
Feature Space ◽  
Training Data ◽  
Reconstruction Method ◽  
Learning Method ◽  
Training Samples ◽  
Visual Reconstruction ◽  
Relationship Of

Decoding human brain activities, especially reconstructing human visual stimuli via functional magnetic resonance imaging (fMRI), has gained increasing attention in recent years. However, the high dimensionality and small quantity of fMRI data impose restrictions on satisfactory reconstruction, especially for the reconstruction method with deep learning requiring huge amounts of labelled samples. When compared with the deep learning method, humans can recognize a new image because our human visual system is naturally capable of extracting features from any object and comparing them. Inspired by this visual mechanism, we introduced the mechanism of comparison into deep learning method to realize better visual reconstruction by making full use of each sample and the relationship of the sample pair by learning to compare. In this way, we proposed a Siamese reconstruction network (SRN) method. By using the SRN, we improved upon the satisfying results on two fMRI recording datasets, providing 72.5% accuracy on the digit dataset and 44.6% accuracy on the character dataset. Essentially, this manner can increase the training data about from n samples to 2n sample pairs, which takes full advantage of the limited quantity of training samples. The SRN learns to converge sample pairs of the same class or disperse sample pairs of different class in feature space.

scholarly journals Application of deep learning in detecting neurological disorders from magnetic resonance images: a survey on the detection of Alzheimer’s disease, Parkinson’s disease and schizophrenia

2020 ◽  
Vol 7 (1) ◽  
Author(s):  
Manan Binth Taj Noor ◽  
Nusrat Zerin Zenia ◽  
M Shamim Kaiser ◽  
Shamim Al Mamun ◽  
Mufti Mahmud
Keyword(s):  
Alzheimer’S Disease ◽  
Parkinson’S Disease ◽  
Alzheimer's Disease ◽  
Parkinson's Disease ◽  
Deep Learning ◽  
Magnetic Resonance ◽  
Neurological Disorders ◽  
Magnetic Resonance Images ◽  
Future Research ◽  
Comparative Performance

Abstract Neuroimaging, in particular magnetic resonance imaging (MRI), has been playing an important role in understanding brain functionalities and its disorders during the last couple of decades. These cutting-edge MRI scans, supported by high-performance computational tools and novel ML techniques, have opened up possibilities to unprecedentedly identify neurological disorders. However, similarities in disease phenotypes make it very difficult to detect such disorders accurately from the acquired neuroimaging data. This article critically examines and compares performances of the existing deep learning (DL)-based methods to detect neurological disorders—focusing on Alzheimer’s disease, Parkinson’s disease and schizophrenia—from MRI data acquired using different modalities including functional and structural MRI. The comparative performance analysis of various DL architectures across different disorders and imaging modalities suggests that the Convolutional Neural Network outperforms other methods in detecting neurological disorders. Towards the end, a number of current research challenges are indicated and some possible future research directions are provided.

Sign in / Sign up

Export Citation Format

Share Document