scholarly journals A Survey on Deep Learning for Software Engineering

2021 ◽  
Author(s):  
Yanming Yang ◽  
Xin Xia ◽  
David Lo ◽  
John Grundy
Keyword(s):  
Deep Learning ◽  
Software Engineering ◽  
Data Representation ◽  
Optimization Techniques ◽  
Learning Ability ◽  
Data Types ◽  
Road Map ◽  
Problem Types ◽  
Learning Techniques ◽  
Improved Model

In 2006, Geoffrey Hinton proposed the concept of training “Deep Neural Networks (DNNs)” and an improved model training method to break the bottleneck of neural network development. More recently, the introduction of AlphaGo in 2016 demonstrated the powerful learning ability of deep learning and its enormous potential. Deep learning has been increasingly used to develop state-of-the-art software engineering (SE) research tools due to its ability to boost performance for various SE tasks. There are many factors, e.g., deep learning model selection, internal structure differences, and model optimization techniques, that may have an impact on the performance of DNNs applied in SE. Few works to date focus on summarizing, classifying, and analyzing the application of deep learning techniques in SE. To fill this gap, we performed a survey to analyze the relevant studies published since 2006. We first provide an example to illustrate how deep learning techniques are used in SE. We then conduct a background analysis (BA) of primary studies and present four research questions to describe the trend of DNNs used in SE (BA), summarize and classify different deep learning techniques (RQ1), analyze the data processing including data collection, data classification, data pre-processing, and data representation (RQ2). In RQ3, we depicted a range of key research topics using DNNs and investigated the relationships between DL-based model adoption and multiple factors (i.e., DL architectures, task types, problem types, and data types). We also summarized commonly used datasets for different SE tasks. In RQ4, we summarized the widely used optimization algorithms and provided important evaluation metrics for different problem types, including regression, classification, recommendation, and generation. Based on our findings, we present a set of current challenges remaining to be investigated and outline a proposed research road map highlighting key opportunities for future work.

scholarly journals Deep Learning in Mining Biological Data

2021 ◽  
Author(s):  
Mufti Mahmud ◽  
M. Shamim Kaiser ◽  
T. Martin McGinnity ◽  
Amir Hussain
Keyword(s):  
Pattern Recognition ◽  
Deep Learning ◽  
Meta Analysis ◽  
Biological Data ◽  
Machine Learning Techniques ◽  
Data Types ◽  
Multimodal Data ◽  
Data Intensive ◽  
Learning Techniques ◽  
Access Data

AbstractRecent technological advancements in data acquisition tools allowed life scientists to acquire multimodal data from different biological application domains. Categorized in three broad types (i.e. images, signals, and sequences), these data are huge in amount and complex in nature. Mining such enormous amount of data for pattern recognition is a big challenge and requires sophisticated data-intensive machine learning techniques. Artificial neural network-based learning systems are well known for their pattern recognition capabilities, and lately their deep architectures—known as deep learning (DL)—have been successfully applied to solve many complex pattern recognition problems. To investigate how DL—especially its different architectures—has contributed and been utilized in the mining of biological data pertaining to those three types, a meta-analysis has been performed and the resulting resources have been critically analysed. Focusing on the use of DL to analyse patterns in data from diverse biological domains, this work investigates different DL architectures’ applications to these data. This is followed by an exploration of available open access data sources pertaining to the three data types along with popular open-source DL tools applicable to these data. Also, comparative investigations of these tools from qualitative, quantitative, and benchmarking perspectives are provided. Finally, some open research challenges in using DL to mine biological data are outlined and a number of possible future perspectives are put forward.

scholarly journals Fast anther dehiscence state recognition system establishing by deep learning to screen heat tolerant cotton

2021 ◽  
Author(s):  
Zhihao Tan ◽  
Jiawei Shi ◽  
Rongjie Lv ◽  
Qingyuan Li ◽  
Jing Yang ◽  
...  
Keyword(s):  
Deep Learning ◽  
Recognition System ◽  
Reproductive Organs ◽  
Detection Accuracy ◽  
Anther Dehiscence ◽  
Accurate Identification ◽  
State Recognition ◽  
Learning Techniques ◽  
Computer Vision Technology ◽  
Improved Model

Cotton is one of the most economically important crops in the world. The fertility of male reproductive organs is a key determinant of cotton yield. The anther dehiscence or indehiscence directly determine the probability of fertilization in cotton. Thus, the rapid and accurate identification of cotton anther dehiscence status is important for judging anther growth status and promoting genetic breeding research. The development of computer vision technology and the advent of big data have prompted the application of deep learning techniques to agricultural phenotype research. Therefore, two deep learning models (Faster R-CNN and YOLOv5) were proposed to detect the number and dehiscence status of anthers. The single-stage model based on YOLOv5 has higher recognition efficiency and the ability to deploy to the mobile end. Breeding researchers can apply this model to terminals to achieve a more intuitive understanding of cotton anther dehiscence status. Moreover, three improvement strategies of Faster R-CNN model were proposed, the improved model has higher detection accuracy than YOLOv5 model. In addition, the percentage of dehiscent anther of randomly selected 30 cotton varieties were observed from cotton population under normal temperature and high temperature (HT) conditions through the integrated Faster R-CNN model and manual observation. The result showed HT varying decreased the percentage of dehiscent anther in different cotton lines, consistent with the manual method. Thus, this system can help us to rapid and accurate identification of HT-tolerant cotton.

scholarly journals Deep learning in cancer diagnosis, prognosis and treatment selection

2021 ◽  
Vol 13 (1) ◽  
Author(s):  
Khoa A. Tran ◽  
Olga Kondrashova ◽  
Andrew Bradley ◽  
Elizabeth D. Williams ◽  
John V. Pearson ◽  
...  
Keyword(s):  
Deep Learning ◽  
Cancer Diagnosis ◽  
Cancer Biology ◽  
Large Data ◽  
Data Sets ◽  
Precision Oncology ◽  
Data Types ◽  
Early Results ◽  
Learning Techniques ◽  
Rich Data

AbstractDeep learning is a subdiscipline of artificial intelligence that uses a machine learning technique called artificial neural networks to extract patterns and make predictions from large data sets. The increasing adoption of deep learning across healthcare domains together with the availability of highly characterised cancer datasets has accelerated research into the utility of deep learning in the analysis of the complex biology of cancer. While early results are promising, this is a rapidly evolving field with new knowledge emerging in both cancer biology and deep learning. In this review, we provide an overview of emerging deep learning techniques and how they are being applied to oncology. We focus on the deep learning applications for omics data types, including genomic, methylation and transcriptomic data, as well as histopathology-based genomic inference, and provide perspectives on how the different data types can be integrated to develop decision support tools. We provide specific examples of how deep learning may be applied in cancer diagnosis, prognosis and treatment management. We also assess the current limitations and challenges for the application of deep learning in precision oncology, including the lack of phenotypically rich data and the need for more explainable deep learning models. Finally, we conclude with a discussion of how current obstacles can be overcome to enable future clinical utilisation of deep learning.

scholarly journals A Practical Tutorial on Graph Neural Networks

2022 ◽  
Author(s):  
Isaac Ronald Ward ◽  
Jack Joyner ◽  
Casey Lickfold ◽  
Yulan Guo ◽  
Mohammed Bennamoun
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Deep Learning ◽  
Input Data ◽  
Unstructured Data ◽  
Data Types ◽  
Learning Techniques ◽  
Graph Neural Networks ◽  
Unique Ability

Graph neural networks (GNNs) have recently grown in popularity in the field of artificial intelligence (AI) due to their unique ability to ingest relatively unstructured data types as input data. Although some elements of the GNN architecture are conceptually similar in operation to traditional neural networks (and neural network variants), other elements represent a departure from traditional deep learning techniques. This tutorial exposes the power and novelty of GNNs to AI practitioners by collating and presenting details regarding the motivations, concepts, mathematics, and applications of the most common and performant variants of GNNs. Importantly, we present this tutorial concisely, alongside practical examples, thus providing a practical and accessible tutorial on the topic of GNNs.

scholarly journals Deep Learning Methods to Predict Mortality in COVID-19 Patients: A Rapid Scoping Review

2021 ◽  
Author(s):  
Mahanazuddin Syed ◽  
Shorabuddin Syed ◽  
Kevin Sexton ◽  
Melody L. Greer ◽  
Meredith Zozus ◽  
...  
Keyword(s):  
Deep Learning ◽  
Intervention Strategies ◽  
Past Century ◽  
Learning Models ◽  
Data Types ◽  
Learning Techniques ◽  
Scoping Literature Review ◽  
Predict Hospital Mortality ◽  
Intelligence Models ◽  
Artificial Intelligence Models

The ongoing COVID-19 pandemic has become the most impactful pandemic of the past century. The SARS-CoV-2 virus has spread rapidly across the globe affecting and straining global health systems. More than 2 million people have died from COVID-19 (as of 30 January 2021). To lessen the pandemic’s impact, advanced methods such as Artificial Intelligence models are proposed to predict mortality, morbidity, disease severity, and other outcomes and sequelae. We performed a rapid scoping literature review to identify the deep learning techniques that have been applied to predict hospital mortality in COVID-19 patients. Our review findings provide insights on the important deep learning models, data types, and features that have been reported in the literature. These summary findings will help scientists build reliable and accurate models for better intervention strategies for predicting mortality in current and future pandemic situations.

scholarly journals Anomaly-Based Intrusion Detection Systems in IoT Using Deep Learning: A Systematic Literature Review

2021 ◽  
Vol 11 (18) ◽  
pp. 8383 ◽  
Author(s):  
Muaadh A. Alsoufi ◽  
Shukor Razak ◽  
Maheyzah Md Siraj ◽  
Ibtehal Nafea ◽  
Fuad A. Ghaleb ◽  
...  
Keyword(s):  
Deep Learning ◽  
Literature Review ◽  
Intrusion Detection ◽  
Systematic Literature Review ◽  
Detection System ◽  
Smart Cities ◽  
Cyber Attacks ◽  
Data Types ◽  
Learning Techniques ◽  
Wide Range

The Internet of Things (IoT) concept has emerged to improve people’s lives by providing a wide range of smart and connected devices and applications in several domains, such as green IoT-based agriculture, smart farming, smart homes, smart transportation, smart health, smart grid, smart cities, and smart environment. However, IoT devices are at risk of cyber attacks. The use of deep learning techniques has been adequately adopted by researchers as a solution in securing the IoT environment. Deep learning has also successfully been implemented in various fields, proving its superiority in tackling intrusion detection attacks. Due to the limitation of signature-based detection for unknown attacks, the anomaly-based Intrusion Detection System (IDS) gains advantages to detect zero-day attacks. In this paper, a systematic literature review (SLR) is presented to analyze the existing published literature regarding anomaly-based intrusion detection, using deep learning techniques in securing IoT environments. Data from the published studies were retrieved from five databases (IEEE Xplore, Scopus, Web of Science, Science Direct, and MDPI). Out of 2116 identified records, 26 relevant studies were selected to answer the research questions. This review has explored seven deep learning techniques practiced in IoT security, and the results showed their effectiveness in dealing with security challenges in the IoT ecosystem. It is also found that supervised deep learning techniques offer better performance, compared to unsupervised and semi-supervised learning. This analysis provides an insight into how the use of data types and learning methods will affect the performance of deep learning techniques for further contribution to enhancing a novel model for anomaly intrusion detection and prediction.

scholarly journals Deep Cross-Corpus Speech Emotion Recognition: Recent Advances and Perspectives

2021 ◽  
Vol 15 ◽  
Author(s):  
Shiqing Zhang ◽  
Ruixin Liu ◽  
Xin Tao ◽  
Xiaoming Zhao
Keyword(s):  
Deep Learning ◽  
Emotion Recognition ◽  
Feature Learning ◽  
Learning Ability ◽  
Speech Emotion Recognition ◽  
Practical Applications ◽  
Learning Techniques ◽  
Challenges And Opportunities ◽  
Comprehensive Survey ◽  
Cross Language

Automatic speech emotion recognition (SER) is a challenging component of human-computer interaction (HCI). Existing literatures mainly focus on evaluating the SER performance by means of training and testing on a single corpus with a single language setting. However, in many practical applications, there are great differences between the training corpus and testing corpus. Due to the diversity of different speech emotional corpus or languages, most previous SER methods do not perform well when applied in real-world cross-corpus or cross-language scenarios. Inspired by the powerful feature learning ability of recently-emerged deep learning techniques, various advanced deep learning models have increasingly been adopted for cross-corpus SER. This paper aims to provide an up-to-date and comprehensive survey of cross-corpus SER, especially for various deep learning techniques associated with supervised, unsupervised and semi-supervised learning in this area. In addition, this paper also highlights different challenges and opportunities on cross-corpus SER tasks, and points out its future trends.

scholarly journals A Survey of Deep Convolutional Neural Networks Applied for Prediction of Plant Leaf Diseases

Sensors ◽  
2021 ◽  
Vol 21 (14) ◽  
pp. 4749
Author(s):  
Vijaypal Singh Dhaka ◽  
Sangeeta Vaibhav Meena ◽  
Geeta Rani ◽  
Deepak Sinwar ◽  
Kavita Kavita ◽  
...  
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Networks ◽  
Image Recognition ◽  
Optimization Techniques ◽  
Plant Diseases ◽  
Deep Convolutional Neural Networks ◽  
Plant Leaf ◽  
Advantages And Disadvantages ◽  
Learning Techniques

In the modern era, deep learning techniques have emerged as powerful tools in image recognition. Convolutional Neural Networks, one of the deep learning tools, have attained an impressive outcome in this area. Applications such as identifying objects, faces, bones, handwritten digits, and traffic signs signify the importance of Convolutional Neural Networks in the real world. The effectiveness of Convolutional Neural Networks in image recognition motivates the researchers to extend its applications in the field of agriculture for recognition of plant species, yield management, weed detection, soil, and water management, fruit counting, diseases, and pest detection, evaluating the nutrient status of plants, and much more. The availability of voluminous research works in applying deep learning models in agriculture leads to difficulty in selecting a suitable model according to the type of dataset and experimental environment. In this manuscript, the authors present a survey of the existing literature in applying deep Convolutional Neural Networks to predict plant diseases from leaf images. This manuscript presents an exemplary comparison of the pre-processing techniques, Convolutional Neural Network models, frameworks, and optimization techniques applied to detect and classify plant diseases using leaf images as a data set. This manuscript also presents a survey of the datasets and performance metrics used to evaluate the efficacy of models. The manuscript highlights the advantages and disadvantages of different techniques and models proposed in the existing literature. This survey will ease the task of researchers working in the field of applying deep learning techniques for the identification and classification of plant leaf diseases.

Developing an Artificial Intelligence Project in your Radiology Department

2020 ◽  
Vol 2 ◽  
pp. 58-61 ◽  
Author(s):  
Syed Junaid ◽  
Asad Saeed ◽  
Zeili Yang ◽  
Thomas Micic ◽  
Rajesh Botchu
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Health Care ◽  
Deep Learning ◽  
Learning Algorithms ◽  
Radiology Department ◽  
Short Article ◽  
Computing Power ◽  
Road Map ◽  
Key Concepts

The advances in deep learning algorithms, exponential computing power, and availability of digital patient data like never before have led to the wave of interest and investment in artificial intelligence in health care. No radiology conference is complete without a substantial dedication to AI. Many radiology departments are keen to get involved but are unsure of where and how to begin. This short article provides a simple road map to aid departments to get involved with the technology, demystify key concepts, and pique an interest in the field. We have broken down the journey into seven steps; problem, team, data, kit, neural network, validation, and governance.

Sign in / Sign up

Export Citation Format

Share Document