scholarly journals Deep Learning for Community Detection: Progress, Challenges and Opportunities

2020 ◽  
Author(s):  
Fanzhen Liu ◽  
Shan Xue ◽  
Jia Wu ◽  
Chuan Zhou ◽  
Wenbin Hu ◽  
...  
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Community Detection ◽  
Spectral Clustering ◽  
Deep Neural Networks ◽  
Future Research ◽  
Learning Techniques ◽  
Challenges And Opportunities ◽  
Graph Neural Networks ◽  
Dimensional Graph

As communities represent similar opinions, similar functions, similar purposes, etc., community detection is an important and extremely useful tool in both scientific inquiry and data analytics. However, the classic methods of community detection, such as spectral clustering and statistical inference, are falling by the wayside as deep learning techniques demonstrate an increasing capacity to handle high-dimensional graph data with impressive performance. Thus, a survey of current progress in community detection through deep learning is timely. Structured into three broad research streams in this domain – deep neural networks, deep graph embedding, and graph neural networks, this article summarizes the contributions of the various frameworks, models, and algorithms in each stream along with the current challenges that remain unsolved and the future research opportunities yet to be explored.

MetaLearning with Graph Neural Networks

2021 ◽  
Vol 23 (2) ◽  
pp. 13-22
Author(s):  
Debmalya Mandal ◽  
Sourav Medya ◽  
Brian Uzzi ◽  
Charu Aggarwal
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Future Research ◽  
Open Problems ◽  
Research Directions ◽  
Graph Problems ◽  
Meta Learning ◽  
Comprehensive Survey ◽  
Future Research Directions ◽  
Graph Neural Networks

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are few available samples. Meta-learning has been an important framework to address the lack of samples in machine learning, and in recent years, researchers have started to apply meta-learning to GNNs. In this work, we provide a comprehensive survey of different metalearning approaches involving GNNs on various graph problems showing the power of using these two approaches together. We categorize the literature based on proposed architectures, shared representations, and applications. Finally, we discuss several exciting future research directions and open problems.

Multi-Mineral Segmentation of SEM Images Using Deep Learning Techniques

2021 ◽  
Author(s):  
Vladislav Vasilevich Alekseev ◽  
Denis Mihaylovich Orlov ◽  
Dmitry Anatolevich Koroteev
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
Pore Space ◽  
Rock Physics ◽  
Sem Images ◽  
Digital Rock Physics ◽  
Learning Techniques ◽  
Digital Core ◽  
Non Destructive

Abstract The approaches of building and methods of using the digital core are currently developing rapidly. The use of these methods makes it possible to obtain petrophysical information by non-destructive methods quickly. Digital rock physics includes two main stages: constructing models and modeling various physical processes on the obtained models. Our work proposes using deep learning methods for mineral and pore space segmentation instead of classical methods such as threshold image processing. Deep neural networks have long been able to show their advantages in many areas of computer vision. This paper proposes and tests methods that help identify different minerals in images from a scanning electron microscope. We used images of rocks of the Achimov formation, which are arkoses, as samples. We tested various deep neural networks such as LinkNet, U-Net, ResUNet, and pix2pix and identified those that performed best in segmentation.

scholarly journals Bike Sharing Prediction using Deep Neural Networks

2017 ◽  
Vol 1 (3) ◽  
pp. 83 ◽  
Author(s):  
Chandrasegar Thirumalai ◽  
Ravisankar Koppuravuri
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
Neural Nets ◽  
Machine Learning Techniques ◽  
Business Decisions ◽  
Learning Techniques ◽  
Bike Sharing ◽  
The Way

In this paper, we will use deep neural networks for predicting the bike sharing usage based on previous years usage data. We will use because deep neural nets for getting higher accuracy. Deep neural nets are quite different from other machine learning techniques; here we can add many numbers of hidden layers to improve the accuracy of our prediction and the model can be trained in the way we want such that we can achieve the results we want. Nowadays many AI experts will say that deep learning is the best AI technique available now and we can achieve some unbelievable results using this technique. Now we will use that technique to predict bike sharing usage of a rental company to make sure they can take good business decisions based on previous years data.

Bearing fault diagnosis using deep learning techniques coupled with handcrafted feature extraction: A comparative study

2020 ◽  
pp. 107754632092914
Author(s):  
Mohammed Alabsi ◽  
Yabin Liao ◽  
Ala-Addin Nabulsi
Keyword(s):  
Neural Networks ◽  
Feature Extraction ◽  
Deep Learning ◽  
Comparative Study ◽  
Domain Knowledge ◽  
Deep Neural Networks ◽  
Performance Limits ◽  
Data Repositories ◽  
Learning Techniques ◽  
Wide Range

Deep learning has seen tremendous growth over the past decade. It has set new performance limits for a wide range of applications, including computer vision, speech recognition, and machinery health monitoring. With the abundance of instrumentation data and the availability of high computational power, deep learning continues to prove itself as an efficient tool for the extraction of micropatterns from machinery big data repositories. This study presents a comparative study for feature extraction capabilities using stacked autoencoders considering the use of expert domain knowledge. Case Western Reserve University bearing dataset was used for the study, and a classifier was trained and tested to extract and visualize features from 12 different failure classes. Based on the raw data preprocessing, four different deep neural network structures were studied. Results indicated that integrating domain knowledge with deep learning techniques improved feature extraction capabilities and reduced the deep neural networks size and computational requirements without the need for exhaustive deep neural networks architecture tuning and modification.

scholarly journals An Efficient Approach for Detecting Driver Drowsiness Based on Deep Learning

2021 ◽  
Vol 11 (18) ◽  
pp. 8441
Author(s):  
Anh-Cang Phan ◽  
Ngoc-Hoang-Quyen Nguyen  ◽  
Thanh-Ngoan Trieu ◽  
Thuong-Cang Phan
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
Training Dataset ◽  
Economic Losses ◽  
Drowsy Driving ◽  
Training Time ◽  
Road Users ◽  
Fast Training ◽  
Learning Techniques

Drowsy driving is one of the common causes of road accidents resulting in injuries, even death, and significant economic losses to drivers, road users, families, and society. There have been many studies carried out in an attempt to detect drowsiness for alert systems. However, a majority of the studies focused on determining eyelid and mouth movements, which have revealed many limitations for drowsiness detection. Besides, physiological measures-based studies may not be feasible in practice because the measuring devices are often not available on vehicles and often uncomfortable for drivers. In this research, we therefore propose two efficient methods with three scenarios for doze alert systems. The former applies facial landmarks to detect blinks and yawns based on appropriate thresholds for each driver. The latter uses deep learning techniques with two adaptive deep neural networks based on MobileNet-V2 and ResNet-50V2. The second method analyzes the videos and detects driver’s activities in every frame to learn all features automatically. We leverage the advantage of the transfer learning technique to train the proposed networks on our training dataset. This solves the problem of limited training datasets, provides fast training time, and keeps the advantage of the deep neural networks. Experiments were conducted to test the effectiveness of our methods compared with other methods. Empirical results demonstrate that the proposed method using deep learning techniques can achieve a high accuracy of 97% . This study provides meaningful solutions in practice to prevent unfortunate automobile accidents caused by drowsiness.

scholarly journals Deep Learning for the classification of quenched jets

2021 ◽  
Vol 2021 (11) ◽  
Author(s):  
L. Apolinário ◽  
N. F. Castro ◽  
M. Crispim Romão ◽  
J. G. Milhano ◽  
R. Pedro ◽  
...  
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Quark Gluon Plasma ◽  
Recurrent Neural Networks ◽  
Heavy Ions ◽  
Deep Neural Networks ◽  
Gluon Plasma ◽  
Jet Quenching ◽  
Learning Techniques

Abstract An important aspect of the study of Quark-Gluon Plasma (QGP) in ultrarelativistic collisions of heavy ions is the ability to identify, in experimental data, a subset of the jets that were strongly modified by the interaction with the QGP. In this work, we propose studying Deep Learning techniques for this purpose. Samples of Z+jet events were simulated in vacuum (pp collisions) and medium (PbPb collisions) and used to train Deep Neural Networks with the objective of discriminating between medium- and vacuum-like jets within the medium (PbPb) sample. Dedicated Convolutional Neural Networks, Dense Neural Networks and Recurrent Neural Networks were developed and trained, and their performance was studied. Our results show the potential of these techniques for the identification of jet quenching effects induced by the presence of the QGP.

scholarly journals A Practical Tutorial on Graph Neural Networks

2022 ◽  
Author(s):  
Isaac Ronald Ward ◽  
Jack Joyner ◽  
Casey Lickfold ◽  
Yulan Guo ◽  
Mohammed Bennamoun
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Neural Networks ◽  
Deep Learning ◽  
Input Data ◽  
Unstructured Data ◽  
Data Types ◽  
Learning Techniques ◽  
Graph Neural Networks ◽  
Unique Ability

Graph neural networks (GNNs) have recently grown in popularity in the field of artificial intelligence (AI) due to their unique ability to ingest relatively unstructured data types as input data. Although some elements of the GNN architecture are conceptually similar in operation to traditional neural networks (and neural network variants), other elements represent a departure from traditional deep learning techniques. This tutorial exposes the power and novelty of GNNs to AI practitioners by collating and presenting details regarding the motivations, concepts, mathematics, and applications of the most common and performant variants of GNNs. Importantly, we present this tutorial concisely, alongside practical examples, thus providing a practical and accessible tutorial on the topic of GNNs.

scholarly journals Multi-Modal Pain Intensity Assessment Based on Physiological Signals: A Deep Learning Perspective

2021 ◽  
Vol 12 ◽  
Author(s):  
Patrick Thiam ◽  
Heinke Hihn ◽  
Daniel A. Braun ◽  
Hans A. Kestler ◽  
Friedhelm Schwenker
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Pain Intensity ◽  
Supervised Learning ◽  
Pain Assessment ◽  
Deep Neural Networks ◽  
Fine Tuning ◽  
Physiological Data ◽  
Intensity Assessment ◽  
Learning Techniques

Traditional pain assessment approaches ranging from self-reporting methods, to observational scales, rely on the ability of an individual to accurately assess and successfully report observed or experienced pain episodes. Automatic pain assessment tools are therefore more than desirable in cases where this specific ability is negatively affected by various psycho-physiological dispositions, as well as distinct physical traits such as in the case of professional athletes, who usually have a higher pain tolerance as regular individuals. Hence, several approaches have been proposed during the past decades for the implementation of an autonomous and effective pain assessment system. These approaches range from more conventional supervised and semi-supervised learning techniques applied on a set of carefully hand-designed feature representations, to deep neural networks applied on preprocessed signals. Some of the most prominent advantages of deep neural networks are the ability to automatically learn relevant features, as well as the inherent adaptability of trained deep neural networks to related inference tasks. Yet, some significant drawbacks such as requiring large amounts of data to train deep models and over-fitting remain. Both of these problems are especially relevant in pain intensity assessment, where labeled data is scarce and generalization is of utmost importance. In the following work we address these shortcomings by introducing several novel multi-modal deep learning approaches (characterized by specific supervised, as well as self-supervised learning techniques) for the assessment of pain intensity based on measurable bio-physiological data. While the proposed supervised deep learning approach is able to attain state-of-the-art inference performances, our self-supervised approach is able to significantly improve the data efficiency of the proposed architecture by automatically generating physiological data and simultaneously performing a fine-tuning of the architecture, which has been previously trained on a significantly smaller amount of data.

scholarly journals Combining content and social features in a deep learning approach to Vietnamese email prioritization

2021 ◽  
Author(s):  
Ha Thanh Nguyen ◽  
Quan Dinh Dang ◽  
Anh Quang Tran
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
New Method ◽  
Learning Approach ◽  
Field Of Study ◽  
Learning Techniques ◽  
Email Overload ◽  
Social Features

The email overload problem has been discussed in numerous email-related studies. One of the possible solutions to this problem is email prioritization, which is the act of automatically predicting the importance levels of received emails and sorting the user’s inbox accordingly. Several learning-based methods have been proposed to address the email prioritization problem using content features as well as social features. Although these methods have laid the foundation works in this field of study, the reported performance is far from being practical. Recent works on deep neural networks have achieved good results in various tasks. In this paper, the authors propose a novel email prioritization model which incorporates several deep learning techniques and uses a combination of both content features and social features from email data. This method targets Vietnamese emails and is tested against a self-built Vietnamese email corpus. Conducted experiments explored the effects of different model configurations and compared the effectiveness of the new method to that of a previous work.

scholarly journals Phishing Website Detection using Supervised Deep Learning

2019 ◽  
Vol 8 (4) ◽  
pp. 4844-4846
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
Personal Information ◽  
Supervised Machine Learning ◽  
Machine Learning Techniques ◽  
Web Pages ◽  
Web Page ◽  
Algorithmic Approach ◽  
Learning Techniques

The website phishing is the tremendously growing problem over the internet which will lead to the loss of personal information. This process will run like, when ever user clicks a website link it will lead them to the web page that is created by the phisher to deceive the user. After this phishing has been started in order to stop it many techniques came into existence to detect the phished web site and help the user from being deceived by the attacker. Even though many techniques have adapted to stop the attackers, it is difficult because as many phished web pages are generated by the attackers within few hours. Most of the techniques to detect these phishing websites are not able to decide the fake website with legitimate one because the accuracy of getting results are much less. There are many supervised machine learning techniques which are supervised, where a primary set of data is given to the algorithm and depending on that set the algorithm will be trained and it will predict the results for the same. One of the most important techniques that is deep Learning classifiers is applied with significant features to detect phishing websites. By using this algorithm we can classify the phishing websites from genuine websites by using effective features. In this algorithmic approach to detect genuine websites a feature set is used so by analyzing these features using deep neural networks we can detect a website is phished or not. We can also increase the accuracy of our algorithm by adding certain more features and increasing the hidden layers in neural networks.

Sign in / Sign up

Export Citation Format

Share Document