scholarly journals Transfer Learning for Node Regression Applied to Spreading Prediction

2021 ◽  
Vol 30 (4) ◽  
pp. 457-481
Author(s):  
Sebastian Mežnar ◽  
◽  
Nada Lavrač ◽  
Blaž Škrlj ◽  
◽  
...  
Keyword(s):  
Machine Learning ◽  
Complex Networks ◽  
Transfer Learning ◽  
State Of The Art ◽  
Real Life ◽  
Dynamic Processes ◽  
Epidemic Spreading ◽  
Machine Learning Methods ◽  
Model Transfer ◽  
Novel Applications

Understanding how information propagates in real-life complex networks yields a better understanding of dynamic processes such as misinformation or epidemic spreading. The recently introduced branch of machine learning methods for learning node representations offers many novel applications, one of them being the task of spreading prediction addressed in this paper. We explore the utility of the state-of-the-art node representation learners when used to assess the effects of spreading from a given node, estimated via extensive simulations. Further, as many real-life networks are topologically similar, we systematically investigate whether the learned models generalize to previously unseen networks, showing that in some cases very good model transfer can be obtained. This paper is one of the first to explore transferability of the learned representations for the task of node regression; we show there exist pairs of networks with similar structure between which the trained models can be transferred (zero-shot) and demonstrate their competitive performance. To our knowledge, this is one of the first attempts to evaluate the utility of zero-shot transfer for the task of node regression.

Deep Learning for text in limted data settings

2020 ◽  
Author(s):  
Pathikkumar Patel ◽  
Bhargav Lad ◽  
Jinan Fiaidhi
Keyword(s):  
Machine Learning ◽  
Time Series ◽  
Deep Learning ◽  
Sentiment Analysis ◽  
Transfer Learning ◽  
Text Classification ◽  
State Of The Art ◽  
Time Series Forecasting ◽  
Text Data ◽  
Performance Levels

During the last few years, RNN models have been extensively used and they have proven to be better for sequence and text data. RNNs have achieved state-of-the-art performance levels in several applications such as text classification, sequence to sequence modelling and time series forecasting. In this article we will review different Machine Learning and Deep Learning based approaches for text data and look at the results obtained from these methods. This work also explores the use of transfer learning in NLP and how it affects the performance of models on a specific application of sentiment analysis.

scholarly journals Domain Adaptation Using a Three-Way Decision Improves the Identification of Autism Patients from Multisite fMRI Data

2021 ◽  
Vol 11 (5) ◽  
pp. 603
Author(s):  
Chunlei Shi ◽  
Xianwei Xin ◽  
Jiacai Zhang
Keyword(s):  
Machine Learning ◽  
Domain Adaptation ◽  
Recognition Accuracy ◽  
State Of The Art ◽  
Autism Spectrum ◽  
Fmri Data ◽  
Target Domain ◽  
Sample Distribution ◽  
Machine Learning Methods ◽  
First Time

Machine learning methods are widely used in autism spectrum disorder (ASD) diagnosis. Due to the lack of labelled ASD data, multisite data are often pooled together to expand the sample size. However, the heterogeneity that exists among different sites leads to the degeneration of machine learning models. Herein, the three-way decision theory was introduced into unsupervised domain adaptation in the first time, and applied to optimize the pseudolabel of the target domain/site from functional magnetic resonance imaging (fMRI) features related to ASD patients. The experimental results using multisite fMRI data show that our method not only narrows the gap of the sample distribution among domains but is also superior to the state-of-the-art domain adaptation methods in ASD recognition. Specifically, the ASD recognition accuracy of the proposed method is improved on all the six tasks, by 70.80%, 75.41%, 69.91%, 72.13%, 71.01% and 68.85%, respectively, compared with the existing methods.

scholarly journals Uncertainty-Informed Deep Transfer Learning of PFAS Toxicity

2021 ◽  
Author(s):  
Jeremy Feinstein ◽  
ganesh sivaraman ◽  
Kurt Picel ◽  
Brian Peters ◽  
Alvaro Vazquez-Mayagoitia ◽  
...  
Keyword(s):  
Machine Learning ◽  
Transfer Learning ◽  
High Throughput ◽  
High Throughput Screening ◽  
Organic Chemical ◽  
Learning Method ◽  
Toxicity Data ◽  
Chemical Structures ◽  
Machine Learning Methods ◽  
Computational Methodology

In this article, we present our recent study on computational methodology for predicting the toxicity of PFAS known as “forever chemicals” based on chemical structures through evaluation of multiple machine learning methods. To address the scarcity of PFAS toxicity data, a deep “transfer learning” method has been investigated by leveraging toxicity information over the entire organic chemical domain and an uncertainty-informed workflow by incorporating SelectiveNet architecture, which can support future guidance of high throughput screening with knowledge of chemical structures, has been developed.

scholarly journals Applying a Deep Q Network for OpenAIs Car Racing Game

2020 ◽  
Author(s):  
Ali Fakhry
Keyword(s):  
Machine Learning ◽  
Reinforcement Learning ◽  
Transfer Learning ◽  
State Of The Art ◽  
Learning Techniques ◽  
Car Racing ◽  
Custom Made ◽  
Learning Technique ◽  
Reward Threshold

The applications of Deep Q-Networks are seen throughout the field of reinforcement learning, a large subsect of machine learning. Using a classic environment from OpenAI, CarRacing-v0, a 2D car racing environment, alongside a custom based modification of the environment, a DQN, Deep Q-Network, was created to solve both the classic and custom environments. The environments are tested using custom made CNN architectures and applying transfer learning from Resnet18. While DQNs were state of the art years ago, using it for CarRacing-v0 appears somewhat unappealing and not as effective as other reinforcement learning techniques. Overall, while the model did train and the agent learned various parts of the environment, attempting to reach the reward threshold for the environment with this reinforcement learning technique seems problematic and difficult as other techniques would be more useful.

scholarly journals A Network Parameter Database False Data Injection Correction Physics-Based Model: A Machine Learning Synthetic Measurement-Based Approach

2021 ◽  
Vol 11 (17) ◽  
pp. 8074
Author(s):  
Tierui Zou ◽  
Nader Aljohani ◽  
Keerthiraj Nagaraj ◽  
Sheng Zou ◽  
Cody Ruben ◽  
...  
Keyword(s):  
Machine Learning ◽  
Power Systems ◽  
State Of The Art ◽  
Real Life ◽  
The State ◽  
Wide Area ◽  
Network Parameter ◽  
False Data Injection ◽  
Network Parameters ◽  
Injection Attacks

Concerning power systems, real-time monitoring of cyber–physical security, false data injection attacks on wide-area measurements are of major concern. However, the database of the network parameters is just as crucial to the state estimation process. Maintaining the accuracy of the system model is the other part of the equation, since almost all applications in power systems heavily depend on the state estimator outputs. While much effort has been given to measurements of false data injection attacks, seldom reported work is found on the broad theme of false data injection on the database of network parameters. State-of-the-art physics-based model solutions correct false data injection on network parameter database considering only available wide-area measurements. In addition, deterministic models are used for correction. In this paper, an overdetermined physics-based parameter false data injection correction model is presented. The overdetermined model uses a parameter database correction Jacobian matrix and a Taylor series expansion approximation. The method further applies the concept of synthetic measurements, which refers to measurements that do not exist in the real-life system. A machine learning linear regression-based model for measurement prediction is integrated in the framework through deriving weights for synthetic measurements creation. Validation of the presented model is performed on the IEEE 118-bus system. Numerical results show that the approximation error is lower than the state-of-the-art, while providing robustness to the correction process. Easy-to-implement model on the classical weighted-least-squares solution, highlights real-life implementation potential aspects.

Machine learning-based analysis of multi-omics data on the cloud for investigating gene regulations

2020 ◽  
Author(s):  
Minsik Oh ◽  
Sungjoon Park ◽  
Sun Kim ◽  
Heejoon Chae
Keyword(s):  
Machine Learning ◽  
Gene Regulation ◽  
State Of The Art ◽  
Patient Specific ◽  
Specific Gene ◽  
Omics Data ◽  
Gene Expressions ◽  
Learning Methods ◽  
Machine Learning Methods ◽  
Disease Subtype

Abstract Gene expressions are subtly regulated by quantifiable measures of genetic molecules such as interaction with other genes, methylation, mutations, transcription factor and histone modifications. Integrative analysis of multi-omics data can help scientists understand the condition or patient-specific gene regulation mechanisms. However, analysis of multi-omics data is challenging since it requires not only the analysis of multiple omics data sets but also mining complex relations among different genetic molecules by using state-of-the-art machine learning methods. In addition, analysis of multi-omics data needs quite large computing infrastructure. Moreover, interpretation of the analysis results requires collaboration among many scientists, often requiring reperforming analysis from different perspectives. Many of the aforementioned technical issues can be nicely handled when machine learning tools are deployed on the cloud. In this survey article, we first survey machine learning methods that can be used for gene regulation study, and we categorize them according to five different goals: gene regulatory subnetwork discovery, disease subtype analysis, survival analysis, clinical prediction and visualization. We also summarize the methods in terms of multi-omics input types. Then, we explain why the cloud is potentially a good solution for the analysis of multi-omics data, followed by a survey of two state-of-the-art cloud systems, Galaxy and BioVLAB. Finally, we discuss important issues when the cloud is used for the analysis of multi-omics data for the gene regulation study.

scholarly journals Identity Recognition Using Biological Electroencephalogram Sensors

2016 ◽  
Vol 2016 ◽  
pp. 1-9 ◽  
Author(s):  
Wei Liang ◽  
Liang Cheng ◽  
Mingdong Tang
Keyword(s):  
Machine Learning ◽  
Signal Processing ◽  
Human Brain ◽  
State Of The Art ◽  
Brain Wave ◽  
Identity Recognition ◽  
Wave Signal ◽  
Machine Learning Methods ◽  
Characteristic Extraction ◽  
Critical Issues

Brain wave signal is a bioelectric phenomenon reflecting activities in human brain. In this paper, we firstly introduce brain wave-based identity recognition techniques and the state-of-the-art work. We then analyze important features of brain wave and present challenges confronted by its applications. Further, we evaluate the security and practicality of using brain wave in identity recognition and anticounterfeiting authentication and describe use cases of several machine learning methods in brain wave signal processing. Afterwards, we survey the critical issues of characteristic extraction, classification, and selection involved in brain wave signal processing. Finally, we propose several brain wave-based identity recognition techniques for further studies and conclude this paper.

scholarly journals WAYS TO USE NEURAL NETWORKS AND MACHINE LEARNING IN COMPUTER GAMES

2021 ◽  
Vol 295 (2) ◽  
pp. 97-100
Author(s):  
K. Seniva ◽  
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Neural Networks ◽  
Computer Games ◽  
Real Life ◽  
Gaming Industry ◽  
Game Development ◽  
Machine Learning Methods ◽  
Long Time ◽  
And Behavior

This article discusses the main ways of using neural networks and machine learning methods of various types in computer games. Machine learning and neural networks are hot topics in many technology fields. One of them is the creation of computer games, where new tools are used to make games more interesting. Remastered and modified games with neural networks have become a new trend. One of the most popular ways to implement artificial intelligence is neural networks. They are used in everything from medicine to the entertainment industry. But one of the most promising areas for their development is games. The game world is an ideal platform for testing artificial intelligence without the danger of harming nature or people. Making bots more complex is just a small part of what neural networks can do. They are also actively used in game development, and in some areas they already make people feel uncomfortable. Research is ongoing on color and light correction, real-time character animation and behavior control. The main types of neural networks that can learn such functions are considered. Neural networks learn (and self-learn) very quickly. The more primitive the task, the faster the person will become unnecessary. This is already noticeable in the gaming industry, but will soon spread to other areas of life, because games are just a convenient platform for experimenting with artificial intelligence before its implementation in real life. The main problem faced by scientists is that it is difficult for neural networks to copy the mechanics of the game. There are some achievements in this direction, but research continues. Therefore, in the future, real specialists will be required for the development of games for a long time, although AI is already coping with some tasks.

scholarly journals Uncertainty-Informed Deep Transfer Learning of PFAS Toxicity

2021 ◽  
Author(s):  
Jeremy Feinstein ◽  
ganesh sivaraman ◽  
Kurt Picel ◽  
Brian Peters ◽  
Alvaro Vazquez-Mayagoitia ◽  
...  
Keyword(s):  
Machine Learning ◽  
Transfer Learning ◽  
High Throughput ◽  
High Throughput Screening ◽  
Organic Chemical ◽  
Learning Method ◽  
Toxicity Data ◽  
Chemical Structures ◽  
Machine Learning Methods ◽  
Computational Methodology

In this article, we present our recent study on computational methodology for predicting the toxicity of PFAS known as “forever chemicals” based on chemical structures through evaluation of multiple machine learning methods. To address the scarcity of PFAS toxicity data, a deep “transfer learning” method has been investigated by leveraging toxicity information over the entire organic chemical domain and an uncertainty-informed workflow by incorporating SelectiveNet architecture, which can support future guidance of high throughput screening with knowledge of chemical structures, has been developed.

Sign in / Sign up

Export Citation Format

Share Document