scholarly journals Fast Power Control Adaptation via Meta-Learning for Random Edge Graph Neural Networks

2021 ◽  
Author(s):  
Ivana Nikoloska ◽  
Osvaldo Simeone
Keyword(s):  
Neural Networks ◽  
Power Control ◽  
Edge Graph ◽  
Meta Learning ◽  
Fast Power ◽  
Graph Neural Networks

MetaLearning with Graph Neural Networks

2021 ◽  
Vol 23 (2) ◽  
pp. 13-22
Author(s):  
Debmalya Mandal ◽  
Sourav Medya ◽  
Brian Uzzi ◽  
Charu Aggarwal
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
Future Research ◽  
Open Problems ◽  
Research Directions ◽  
Graph Problems ◽  
Meta Learning ◽  
Comprehensive Survey ◽  
Future Research Directions ◽  
Graph Neural Networks

Graph Neural Networks (GNNs), a generalization of deep neural networks on graph data have been widely used in various domains, ranging from drug discovery to recommender systems. However, GNNs on such applications are limited when there are few available samples. Meta-learning has been an important framework to address the lack of samples in machine learning, and in recent years, researchers have started to apply meta-learning to GNNs. In this work, we provide a comprehensive survey of different metalearning approaches involving GNNs on various graph problems showing the power of using these two approaches together. We categorize the literature based on proposed architectures, shared representations, and applications. Finally, we discuss several exciting future research directions and open problems.

scholarly journals Improved Lipophilicity and Aqueous Solubility Prediction with Composite Graph Neural Networks

Molecules ◽  
2021 ◽  
Vol 26 (20) ◽  
pp. 6185
Author(s):  
Oliver Wieder ◽  
Mélaine Kuenemann ◽  
Marcus Wieder ◽  
Thomas Seidel ◽  
Christophe Meyer ◽  
...  
Keyword(s):  
Neural Networks ◽  
Performance Metrics ◽  
Graph Isomorphism ◽  
Aqueous Solubility ◽  
Solubility Prediction ◽  
Robust Solution ◽  
Composite Graph ◽  
Edge Graph ◽  
Graph Neural Networks ◽  
Key Aspects

The accurate prediction of molecular properties, such as lipophilicity and aqueous solubility, are of great importance and pose challenges in several stages of the drug discovery pipeline. Machine learning methods, such as graph-based neural networks (GNNs), have shown exceptionally good performance in predicting these properties. In this work, we introduce a novel GNN architecture, called directed edge graph isomorphism network (D-GIN). It is composed of two distinct sub-architectures (D-MPNN, GIN) and achieves an improvement in accuracy over its sub-architectures employing various learning, and featurization strategies. We argue that combining models with different key aspects help make graph neural networks deeper and simultaneously increase their predictive power. Furthermore, we address current limitations in assessment of deep-learning models, namely, comparison of single training run performance metrics, and offer a more robust solution.

scholarly journals Optimal Wireless Resource Allocation With Random Edge Graph Neural Networks

2020 ◽  
Vol 68 ◽  
pp. 2977-2991 ◽  
Author(s):  
Mark Eisen ◽  
Alejandro Ribeiro
Keyword(s):  
Neural Networks ◽  
Resource Allocation ◽  
Edge Graph ◽  
Graph Neural Networks ◽  
Wireless Resource Allocation

scholarly journals Learning from the Past: Continual Meta-Learning with Bayesian Graph Neural Networks

2020 ◽  
Vol 34 (04) ◽  
pp. 5021-5028 ◽  
Author(s):  
Yadan Luo ◽  
Zi Huang ◽  
Zheng Zhang ◽  
Ziwei Wang ◽  
Mahsa Baktashmotlagh ◽  
...  
Keyword(s):  
Neural Networks ◽  
Message Passing ◽  
Shot Classification ◽  
The Past ◽  
Meta Learning ◽  
Error Accumulation ◽  
Effectiveness And Efficiency ◽  
Graph Neural Networks ◽  
Continual Learning

Meta-learning for few-shot learning allows a machine to leverage previously acquired knowledge as a prior, thus improving the performance on novel tasks with only small amounts of data. However, most mainstream models suffer from catastrophic forgetting and insufficient robustness issues, thereby failing to fully retain or exploit long-term knowledge while being prone to cause severe error accumulation. In this paper, we propose a novel Continual Meta-Learning approach with Bayesian Graph Neural Networks (CML-BGNN) that mathematically formulates meta-learning as continual learning of a sequence of tasks. With each task forming as a graph, the intra- and inter-task correlations can be well preserved via message-passing and history transition. To remedy topological uncertainty from graph initialization, we utilize Bayes by Backprop strategy that approximates the posterior distribution of task-specific parameters with amortized inference networks, which are seamlessly integrated into the end-to-end edge learning. Extensive experiments conducted on the miniImageNet and tieredImageNet datasets demonstrate the effectiveness and efficiency of the proposed method, improving the performance by 42.8% compared with state-of-the-art on the miniImageNet 5-way 1-shot classification task.

Graph Neural Networks for Prediction of Fuel Ignition Quality

2020 ◽  
Author(s):  
Artur Schweidtmann ◽  
Jan Rittig ◽  
Andrea König ◽  
Martin Grohe ◽  
Alexander Mitsos ◽  
...  
Keyword(s):  
Neural Networks ◽  
Octane Number ◽  
Molecular Graph ◽  
Chemical Properties ◽  
Graph Representation ◽  
Structure Property ◽  
Oxygenated Hydrocarbons ◽  
Physico Chemical ◽  
Ignition Quality ◽  
Graph Neural Networks

<div>Prediction of combustion-related properties of (oxygenated) hydrocarbons is an important and challenging task for which quantitative structure-property relationship (QSPR) models are frequently employed. Recently, a machine learning method, graph neural networks (GNNs), has shown promising results for the prediction of structure-property relationships. GNNs utilize a graph representation of molecules, where atoms correspond to nodes and bonds to edges containing information about the molecular structure. More specifically, GNNs learn physico-chemical properties as a function of the molecular graph in a supervised learning setup using a backpropagation algorithm. This end-to-end learning approach eliminates the need for selection of molecular descriptors or structural groups, as it learns optimal fingerprints through graph convolutions and maps the fingerprints to the physico-chemical properties by deep learning. We develop GNN models for predicting three fuel ignition quality indicators, i.e., the derived cetane number (DCN), the research octane number (RON), and the motor octane number (MON), of oxygenated and non-oxygenated hydrocarbons. In light of limited experimental data in the order of hundreds, we propose a combination of multi-task learning, transfer learning, and ensemble learning. The results show competitive performance of the proposed GNN approach compared to state-of-the-art QSPR models making it a promising field for future research. The prediction tool is available via a web front-end at www.avt.rwth-aachen.de/gnn.</div>

Conversational Emotion Recognition Using Self-Attention Mechanisms and Graph Neural Networks

2020 ◽  
Author(s):  
Zheng Lian ◽  
Jianhua Tao ◽  
Bin Liu ◽  
Jian Huang ◽  
Zhanlei Yang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Emotion Recognition ◽  
Graph Neural Networks

Graph Pooling in Graph Neural Networks with Node Feature Correlation

2020 ◽  
Author(s):  
Jianjian Jiang ◽  
Fangyuan Lei ◽  
Qingyun Dai ◽  
Zhengmin Li
Keyword(s):  
Neural Networks ◽  
Feature Correlation ◽  
Graph Neural Networks

scholarly journals Streaming Graph Neural Networks via Continual Learning

2020 ◽  
Author(s):  
Junshan Wang ◽  
Guojie Song ◽  
Yi Wu ◽  
Liang Wang
Keyword(s):  
Neural Networks ◽  
Graph Neural Networks ◽  
Continual Learning
Sign in / Sign up

Export Citation Format

Share Document