Gated Knowledge Graph Neural Networks for Top-N Recommendation System

2021 ◽  
Author(s):  
Nan Mu ◽  
Daren Zha ◽  
Rui Gong
Keyword(s):  
Neural Networks ◽  
Recommendation System ◽  
Knowledge Graph ◽  
Graph Neural Networks

scholarly journals Knowledge Graph Alignment Network with Gated Multi-Hop Neighborhood Aggregation

2020 ◽  
Vol 34 (01) ◽  
pp. 222-229
Author(s):  
Zequn Sun ◽  
Chengming Wang ◽  
Wei Hu ◽  
Muhao Chen ◽  
Jian Dai ◽  
...  
Keyword(s):  
Neural Networks ◽  
Attention Mechanism ◽  
Knowledge Graph ◽  
Neighborhood Information ◽  
Graph Alignment ◽  
Gating Mechanism ◽  
Neighborhood Structures ◽  
Knowledge Graphs ◽  
End To End ◽  
Graph Neural Networks

Graph neural networks (GNNs) have emerged as a powerful paradigm for embedding-based entity alignment due to their capability of identifying isomorphic subgraphs. However, in real knowledge graphs (KGs), the counterpart entities usually have non-isomorphic neighborhood structures, which easily causes GNNs to yield different representations for them. To tackle this problem, we propose a new KG alignment network, namely AliNet, aiming at mitigating the non-isomorphism of neighborhood structures in an end-to-end manner. As the direct neighbors of counterpart entities are usually dissimilar due to the schema heterogeneity, AliNet introduces distant neighbors to expand the overlap between their neighborhood structures. It employs an attention mechanism to highlight helpful distant neighbors and reduce noises. Then, it controls the aggregation of both direct and distant neighborhood information using a gating mechanism. We further propose a relation loss to refine entity representations. We perform thorough experiments with detailed ablation studies and analyses on five entity alignment datasets, demonstrating the effectiveness of AliNet.

scholarly journals The Geranium Platform: A KG-Based System for Academic Publications

Information ◽  
2021 ◽  
Vol 12 (9) ◽  
pp. 366
Author(s):  
Giovanni Garifo ◽  
Giuseppe Futia ◽  
Antonio Vetrò ◽  
Juan Carlos De Martin
Keyword(s):  
Recommendation System ◽  
State Of The Art ◽  
Synthetic Data ◽  
Knowledge Graph ◽  
Human Knowledge ◽  
Core Technology ◽  
Academic Publications ◽  
Knowledge Graphs ◽  
Graph Neural Networks ◽  
Semantic Properties

Knowledge Graphs (KGs) have emerged as a core technology for incorporating human knowledge because of their capability to capture the relational dimension of information and of its semantic properties. The nature of KGs meets one of the vocational pursuits of academic institutions, which is sharing their intellectual output, especially publications. In this paper, we describe and make available the Polito Knowledge Graph (PKG) –which semantically connects information on more than 23,000 publications and 34,000 authors– and Geranium, a semantic platform that leverages the properties of the PKG to offer advanced services for search and exploration. In particular, we describe the Geranium recommendation system, which exploits Graph Neural Networks (GNNs) to suggest collaboration opportunities between researchers of different disciplines. This work integrates the state of the art because we use data from a real application in the scholarly domain, while the current literature still explores the combination of KGs and GNNs in a prototypal context using synthetic data. The results shows that the fusion of these technologies represents a promising approach for recommendation and metadata inference in the scholarly domain.

scholarly journals BERT-INT:A BERT-based Interaction Model For Knowledge Graph Alignment

2020 ◽  
Author(s):  
Xiaobin Tang ◽  
Jing Zhang ◽  
Bo Chen ◽  
Yang Yang ◽  
Hong Chen ◽  
...  
Keyword(s):  
Neural Networks ◽  
State Of The Art ◽  
Side Information ◽  
Interaction Model ◽  
Experimental Results ◽  
Knowledge Graph ◽  
Fine Grained ◽  
Graph Alignment ◽  
Knowledge Graphs ◽  
Graph Neural Networks

Knowledge graph alignment aims to link equivalent entities across different knowledge graphs. To utilize both the graph structures and the side information such as name, description and attributes, most of the works propagate the side information especially names through linked entities by graph neural networks. However, due to the heterogeneity of different knowledge graphs, the alignment accuracy will be suffered from aggregating different neighbors. This work presents an interaction model to only leverage the side information. Instead of aggregating neighbors, we compute the interactions between neighbors which can capture fine-grained matches of neighbors. Similarly, the interactions of attributes are also modeled. Experimental results show that our model significantly outperforms the best state-of-the-art methods by 1.9-9.7% in terms of HitRatio@1 on the dataset DBP15K.

scholarly journals Cybersecurity Knowledge Graph Improvement with Graph Neural Networks

2021 ◽  
Author(s):  
Soham Dasgupta ◽  
Aritran Piplai ◽  
Priyanka Ranade ◽  
Anupam Joshi
Keyword(s):  
Neural Networks ◽  
Knowledge Graph ◽  
Graph Neural Networks

scholarly journals Social Recommendation System Based on Hypergraph Attention Network

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Zhongxiu Xia ◽  
Weiyu Zhang ◽  
Ziqiang Weng
Keyword(s):  
Neural Networks ◽  
Social Networks ◽  
Recommendation System ◽  
Recommendation Systems ◽  
High Order ◽  
Social Recommendation ◽  
Attention Network ◽  
Practical Applications ◽  
Order Relations ◽  
Graph Neural Networks

In recent years, due to the rise of online social platforms, social networks have more and more influence on our daily life, and social recommendation system has become one of the important research directions of recommendation system research. Because the graph structure in social networks and graph neural networks has strong representation capabilities, the application of graph neural networks in social recommendation systems has become more and more extensive, and it has also shown good results. Although graph neural networks have been successfully applied in social recommendation systems, their performance may still be limited in practical applications. The main reason is that they can only take advantage of pairs of user relations but cannot capture the higher-order relations between users. We propose a model that applies the hypergraph attention network to the social recommendation system (HASRE) to solve this problem. Specifically, we take the hypergraph’s ability to model high-order relations to capture high-order relations between users. However, because the influence of the users’ friends is different, we use the graph attention mechanism to capture the users’ attention to different friends and adaptively model selection information for the user. In order to verify the performance of the recommendation system, this paper carries out analysis experiments on three data sets related to the recommendation system. The experimental results show that HASRE outperforms the state-of-the-art method and can effectively improve the accuracy of recommendation.

scholarly journals Multi-hop Attention Graph Neural Networks

2021 ◽  
Author(s):  
Guangtao Wang ◽  
Rex Ying ◽  
Jing Huang ◽  
Jure Leskovec
Keyword(s):  
Neural Networks ◽  
Large Scale ◽  
Performance Metrics ◽  
State Of The Art ◽  
Structural Information ◽  
Representation Learning ◽  
Attention Mechanism ◽  
Graph Representation ◽  
Knowledge Graph ◽  
Graph Neural Networks

Self-attention mechanism in graph neural networks (GNNs) led to state-of-the-art performance on many graph representation learning tasks. Currently, at every layer, attention is computed between connected pairs of nodes and depends solely on the representation of the two nodes. However, such attention mechanism does not account for nodes that are not directly connected but provide important network context. Here we propose Multi-hop Attention Graph Neural Network (MAGNA), a principled way to incorporate multi-hop context information into every layer of attention computation. MAGNA diffuses the attention scores across the network, which increases the receptive field for every layer of the GNN. Unlike previous approaches, MAGNA uses a diffusion prior on attention values, to efficiently account for all paths between the pair of disconnected nodes. We demonstrate in theory and experiments that MAGNA captures large-scale structural information in every layer, and has a low-pass effect that eliminates noisy high-frequency information from graph data. Experimental results on node classification as well as the knowledge graph completion benchmarks show that MAGNA achieves state-of-the-art results: MAGNA achieves up to 5.7% relative error reduction over the previous state-of-the-art on Cora, Citeseer, and Pubmed. MAGNA also obtains the best performance on a large-scale Open Graph Benchmark dataset. On knowledge graph completion MAGNA advances state-of-the-art on WN18RR and FB15k-237 across four different performance metrics.

Sign in / Sign up

Export Citation Format

Share Document