Dual Gated Graph Attention Networks with Dynamic Iterative Training for Cross-Lingual Entity Alignment

2022 ◽  
Vol 40 (3) ◽  
pp. 1-30
Author(s):  
Zhiwen Xie ◽  
Runjie Zhu ◽  
Kunsong Zhao ◽  
Jin Liu ◽  
Guangyou Zhou ◽  
...  
Keyword(s):  
Neural Network ◽  
Structural Information ◽  
Contextual Information ◽  
Network Models ◽  
Neural Network Models ◽  
Attention Networks ◽  
Individual Knowledge ◽  
Benchmark Datasets ◽  
Cross Lingual ◽  
Network Approaches

Cross-lingual entity alignment has attracted considerable attention in recent years. Past studies using conventional approaches to match entities share the common problem of missing important structural information beyond entities in the modeling process. This allows graph neural network models to step in. Most existing graph neural network approaches model individual knowledge graphs (KGs) separately with a small amount of pre-aligned entities served as anchors to connect different KG embedding spaces. However, this characteristic can cause several major problems, including performance restraint due to the insufficiency of available seed alignments and ignorance of pre-aligned links that are useful in contextual information in-between nodes. In this article, we propose DuGa-DIT, a dual gated graph attention network with dynamic iterative training, to address these problems in a unified model. The DuGa-DIT model captures neighborhood and cross-KG alignment features by using intra-KG attention and cross-KG attention layers. With the dynamic iterative process, we can dynamically update the cross-KG attention score matrices, which enables our model to capture more cross-KG information. We conduct extensive experiments on two benchmark datasets and a case study in cross-lingual personalized search. Our experimental results demonstrate that DuGa-DIT outperforms state-of-the-art methods.

Effect of Social Media Interactions on CLV in Telecommunications

2020 ◽  
Vol 19 (02) ◽  
pp. 447-468
Author(s):  
Oğuzhan Kivrak ◽  
Cüneyt Akar
Keyword(s):  
Neural Network ◽  
Social Media ◽  
Network Models ◽  
Neural Network Models ◽  
Telecommunication Sector ◽  
Elman Neural Network ◽  
Customer Lifetime ◽  
Twitter Account ◽  
Network Approaches ◽  
Artificial Neural Network Models

The main goal of this study is to investigate whether social media, as a recent communication channel, has an impact on customer lifetime value (CLV). No studies have been done in Turkey with similar purposes in the telecommunication sector. To reach this goal, there has been an attempt to develop both artificial neural network models and sector-specific applicable models. Four years of data between 2011 and 2014 belonging to customers in the telecommunication sector who have a Twitter account are used in this study. The CLV is modeled through radial basis function (RBF), multilayer perceptron (MLP), and Elman neural network approaches, and the performance of such models is compared. According to the findings, calculated CLV error values are at an acceptable range in all formed models. Additionally, it is determined that the CLV was calculated with a lower error value in models where social media variables were used. The Elman neural network is determined to perform better compared to RBF and MLP.

scholarly journals Thinking like a naturalist: enhancing computer vision of citizen science images by harnessing contextual data

2019 ◽  
Author(s):  
J. Christopher D. Terry ◽  
Helen E. Roy ◽  
Tom A. August
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Computer Vision ◽  
Contextual Information ◽  
Network Models ◽  
List Type ◽  
British Isles ◽  
Automated Identification ◽  
Neural Network Models ◽  
Contextual Data

AbstractThe accurate identification of species in images submitted by citizen scientists is currently a bottleneck for many data uses. Machine learning tools offer the potential to provide rapid, objective and scalable species identification for the benefit of many aspects of ecological science. Currently, most approaches only make use of image pixel data for classification. However, an experienced naturalist would also use a wide variety of contextual information such as the location and date of recording.Here, we examine the automated identification of ladybird (Coccinellidae) records from the British Isles submitted to the UK Ladybird Survey, a volunteer-led mass participation recording scheme. Each image is associated with metadata; a date, location and recorder ID, which can be cross-referenced with other data sources to determine local weather at the time of recording, habitat types and the experience of the observer. We built multi-input neural network models that synthesise metadata and images to identify records to species level.We show that machine learning models can effectively harness contextual information to improve the interpretation of images. Against an image-only baseline of 48.2%, we observe a 9.1 percentage-point improvement in top-1 accuracy with a multi-input model compared to only a 3.6% increase when using an ensemble of image and metadata models. This suggests that contextual data is being used to interpret an image, beyond just providing a prior expectation. We show that our neural network models appear to be utilising similar pieces of evidence as human naturalists to make identifications.Metadata is a key tool for human naturalists. We show it can also be harnessed by computer vision systems. Contextualisation offers considerable extra information, particularly for challenging species, even within small and relatively homogeneous areas such as the British Isles. Although complex relationships between disparate sources of information can be profitably interpreted by simple neural network architectures, there is likely considerable room for further progress. Contextualising images has the potential to lead to a step change in the accuracy of automated identification tools, with considerable benefits for large scale verification of submitted records.

scholarly journals Air Temperature Estimation by Using Artificial Neural Network Models in the Greater Athens Area, Greece

2013 ◽  
Vol 2013 ◽  
pp. 1-7 ◽  
Author(s):  
A. P. Kamoutsis ◽  
A. S. Matsoukis ◽  
K. I. Chronopoulos
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Air Temperature ◽  
Input Parameter ◽  
Network Models ◽  
Reference Station ◽  
Neural Network Models ◽  
Artificial Neural ◽  
Network Approaches ◽  
Athens Area

Air temperature (T) data were estimated in the regions of Nea Smirni, Penteli, and Peristeri, in the greater Athens area, Greece, using the T data of a reference station in Penteli. Two artificial neural network approaches were developed. The first approach, MLP1, used the T as input parameter and the second, MLP2, used additionally the time of the corresponding T. One site in Nea Smirni, three sites in Penteli, from which two are located in the Pentelikon mountain, and one site in Peristeri were selected based on different land use and altitude. T data were monitored in each site for the period between December 1, 2009, and November 30, 2010. In this work the two extreme seasons (winter and summer) are presented. The results showed that the MLP2 model was better (higher and lower MAE) than MLP1 for the T estimation in both winter and summer, independently of the examined region. In general, MLP1 and MLP2 models provided more accurate T estimations in regions located in greater distance (Nea Smirni and Peristeri) from the reference station in relation to the nearby Pentelikon mountain. The greater distance T estimations, in most cases, were better in winter compared to summer.

scholarly journals Coreference Aware Representation Learning for Neural Named Entity Recognition

2019 ◽  
Author(s):  
Zeyu Dai ◽  
Hongliang Fei ◽  
Ping Li
Keyword(s):  
Neural Network ◽  
State Of The Art ◽  
Structural Information ◽  
Named Entity Recognition ◽  
Network Models ◽  
Third Party ◽  
Entity Recognition ◽  
Neural Network Models ◽  
Named Entity ◽  
Art Performance

Recent neural network models have achieved state-of-the-art performance on the task of named entity recognition (NER). However, previous neural network models typically treat the input sentences as a linear sequence of words but ignore rich structural information, such as the coreference relations among non-adjacent words, phrases or entities. In this paper, we propose a novel approach to learn coreference-aware word representations for the NER task at the document level. In particular, we enrich the well-known neural architecture ``CNN-BiLSTM-CRF'' with a coreference layer on top of the BiLSTM layer to incorporate coreferential relations. Furthermore, we introduce the coreference regularization to ensure the coreferential entities to share similar representations and consistent predictions within the same coreference cluster. Our proposed model achieves new state-of-the-art performance on two NER benchmarks: CoNLL-2003 and OntoNotes v5.0. More importantly, we demonstrate that our framework does not rely on gold coreference knowledge, and can still work well even when the coreferential relations are generated by a third-party toolkit.

Method of complex copper-zinc ore typification using neural network models

2020 ◽  
Vol 5 ◽  
pp. 140-147 ◽  
Author(s):  
T.N. Aleksandrova ◽  
◽  
E.K. Ushakov ◽  
A.V. Orlova ◽  
◽  
...  
Keyword(s):  
Neural Network ◽  
Network Models ◽  
Neural Network Models ◽  
Copper Zinc ◽  
Complex Copper

Digital twin of equipment as a basis for the consumer in digital production

2020 ◽  
Keyword(s):  
Neural Network ◽  
Tool Wear ◽  
Chip Formation ◽  
Network Models ◽  
Machining Accuracy ◽  
Neural Network Models ◽  
Digital Twin ◽  
The Neural Network ◽  
Digital Production ◽  
Cyberphysical System

The neural network models series used in the development of an aggregated digital twin of equipment as a cyber-physical system are presented. The twins of machining accuracy, chip formation and tool wear are examined in detail. On their basis, systems for stabilization of the chip formation process during cutting and diagnose of the cutting too wear are developed. Keywords cyberphysical system; neural network model of equipment; big data, digital twin of the chip formation; digital twin of the tool wear; digital twin of nanostructured coating choice

scholarly journals Prediction of Stress in Power Transformer Winding Conductors Using Artificial Neural Networks: Hyperparameter Analysis

Energies ◽  
2021 ◽  
Vol 14 (14) ◽  
pp. 4242
Author(s):  
Fausto Valencia ◽  
Hugo Arcos ◽  
Franklin Quilumba
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Finite Element ◽  
Power Transformer ◽  
Network Models ◽  
Activation Function ◽  
Neural Network Models ◽  
Transformer Winding ◽  
Artificial Neural ◽  
Femm Software

The purpose of this research is the evaluation of artificial neural network models in the prediction of stresses in a 400 MVA power transformer winding conductor caused by the circulation of fault currents. The models were compared considering the training, validation, and test data errors’ behavior. Different combinations of hyperparameters were analyzed based on the variation of architectures, optimizers, and activation functions. The data for the process was created from finite element simulations performed in the FEMM software. The design of the Artificial Neural Network was performed using the Keras framework. As a result, a model with one hidden layer was the best suited architecture for the problem at hand, with the optimizer Adam and the activation function ReLU. The final Artificial Neural Network model predictions were compared with the Finite Element Method results, showing good agreement but with a much shorter solution time.

scholarly journals The Effectiveness of Ensemble-Neural Network Techniques to Predict Peak Uplift Resistance of Buried Pipes in Reinforced Sand

2021 ◽  
Vol 11 (3) ◽  
pp. 908
Author(s):  
Jie Zeng ◽  
Panagiotis G. Asteris ◽  
Anna P. Mamou ◽  
Ahmed Salih Mohammed ◽  
Emmanuil A. Golias ◽  
...  
Keyword(s):  
Neural Network ◽  
Numerical Models ◽  
Correlation Coefficients ◽  
Network Models ◽  
Small Scale ◽  
Offshore Platforms ◽  
Neural Network Models ◽  
Buried Pipes ◽  
Ensemble Techniques ◽  
Uplift Resistance

Buried pipes are extensively used for oil transportation from offshore platforms. Under unfavorable loading combinations, the pipe’s uplift resistance may be exceeded, which may result in excessive deformations and significant disruptions. This paper presents findings from a series of small-scale tests performed on pipes buried in geogrid-reinforced sands, with the measured peak uplift resistance being used to calibrate advanced numerical models employing neural networks. Multilayer perceptron (MLP) and Radial Basis Function (RBF) primary structure types have been used to train two neural network models, which were then further developed using bagging and boosting ensemble techniques. Correlation coefficients in excess of 0.954 between the measured and predicted peak uplift resistance have been achieved. The results show that the design of pipelines can be significantly improved using the proposed novel, reliable and robust soft computing models.

Sign in / Sign up

Export Citation Format

Share Document