scholarly journals Entity Relation Extraction Based on Entity Indicators

Symmetry ◽  
2021 ◽  
Vol 13 (4) ◽  
pp. 539
Author(s):  
Yongbin Qin ◽  
Weizhe Yang ◽  
Kai Wang ◽  
Ruizhang Huang ◽  
Feng Tian ◽  
...  
Keyword(s):  
Neural Network ◽  
Semantic Information ◽  
Chinese Literature ◽  
Relation Extraction ◽  
Relevant Information ◽  
Internal Symmetry ◽  
Named Entity ◽  
Systemic Analysis ◽  
The Neural Network ◽  
The Impact

Relation extraction aims to extract semantic relationships between two specified named entities in a sentence. Because a sentence often contains several named entity pairs, a neural network is easily bewildered when learning a relation representation without position and semantic information about the considered entity pair. In this paper, instead of learning an abstract representation from raw inputs, task-related entity indicators are designed to enable a deep neural network to concentrate on the task-relevant information. By implanting entity indicators into a relation instance, the neural network is effective for encoding syntactic and semantic information about a relation instance. Organized, structured and unified entity indicators can make the similarity between sentences that possess the same or similar entity pair and the internal symmetry of one sentence more obviously. In the experiment, a systemic analysis was conducted to evaluate the impact of entity indicators on relation extraction. This method has achieved state-of-the-art performance, exceeding the compared methods by more than 3.7%, 5.0% and 11.2% in F1 score on the ACE Chinese corpus, ACE English corpus and Chinese literature text corpus, respectively.

scholarly journals Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images

2020 ◽  
Vol 12 (5) ◽  
pp. 784 ◽  
Author(s):  
Wei Guo ◽  
Weihong Li ◽  
Weiguo Gong ◽  
Jinkai Cui
Keyword(s):  
Neural Network ◽  
Object Detection ◽  
Semantic Information ◽  
Aerial Images ◽  
Training Strategy ◽  
The Public ◽  
Multi Scale ◽  
Shallow Layer ◽  
The Neural Network ◽  
Feature Pyramid

Multi-scale object detection is a basic challenge in computer vision. Although many advanced methods based on convolutional neural networks have succeeded in natural images, the progress in aerial images has been relatively slow mainly due to the considerably huge scale variations of objects and many densely distributed small objects. In this paper, considering that the semantic information of the small objects may be weakened or even disappear in the deeper layers of neural network, we propose a new detection framework called Extended Feature Pyramid Network (EFPN) for strengthening the information extraction ability of the neural network. In the EFPN, we first design the multi-branched dilated bottleneck (MBDB) module in the lateral connections to capture much more semantic information. Then, we further devise an attention pathway for better locating the objects. Finally, an augmented bottom-up pathway is conducted for making shallow layer information easier to spread and further improving performance. Moreover, we present an adaptive scale training strategy to enable the network to better recognize multi-scale objects. Meanwhile, we present a novel clustering method to achieve adaptive anchors and make the neural network better learn data features. Experiments on the public aerial datasets indicate that the presented method obtain state-of-the-art performance.

scholarly journals Network Embedding via a Bi-Mode and Deep Neural Network Model

2017 ◽  
Author(s):  
Yang Fang ◽  
Xiang Zhao ◽  
Zhen Tan
Keyword(s):  
Neural Network ◽  
Deep Neural Network ◽  
Semantic Information ◽  
Dimensional Space ◽  
Relation Extraction ◽  
Network Embedding ◽  
Structure Information ◽  
Second Mode ◽  
Real World Datasets ◽  
Low Dimensional

Network Embedding (NE) is an important method to learn the representations of network via a low-dimensional space. Conventional NE models focus on capturing the structure information and semantic information of vertices while neglecting such information for edges. In this work, we propose a novel NE model named BimoNet to capture both the structure and semantic information of edges. BimoNet is composed of two parts, i.e., the bi-mode embedding part and the deep neural network part. For bi-mode embedding part, the first mode named add-mode is used to express the entity-shared features of edges and the second mode named subtract-mode is employed to represent the entity-specific features of edges. These features actually reflect the semantic information. For deep neural network part, we firstly regard the edges in a network as nodes, and the vertices as links, which will not change the overall structure of the whole network. Then we take the nodes' adjacent matrix as the input of the deep neural network as it can obtain similar representations for nodes with similar structure. Afterwards, by jointly optimizing the objective function of these two parts, BimoNet could preserve both the semantic and structure information of edges. In experiments, we evaluate BimoNet on three real-world datasets and task of relation extraction, and BimoNet is demonstrated to outperform state-of-the-art baseline models consistently and significantly.

Combined Trajectory Planning and Tracking for Autonomous Vehicles on Deformable Terrains

2020 ◽  
Author(s):  
James Dallas ◽  
Yifan Weng ◽  
Tulga Ersal
Keyword(s):  
Neural Network ◽  
Trajectory Planning ◽  
Autonomous Vehicles ◽  
Performance Metrics ◽  
Soft Soil ◽  
Computation Time ◽  
Operating Conditions ◽  
The Neural Network ◽  
Vehicle Response ◽  
The Impact

Abstract In this work, a novel combined trajectory planner and tracking controller is developed for autonomous vehicles operating on off-road deformable terrains. Common approaches to trajectory planning and tracking often rely on model-dependent schemes, which utilize a simplified model to predict the impact of control inputs to future vehicle response. However, in an off-road context and especially on deformable terrains, accurately modeling the vehicle response for predictive purposes can be challenging due to the complexity of the tire-terrain interaction and limitations of state-of-the-art terramechanics models in terms of operating conditions, computation time, and continuous differentiability. To address this challenge and improve vehicle safety and performance through more accurate prediction of the plant response, in this paper, a nonlinear model predictive control framework is presented that accounts for terrain deformability explicitly using a neural network terramechanics model for deformable terrains. The utility of the proposed scheme is demonstrated on high fidelity simulations for a notional lightweight military vehicle on soft soil. It is shown that the neural network based controller can outperform a baseline Pacejka model based scheme by improving on performance metrics associated with the cost function. In more severe maneuvers, the neural network based controller can achieve sufficient fidelity as compared to the plant to complete maneuvers that lead to failure for the Pacejka based controller. Finally, it is demonstrated that the proposed framework is conducive to real-time implementability.

scholarly journals Phonetics and Ambiguity Comprehension Gated Attention Network for Humor Recognition

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-9 ◽  
Author(s):  
Xiaochao Fan ◽  
Hongfei Lin ◽  
Liang Yang ◽  
Yufeng Diao ◽  
Chen Shen ◽  
...  
Keyword(s):  
Neural Network ◽  
Semantic Information ◽  
Semantic Representation ◽  
Research Attention ◽  
Attention Network ◽  
Phonetic Information ◽  
The Neural Network ◽  
Ambiguous Words ◽  
Public Datasets

Humor refers to the quality of being amusing. With the development of artificial intelligence, humor recognition is attracting a lot of research attention. Although phonetics and ambiguity have been introduced by previous studies, existing recognition methods still lack suitable feature design for neural networks. In this paper, we illustrate that phonetics structure and ambiguity associated with confusing words need to be learned for their own representations via the neural network. Then, we propose the Phonetics and Ambiguity Comprehension Gated Attention network (PACGA) to learn phonetic structures and semantic representation for humor recognition. The PACGA model can well represent phonetic information and semantic information with ambiguous words, which is of great benefit to humor recognition. Experimental results on two public datasets demonstrate the effectiveness of our model.

scholarly journals Entity Type Enhanced Neural Model for Distantly Supervised Relation Extraction (Student Abstract)

2020 ◽  
Vol 34 (10) ◽  
pp. 13751-13752
Author(s):  
Long Bai ◽  
Xiaolong Jin ◽  
Chuanzhi Zhuang ◽  
Xueqi Cheng
Keyword(s):  
Neural Network ◽  
Semantic Information ◽  
Relation Extraction ◽  
Neural Model ◽  
Benchmark Dataset ◽  
Experimental Comparison ◽  
Type Information

Distantly Supervised Relation Extraction (DSRE) has been widely studied, since it can automatically extract relations from very large corpora. However, existing DSRE methods only use little semantic information about entities, such as the information of entity type. Thus, in this paper, we propose a method for integrating entity type information into a neural network based DSRE model. It also adopts two attention mechanisms, namely, sentence attention and type attention. The former selects the representative sentences for a sentence bag, while the latter selects appropriate type information for entities. Experimental comparison with existing methods on a benchmark dataset demonstrates its merits.

scholarly journals Deep Learning-Based Localization of EEG Electrodes Within MRI Acquisitions

2021 ◽  
Vol 12 ◽  
Author(s):  
Caroline Pinte ◽  
Mathis Fleury ◽  
Pierre Maurel
Keyword(s):  
Neural Network ◽  
Spatial Information ◽  
Brain Activity ◽  
Relevant Information ◽  
Magnetic Resonance Images ◽  
Detection Accuracy ◽  
Simultaneous Acquisition ◽  
The Neural Network ◽  
Mri Sequences ◽  
Short Echo Time

The simultaneous acquisition of electroencephalographic (EEG) signals and functional magnetic resonance images (fMRI) aims to measure brain activity with good spatial and temporal resolution. This bimodal neuroimaging can bring complementary and very relevant information in many cases and in particular for epilepsy. Indeed, it has been shown that it can facilitate the localization of epileptic networks. Regarding the EEG, source localization requires the resolution of a complex inverse problem that depends on several parameters, one of the most important of which is the position of the EEG electrodes on the scalp. These positions are often roughly estimated using fiducial points. In simultaneous EEG-fMRI acquisitions, specific MRI sequences can provide valuable spatial information. In this work, we propose a new fully automatic method based on neural networks to segment an ultra-short echo-time MR volume in order to retrieve the coordinates and labels of the EEG electrodes. It consists of two steps: a segmentation of the images by a neural network, followed by the registration of an EEG template on the obtained detections. We trained the neural network using 37 MR volumes and then we tested our method on 23 new volumes. The results show an average detection accuracy of 99.7% with an average position error of 2.24 mm, as well as 100% accuracy in the labeling.

scholarly journals Language switching training modulates the neural network of non-linguistic cognitive control

PLoS ONE ◽  
2021 ◽  
Vol 16 (4) ◽  
pp. e0247100
Author(s):  
Mo Chen ◽  
Fengyang Ma ◽  
Zhaoqi Zhang ◽  
Shuhua Li ◽  
Man Zhang ◽  
...  
Keyword(s):  
Neural Network ◽  
Cognitive Control ◽  
Structural Equation ◽  
Structural Equation Models ◽  
Brain Regions ◽  
Anterior Cingulate ◽  
Language Switching ◽  
Dorsal Anterior Cingulate Cortex ◽  
The Neural Network ◽  
The Impact

Bilingual language experience, such as switching between languages, has been shown to shape both cognitive and neural mechanisms of non-linguistic cognitive control. However, the neural adaptations induced by language switching remain unclear. Using fMRI, the current study examined the impact of short-term language switching training on the neural network of domain-general cognitive control for unbalanced Chinese-English bilinguals. Effective connectivity maps were constructed by using the extended unified structural equation models (euSEM) within 10 common brain regions involved in both language control and domain-general cognitive control. Results showed that, the dorsal anterior cingulate cortex/pre-supplementary motor area (dACC/pre-SMA) lost connection from the right thalamus after training, suggesting that less neural connectivity was required to complete the same domain-general cognitive control task. These findings not only provide direct evidence for the modulation of language switching training on the neural interaction of domain-general cognitive control, but also have important implications for revealing the potential neurocognitive adaptation effects of specific bilingual language experiences.

scholarly journals Evaluation of VIIRS Neural Network Cloud Detection against Current Operational Cloud Masks

2020 ◽  
Author(s):  
Charles H. White ◽  
Andrew K. Heidinger ◽  
Steven A. Ackerman
Keyword(s):  
Neural Network ◽  
Optical Depth ◽  
Infrared Imaging ◽  
Regional Analysis ◽  
True Positive Rate ◽  
Orthogonal Polarization ◽  
Cloud Detection ◽  
The Neural Network ◽  
Cloud Mask ◽  
The Impact

Abstract. Cloud properties are critical to our understanding of weather and climate variability, but their estimation from satellite imagers is a nontrivial task. In this work, we aim to improve cloud detection which is the most fundamental cloud property. We use a neural network applied to Visible Infrared Imaging Radiometer Suite (VIIRS) measurements to determine whether an imager pixel is cloudy or cloud-free. The neural network is trained and evaluated using four years (2016–2019) of coincident measurements between VIIRS and the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP). We successfully address the lack of sun glint in the collocation dataset with a simple semi-supervised learning approach. The results of the neural network are then compared with two operational cloud masks: the MODIS-VIIRS Continuity Cloud Mask (MVCM) and the NOAA Enterprise Cloud Mask (ECM). We find that the neural network outperforms both operational cloud masks in most conditions examined with a few exceptions. The largest improvements we observe occur during the night over snow or ice covered surfaces in the high latitudes. In our analysis, we show that this improvement is not solely due to differences in optical depth-based definitions of a cloud between each mask. We also analyze the differences in true positive rate between day/night and land/water scenes as a function of optical depth. Such differences are a contributor to spatial artifacts in cloud masking and we find that the neural network is the most consistent in cloud detection with respect to optical depth across these conditions. A regional analysis over Greenland illustrates the impact of such differences and shows that they can result in mean cloud fractions with very different spatial and temporal characteristics.

scholarly journals A Hierarchical Multi-Task Approach for Learning Embeddings from Semantic Tasks

2019 ◽  
Vol 33 ◽  
pp. 6949-6956 ◽  
Author(s):  
Victor Sanh ◽  
Thomas Wolf ◽  
Sebastian Ruder
Keyword(s):  
Language Processing ◽  
Semantic Information ◽  
State Of The Art ◽  
Named Entity Recognition ◽  
Relation Extraction ◽  
Entity Recognition ◽  
Inductive Bias ◽  
Named Entity ◽  
Task Learning ◽  
Hidden States

Much effort has been devoted to evaluate whether multi-task learning can be leveraged to learn rich representations that can be used in various Natural Language Processing (NLP) down-stream applications. However, there is still a lack of understanding of the settings in which multi-task learning has a significant effect. In this work, we introduce a hierarchical model trained in a multi-task learning setup on a set of carefully selected semantic tasks. The model is trained in a hierarchical fashion to introduce an inductive bias by supervising a set of low level tasks at the bottom layers of the model and more complex tasks at the top layers of the model. This model achieves state-of-the-art results on a number of tasks, namely Named Entity Recognition, Entity Mention Detection and Relation Extraction without hand-engineered features or external NLP tools like syntactic parsers. The hierarchical training supervision induces a set of shared semantic representations at lower layers of the model. We show that as we move from the bottom to the top layers of the model, the hidden states of the layers tend to represent more complex semantic information.

Bolt Tightening Using Impact Wrench Based on Neural Networks

2000 ◽  
Vol 12 (6) ◽  
pp. 706-711
Author(s):  
Toru Fujinaka ◽  
◽  
Hirofumi Nakano ◽  
Michifumi Yoshioka ◽  
Sigeru Omatu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Clamping Force ◽  
The Neural Network ◽  
The Impact

A method for controlling the tightening operation of bolts using an impact wrench is proposed, where the neural network is employed for achieving proper clamping force. The characteristics of the clamping force depend on the kind of work to which bolts are tightened, thus a neural network is used for classification of the work. The clamping force, which can only be measured during the test run, is estimated online, using another neural network. Then appropriate input to the actuator of the impact wrench is determined, based on the estimated value of the clamping force.

Sign in / Sign up

Export Citation Format

Share Document