scholarly journals Graph Adaptation Network with Domain-Specific Word Alignment for Cross-Domain Relation Extraction

Sensors ◽  
2020 ◽  
Vol 20 (24) ◽  
pp. 7180
Author(s):  
Zhe Wang ◽  
Bo Yan ◽  
Chunhua Wu ◽  
Bin Wu ◽  
Xiujuan Wang ◽  
...  
Keyword(s):  
Relation Extraction ◽  
Local Features ◽  
Word Alignment ◽  
Target Domain ◽  
Domain Specific ◽  
Tripartite Graph ◽  
Cross Domain ◽  
Fixed Weight ◽  
Word Representation ◽  
Non Local

Cross-domain relation extraction has become an essential approach when target domain lacking labeled data. Most existing works adapted relation extraction models from the source domain to target domain through aligning sequential features, but failed to transfer non-local and non-sequential features such as word co-occurrence which are also critical for cross-domain relation extraction. To address this issue, in this paper, we propose a novel tripartite graph architecture to adapt non-local features when there is no labeled data in the target domain. The graph uses domain words as nodes to model the co-occurrence relation between domain-specific words and domain-independent words. Through graph convolutions on the tripartite graph, the information of domain-specific words is propagated so that the word representation can be fine-tuned to align domain-specific features. In addition, unlike the traditional graph structure, the weights of edges innovatively combine fixed weight and dynamic weight, to capture the global non-local features and avoid introducing noise to word representation. Experiments on three domains of ACE2005 datasets show that our method outperforms the state-of-the-art models by a big margin.

Domain-Specific Keyword Extraction Using Joint Modeling of Local and Global Contextual Semantics

2022 ◽  
Vol 16 (4) ◽  
pp. 1-30
Author(s):  
Muhammad Abulaish ◽  
Mohd Fazil ◽  
Mohammed J. Zaki
Keyword(s):  
Hybrid Approach ◽  
Joint Modeling ◽  
Keyword Extraction ◽  
Semantic Association ◽  
Target Domain ◽  
Domain Specific ◽  
Online Social Media ◽  
Word Representation ◽  
E Mail ◽  
Language Detection

Domain-specific keyword extraction is a vital task in the field of text mining. There are various research tasks, such as spam e-mail classification, abusive language detection, sentiment analysis, and emotion mining, where a set of domain-specific keywords (aka lexicon) is highly effective. Existing works for keyword extraction list all keywords rather than domain-specific keywords from a document corpus. Moreover, most of the existing approaches perform well on formal document corpuses but fail on noisy and informal user-generated content in online social media. In this article, we present a hybrid approach by jointly modeling the local and global contextual semantics of words, utilizing the strength of distributional word representation and contrasting-domain corpus for domain-specific keyword extraction. Starting with a seed set of a few domain-specific keywords, we model the text corpus as a weighted word-graph. In this graph, the initial weight of a node (word) represents its semantic association with the target domain calculated as a linear combination of three semantic association metrics, and the weight of an edge connecting a pair of nodes represents the co-occurrence count of the respective words. Thereafter, a modified PageRank method is applied to the word-graph to identify the most relevant words for expanding the initial set of domain-specific keywords. We evaluate our method over both formal and informal text corpuses (comprising six datasets), and show that it performs significantly better in comparison to state-of-the-art methods. Furthermore, we generalize our approach to handle the language-agnostic case, and show that it outperforms existing language-agnostic approaches.

scholarly journals Information-Theoretic Multi-view Domain Adaptation: A Theoretical and Empirical Study

2014 ◽  
Vol 49 ◽  
pp. 501-525 ◽  
Author(s):  
P. Yang ◽  
W. Gao
Keyword(s):  
Domain Adaptation ◽  
Classification Performance ◽  
Transfer Model ◽  
Multiple Views ◽  
Target Domain ◽  
Adaptation Algorithm ◽  
Information Theoretic ◽  
Single View ◽  
Domain Specific ◽  
Cross Domain

Multi-view learning aims to improve classification performance by leveraging the consistency among different views of data. The incorporation of multiple views was paid little attention in the studies of domain adaptation, where the view consistency based on source data is largely violated in the target domain due to the distribution gap between different domain data. In this paper, we leverage multiple views for cross-domain document classification. The central idea is to strengthen the views' consistency on target data by identifying the associations of domain-specific features from different domains. We present an Information-theoretic Multi-view Adaptation Model (IMAM) using a multi-way clustering scheme, where word and link clusters can draw together seemingly unrelated features across domains, which boosts the consistency between document clusterings that are based on the respective word and link views. Moreover, we demonstrate that IMAM can always find the document clustering with the minimal disagreement rate to the overlap of view-based clusterings. We provide both theoretical and empirical justifications of the proposed method. Our experiments show that IMAM significantly outperforms traditional multi-view algorithm co-training, the co-training-based adaptation algorithm CODA, the single-view transfer model CoCC and the large-margin-based multi-view transfer model MVTL-LM.

Self-Supervised Pre-training on the Target Domain for Cross-Domain Person Re-identification

2021 ◽  
Author(s):  
Junyin Zhang ◽  
Yongxin Ge ◽  
Xinqian Gu ◽  
Boyu Hua ◽  
Tao Xiang
Keyword(s):  
Target Domain ◽  
Cross Domain

scholarly journals Resisting Everything except Temptation: Evidence and an Explanation for Domain–specific Impulsivity

2012 ◽  
Vol 26 (3) ◽  
pp. 318-334 ◽  
Author(s):  
Eli Tsukayama ◽  
Angela Lee Duckworth ◽  
Betty Kim
Keyword(s):  
Interpersonal Relationships ◽  
Control Strategies ◽  
Self Control ◽  
Self Report ◽  
Special Interest Groups ◽  
Target Domain ◽  
Domain Specific ◽  
Impulsive Behaviour ◽  
Report Measure

We propose a model of impulsivity that predicts both domain–general and domain–specific variance in behaviours that produce short–term gratification at the expense of long–term goals and standards. Specifically, we posit that domain–general impulsivity is explained by domain–general self–control strategies and resources, whereas domain–specific impulsivity is explained by how tempting individuals find various impulsive behaviours, and to a lesser extent, in perceptions of their long–term harm. Using a novel self–report measure, factor analyses produced six (non–exhaustive) domains of impulsive behaviour (Studies 1–2): work, interpersonal relationships, drugs, food, exercise and finances. Domain–general self–control explained 40% of the variance in domain–general impulsive behaviour between individuals, reffect = .71. Domain–specific temptation ( reffect = .83) and perceived harm ( reffect = −.26) explained 40% and 2% of the unique within–individual variance in impulsive behaviour, respectively (59% together). In Study 3, we recruited individuals in special interest groups (e.g. procrastinators) to confirm that individuals who are especially tempted by behaviours in their target domain are not likely to be more tempted in non–target domains. Copyright © 2011 John Wiley & Sons, Ltd.

scholarly journals DISSECT: DISentangle SharablE ConTent for Multimodal Integration and Crosswise-mapping

2020 ◽  
Author(s):  
Geoffrey Schau ◽  
Erik Burlingame ◽  
Young Hwan Chang
Keyword(s):  
Deep Learning ◽  
Complete Information ◽  
Specific Information ◽  
Multimodal Integration ◽  
Specific Data ◽  
Domain Specific ◽  
Cross Domain ◽  
Input Feature ◽  
Novel Approach ◽  
Latent Representations

AbstractDeep learning systems have emerged as powerful mechanisms for learning domain translation models. However, in many cases, complete information in one domain is assumed to be necessary for sufficient cross-domain prediction. In this work, we motivate a formal justification for domain-specific information separation in a simple linear case and illustrate that a self-supervised approach enables domain translation between data domains while filtering out domain-specific data features. We introduce a novel approach to identify domainspecific information from sets of unpaired measurements in complementary data domains by considering a deep learning cross-domain autoencoder architecture designed to learn shared latent representations of data while enabling domain translation. We introduce an orthogonal gate block designed to enforce orthogonality of input feature sets by explicitly removing non-sharable information specific to each domain and illustrate separability of domain-specific information on a toy dataset.

scholarly journals An Iterative Multi-Source Mutual Knowledge Transfer Framework for Machine Reading Comprehension

2020 ◽  
Author(s):  
Xin Liu ◽  
Kai Liu ◽  
Xiang Li ◽  
Jinsong Su ◽  
Yubin Ge ◽  
...  
Keyword(s):  
Reading Comprehension ◽  
Knowledge Transfer ◽  
Training Data ◽  
Target Domain ◽  
Domain Specific ◽  
Mutual Knowledge ◽  
Benchmark Datasets ◽  
Knowledge Distillation ◽  
The Many ◽  
Machine Reading

The lack of sufficient training data in many domains, poses a major challenge to the construction of domain-specific machine reading comprehension (MRC) models with satisfying performance. In this paper, we propose a novel iterative multi-source mutual knowledge transfer framework for MRC. As an extension of the conventional knowledge transfer with one-to-one correspondence, our framework focuses on the many-to-many mutual transfer, which involves synchronous executions of multiple many-to-one transfers in an iterative manner.Specifically, to update a target-domain MRC model, we first consider other domain-specific MRC models as individual teachers, and employ knowledge distillation to train a multi-domain MRC model, which is differentially required to fit the training data and match the outputs of these individual models according to their domain-level similarities to the target domain. After being initialized by the multi-domain MRC model, the target-domain MRC model is fine-tuned to match both its training data and the output of its previous best model simultaneously via knowledge distillation. Compared with previous approaches, our framework can continuously enhance all domain-specific MRC models by enabling each model to iteratively and differentially absorb the domain-shared knowledge from others. Experimental results and in-depth analyses on several benchmark datasets demonstrate the effectiveness of our framework.

A Transformer-Based Approach to Multilingual Fake News Detection in Low-Resource Languages

2022 ◽  
Vol 21 (1) ◽  
pp. 1-20
Author(s):  
Arkadipta De ◽  
Dibyanayan Bandyopadhyay ◽  
Baban Gain ◽  
Asif Ekbal
Keyword(s):  
Language Processing ◽  
English Language ◽  
Neural Model ◽  
Fake News ◽  
Web Content ◽  
Low Resource ◽  
Domain Specific ◽  
Cross Domain ◽  
Current State ◽  
Domain Transfer

Fake news classification is one of the most interesting problems that has attracted huge attention to the researchers of artificial intelligence, natural language processing, and machine learning (ML). Most of the current works on fake news detection are in the English language, and hence this has limited its widespread usability, especially outside the English literate population. Although there has been a growth in multilingual web content, fake news classification in low-resource languages is still a challenge due to the non-availability of an annotated corpus and tools. This article proposes an effective neural model based on the multilingual Bidirectional Encoder Representations from Transformer (BERT) for domain-agnostic multilingual fake news classification. Large varieties of experiments, including language-specific and domain-specific settings, are conducted. The proposed model achieves high accuracy in domain-specific and domain-agnostic experiments, and it also outperforms the current state-of-the-art models. We perform experiments on zero-shot settings to assess the effectiveness of language-agnostic feature transfer across different languages, showing encouraging results. Cross-domain transfer experiments are also performed to assess language-independent feature transfer of the model. We also offer a multilingual multidomain fake news detection dataset of five languages and seven different domains that could be useful for the research and development in resource-scarce scenarios.

scholarly journals Optimal Transport with Dimensionality Reduction for Domain Adaptation

Symmetry ◽  
2020 ◽  
Vol 12 (12) ◽  
pp. 1994
Author(s):  
Ping Li ◽  
Zhiwei Ni ◽  
Xuhui Zhu ◽  
Juan Song ◽  
Wenying Wu
Keyword(s):  
Dimensionality Reduction ◽  
Optimal Transport ◽  
Domain Adaptation ◽  
Wasserstein Distance ◽  
Local Information ◽  
Target Domain ◽  
Source Domain ◽  
Second Stage ◽  
Cross Domain ◽  
Feature Based

Domain adaptation manages to learn a robust classifier for target domain, using the source domain, but they often follow different distributions. To bridge distribution shift between the two domains, most of previous works aim to align their feature distributions through feature transformation, of which optimal transport for domain adaptation has attract researchers’ interest, as it can exploit the local information of the two domains in the process of mapping the source instances to the target ones by minimizing Wasserstein distance between their feature distributions. However, it may weaken the feature discriminability of source domain, thus degrade domain adaptation performance. To address this problem, this paper proposes a two-stage feature-based adaptation approach, referred to as optimal transport with dimensionality reduction (OTDR). In the first stage, we apply the dimensionality reduction with intradomain variant maximization but source intraclass compactness minimization, to separate data samples as much as possible and enhance the feature discriminability of the source domain. In the second stage, we leverage optimal transport-based technique to preserve the local information of the two domains. Notably, the desirable properties in the first stage can mitigate the degradation of feature discriminability of the source domain in the second stage. Extensive experiments on several cross-domain image datasets validate that OTDR is superior to its competitors in classification accuracy.

Sign in / Sign up

Export Citation Format

Share Document