scholarly journals Cross-Lingual Syntactic Transfer with Limited Resources

2017 ◽  
Vol 5 ◽  
pp. 279-293 ◽  
Author(s):  
Mohammad Sadegh Rasooli ◽  
Michael Collins
Keyword(s):  
Projection Method ◽  
State Of The Art ◽  
The State ◽  
Target Language ◽  
Limited Resources ◽  
Lexical Information ◽  
Source Language ◽  
The Bible ◽  
Cross Lingual

We describe a simple but effective method for cross-lingual syntactic transfer of dependency parsers, in the scenario where a large amount of translation data is not available. This method makes use of three steps: 1) a method for deriving cross-lingual word clusters, which can then be used in a multilingual parser; 2) a method for transferring lexical information from a target language to source language treebanks; 3) a method for integrating these steps with the density-driven annotation projection method of Rasooli and Collins (2015). Experiments show improvements over the state-of-the-art in several languages used in previous work, in a setting where the only source of translation data is the Bible, a considerably smaller corpus than the Europarl corpus used in previous work. Results using the Europarl corpus as a source of translation data show additional improvements over the results of Rasooli and Collins (2015). We conclude with results on 38 datasets from the Universal Dependencies corpora.

scholarly journals Improving Candidate Generation for Low-resource Cross-lingual Entity Linking

2020 ◽  
Vol 8 ◽  
pp. 109-124
Author(s):  
Shuyan Zhou ◽  
Shruti Rijhwani ◽  
John Wieting ◽  
Jaime Carbonell ◽  
Graham Neubig
Keyword(s):  
State Of The Art ◽  
Target Language ◽  
Entity Linking ◽  
Average Gain ◽  
Source Language ◽  
Low Resource ◽  
High Resource ◽  
Language Knowledge ◽  
Cross Lingual ◽  
Improved Model

Cross-lingual entity linking (XEL) is the task of finding referents in a target-language knowledge base (KB) for mentions extracted from source-language texts. The first step of (X)EL is candidate generation, which retrieves a list of plausible candidate entities from the target-language KB for each mention. Approaches based on resources from Wikipedia have proven successful in the realm of relatively high-resource languages, but these do not extend well to low-resource languages with few, if any, Wikipedia pages. Recently, transfer learning methods have been shown to reduce the demand for resources in the low-resource languages by utilizing resources in closely related languages, but the performance still lags far behind their high-resource counterparts. In this paper, we first assess the problems faced by current entity candidate generation methods for low-resource XEL, then propose three improvements that (1) reduce the disconnect between entity mentions and KB entries, and (2) improve the robustness of the model to low-resource scenarios. The methods are simple, but effective: We experiment with our approach on seven XEL datasets and find that they yield an average gain of 16.9% in Top-30 gold candidate recall, compared with state-of-the-art baselines. Our improved model also yields an average gain of 7.9% in in-KB accuracy of end-to-end XEL. 1

scholarly journals Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classification

2018 ◽  
Vol 6 ◽  
pp. 557-570 ◽  
Author(s):  
Xilun Chen ◽  
Yu Sun ◽  
Ben Athiwaratkun ◽  
Claire Cardie ◽  
Kilian Weinberger
Keyword(s):  
State Of The Art ◽  
Classification Problem ◽  
Sentiment Classification ◽  
Great Success ◽  
Source Language ◽  
Shared Feature ◽  
Low Resource ◽  
Feature Extractor ◽  
Cross Lingual ◽  
Averaging Network

In recent years great success has been achieved in sentiment classification for English, thanks in part to the availability of copious annotated resources. Unfortunately, most languages do not enjoy such an abundance of labeled data. To tackle the sentiment classification problem in low-resource languages without adequate annotated data, we propose an Adversarial Deep Averaging Network (ADAN 1 ) to transfer the knowledge learned from labeled data on a resource-rich source language to low-resource languages where only unlabeled data exist. ADAN has two discriminative branches: a sentiment classifier and an adversarial language discriminator. Both branches take input from a shared feature extractor to learn hidden representations that are simultaneously indicative for the classification task and invariant across languages. Experiments on Chinese and Arabic sentiment classification demonstrate that ADAN significantly outperforms state-of-the-art systems.

scholarly journals Reinforced Transformer with Cross-Lingual Distillation for Cross-Lingual Aspect Sentiment Classification

Electronics ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 270
Author(s):  
Hanqian Wu ◽  
Zhike Wang ◽  
Feng Qing ◽  
Shoushan Li
Keyword(s):  
General Purpose ◽  
Sentiment Classification ◽  
Training Data ◽  
Target Language ◽  
Source Language ◽  
Domain Specific ◽  
Novel Approach ◽  
The Rich ◽  
Target Languages ◽  
Cross Lingual

Though great progress has been made in the Aspect-Based Sentiment Analysis(ABSA) task through research, most of the previous work focuses on English-based ABSA problems, and there are few efforts on other languages mainly due to the lack of training data. In this paper, we propose an approach for performing a Cross-Lingual Aspect Sentiment Classification (CLASC) task which leverages the rich resources in one language (source language) for aspect sentiment classification in a under-resourced language (target language). Specifically, we first build a bilingual lexicon for domain-specific training data to translate the aspect category annotated in the source-language corpus and then translate sentences from the source language to the target language via Machine Translation (MT) tools. However, most MT systems are general-purpose, it non-avoidably introduces translation ambiguities which would degrade the performance of CLASC. In this context, we propose a novel approach called Reinforced Transformer with Cross-Lingual Distillation (RTCLD) combined with target-sensitive adversarial learning to minimize the undesirable effects of translation ambiguities in sentence translation. We conduct experiments on different language combinations, treating English as the source language and Chinese, Russian, and Spanish as target languages. The experimental results show that our proposed approach outperforms the state-of-the-art methods on different target languages.

scholarly journals Embedding Projection for Targeted Cross-lingual Sentiment: Model Comparisons and a Real-World Study

2019 ◽  
Vol 66 ◽  
Author(s):  
Jeremy Barnes ◽  
Roman Klinger
Keyword(s):  
Sentiment Analysis ◽  
State Of The Art ◽  
Target Language ◽  
Test Machine ◽  
Fine Grained ◽  
Sentence Level ◽  
Level Information ◽  
Cross Lingual ◽  
Multiple Domains ◽  
Embedding Methods

Sentiment analysis benefits from large, hand-annotated resources in order to train and test machine learning models, which are often data hungry. While some languages, e.g., English, have a vast arrayof these resources, most under-resourced languages do not, especially for fine-grained sentiment tasks, such as aspect-level or targeted sentiment analysis. To improve this situation, we propose a cross-lingual approach to sentiment analysis that is applicable to under-resourced languages and takes into account target-level information. This model incorporates sentiment information into bilingual distributional representations, byjointly optimizing them for semantics and sentiment, showing state-of-the-art performance at sentence-level when combined with machine translation. The adaptation to targeted sentiment analysis on multiple domains shows that our model outperforms other projection-based bilingual embedding methods on binary targetedsentiment tasks. Our analysis on ten languages demonstrates that the amount of unlabeled monolingual data has surprisingly little effect on the sentiment results. As expected, the choice of a annotated source language for projection to a target leads to better results for source-target language pairs which are similar. Therefore, our results suggest that more efforts should be spent on the creation of resources for less similar languages tothose which are resource-rich already. Finally, a domain mismatch leads to a decreased performance. This suggests resources in any language should ideally cover varieties of domains.

scholarly journals Exploiting Cross-Lingual Subword Similarities in Low-Resource Document Classification

2020 ◽  
Vol 34 (05) ◽  
pp. 9547-9554
Author(s):  
Mozhi Zhang ◽  
Yoshinari Fujinuma ◽  
Jordan Boyd-Graber
Keyword(s):  
Knowledge Transfer ◽  
Text Classification ◽  
Document Classification ◽  
Training Data ◽  
Target Language ◽  
Source Language ◽  
Low Resource ◽  
Classification Framework ◽  
Related Language ◽  
Cross Lingual

Text classification must sometimes be applied in a low-resource language with no labeled training data. However, training data may be available in a related language. We investigate whether character-level knowledge transfer from a related language helps text classification. We present a cross-lingual document classification framework (caco) that exploits cross-lingual subword similarity by jointly training a character-based embedder and a word-based classifier. The embedder derives vector representations for input words from their written forms, and the classifier makes predictions based on the word vectors. We use a joint character representation for both the source language and the target language, which allows the embedder to generalize knowledge about source language words to target language words with similar forms. We propose a multi-task objective that can further improve the model if additional cross-lingual or monolingual resources are available. Experiments confirm that character-level knowledge transfer is more data-efficient than word-level transfer between related languages.

scholarly journals Source Language Adaptation Approaches for Resource-Poor Machine Translation

2016 ◽  
Vol 42 (2) ◽  
pp. 277-306 ◽  
Author(s):  
Pidong Wang ◽  
Preslav Nakov ◽  
Hwee Tou Ng
Keyword(s):  
Machine Translation ◽  
Statistical Machine Translation ◽  
Target Language ◽  
Source Language ◽  
World Languages ◽  
Word Level ◽  
Resource Poor ◽  
Morphological Variants ◽  
Cross Lingual ◽  
Translation Systems

Most of the world languages are resource-poor for statistical machine translation; still, many of them are actually related to some resource-rich language. Thus, we propose three novel, language-independent approaches to source language adaptation for resource-poor statistical machine translation. Specifically, we build improved statistical machine translation models from a resource-poor language POOR into a target language TGT by adapting and using a large bitext for a related resource-rich language RICH and the same target language TGT. We assume a small POOR–TGT bitext from which we learn word-level and phrase-level paraphrases and cross-lingual morphological variants between the resource-rich and the resource-poor language. Our work is of importance for resource-poor machine translation because it can provide a useful guideline for people building machine translation systems for resource-poor languages. Our experiments for Indonesian/Malay–English translation show that using the large adapted resource-rich bitext yields 7.26 BLEU points of improvement over the unadapted one and 3.09 BLEU points over the original small bitext. Moreover, combining the small POOR–TGT bitext with the adapted bitext outperforms the corresponding combinations with the unadapted bitext by 1.93–3.25 BLEU points. We also demonstrate the applicability of our approaches to other languages and domains.

scholarly journals Emu: Enhancing Multilingual Sentence Embeddings with Semantic Specialization

2020 ◽  
Vol 34 (05) ◽  
pp. 7935-7943
Author(s):  
Wataru Hirota ◽  
Yoshihiko Suhara ◽  
Behzad Golshan ◽  
Wang-Chiew Tan
Keyword(s):  
Semantic Similarity ◽  
State Of The Art ◽  
The State ◽  
Experimental Results ◽  
Adversarial Training ◽  
Main Components ◽  
Cross Lingual

We present Emu, a system that semantically enhances multilingual sentence embeddings. Our framework fine-tunes pre-trained multilingual sentence embeddings using two main components: a semantic classifier and a language discriminator. The semantic classifier improves the semantic similarity of related sentences, whereas the language discriminator enhances the multilinguality of the embeddings via multilingual adversarial training. Our experimental results based on several language pairs show that our specialized embeddings outperform the state-of-the-art multilingual sentence embedding model on the task of cross-lingual intent classification using only monolingual labeled data.

scholarly journals Synthetic Treebanking for Cross-Lingual Dependency Parsing

2016 ◽  
Vol 55 ◽  
pp. 209-248 ◽  
Author(s):  
Jörg Tiedemann ◽  
Zeljko Agić
Keyword(s):  
Machine Translation ◽  
Target Language ◽  
Dependency Parsing ◽  
Practical Applications ◽  
Source Language ◽  
Part Of Speech ◽  
Statistical Dependency ◽  
Target Languages ◽  
Cross Lingual ◽  
The Impact

How do we parse the languages for which no treebanks are available? This contribution addresses the cross-lingual viewpoint on statistical dependency parsing, in which we attempt to make use of resource-rich source language treebanks to build and adapt models for the under-resourced target languages. We outline the benefits, and indicate the drawbacks of the current major approaches. We emphasize synthetic treebanking: the automatic creation of target language treebanks by means of annotation projection and machine translation. We present competitive results in cross-lingual dependency parsing using a combination of various techniques that contribute to the overall success of the method. We further include a detailed discussion about the impact of part-of-speech label accuracy on parsing results that provide guidance in practical applications of cross-lingual methods for truly under-resourced languages.

scholarly journals An Analysis of Interference from Javanese in the Pronunciation of ,  and  in English by the Students of Faculty of Letters in Gajayana University.

2020 ◽  
Vol 1 (1) ◽  
Author(s):  
Pradnya Pramita Dewi
Keyword(s):  
Foreign Language ◽  
Native Speakers ◽  
First Language ◽  
The State ◽  
Target Language ◽  
Vocal Cords ◽  
English As Foreign Language ◽  
Source Language ◽  
Place Of Articulation ◽  
The Way

English as one of the international languages has been learned by the students of Faculty of Letters in Gajayana University. In learning English as foreign language, most learners have problem in pronunciation, especially in the way they pronounce the sound of the target language. Mispronunciations which are produce by the learners is caused by the interference of the source language or first language. The object of this research is the students of Faculty of Letters in Gajayana University 2005/2006 intake who are native speakers of Javanese and have been done phonology class. Some specific sounds are discussed in these research namely English sounds of inter-dental fricative,  and alveolar approximant. The finding of the research are some interferences occur in pronouncing those sounds, they are 1) voiceless inter-dental fricative  is pronounced using voiceless dental stop , aspirated voiceless dental stop , voiced dental stop , and voiceless palato-alveolar affricate . 2).Voiced inter-dental fricative is pronounce using voiceless dental stop , aspirated voiceless dental stop , voiced dental stop , and voiceless palato-alveolar affricate . 3).Voiced alveolar approximant  is pronounced using voiced alveolar trill. 4). the possible reasons for the interferences made are based on the similarity of characteristics in the state of vocal cords, place of articulation, and manner of articulations.

scholarly journals Emoji-Powered Representation Learning for Cross-Lingual Sentiment Classification (Extended Abstract)

2020 ◽  
Author(s):  
Zhenpeng Chen ◽  
Sheng Shen ◽  
Ziniu Hu ◽  
Xuan Lu ◽  
Qiaozhu Mei ◽  
...  
Keyword(s):  
Machine Translation ◽  
Representation Learning ◽  
Sentiment Classification ◽  
Target Language ◽  
Learning Method ◽  
Source Language ◽  
Translation Tools ◽  
Target Languages ◽  
Cross Lingual ◽  
Cross Language

Sentiment classification typically relies on a large amount of labeled data. In practice, the availability of labels is highly imbalanced among different languages. To tackle this problem, cross-lingual sentiment classification approaches aim to transfer knowledge learned from one language that has abundant labeled examples (i.e., the source language, usually English) to another language with fewer labels (i.e., the target language). The source and the target languages are usually bridged through off-the-shelf machine translation tools. Through such a channel, cross-language sentiment patterns can be successfully learned from English and transferred into the target languages. This approach, however, often fails to capture sentiment knowledge specific to the target language. In this paper, we employ emojis, which are widely available in many languages, as a new channel to learn both the cross-language and the language-specific sentiment patterns. We propose a novel representation learning method that uses emoji prediction as an instrument to learn respective sentiment-aware representations for each language. The learned representations are then integrated to facilitate cross-lingual sentiment classification.

Sign in / Sign up

Export Citation Format

Share Document