Compositional Language Engineering Using Generated, Extensible, Static Type-Safe Visitors

2016 ◽  
pp. 67-82 ◽  
Author(s):  
Robert Heim ◽  
Pedram Mir Seyed Nazari ◽  
Bernhard Rumpe ◽  
Andreas Wortmann
Keyword(s):  
Language Engineering ◽  
Compositional Language

scholarly journals Language engineering for syntactic knowledge transfer

2012 ◽  
Vol 9 (3) ◽  
pp. 1231-1247 ◽  
Author(s):  
Mihaela Colhon
Keyword(s):  
Knowledge Transfer ◽  
Syntactic Parsing ◽  
Language Engineering ◽  
Syntactic Knowledge ◽  
Cross Lingual ◽  
Parallel Texts

In this paper we present a method for an English-Romanian treebank construction, together with the obtained evaluation results. The treebank is built upon a parallel English-Romanian corpus word-aligned and annotated at the morphological and syntactic level. The syntactic trees of the Romanian texts are generated by considering the syntactic phrases of the English parallel texts automatically resulted from syntactic parsing. The method reuses and adjusts existing tools and algorithms for cross-lingual transfer of syntactic constituents and syntactic trees alignment.

scholarly journals Emerging trends: A gentle introduction to fine-tuning

2021 ◽  
Vol 27 (6) ◽  
pp. 763-778
Author(s):  
Kenneth Ward Church ◽  
Zeyu Chen ◽  
Yanjun Ma
Keyword(s):  
Natural Language ◽  
Language Processing ◽  
Question Answering ◽  
General Purpose ◽  
Fine Tuning ◽  
Language Engineering ◽  
Training Models ◽  
Emerging Trends ◽  
Foundation Model ◽  
Programming Skills

AbstractThe previous Emerging Trends article (Church et al., 2021. Natural Language Engineering27(5), 631–645.) introduced deep nets to poets. Poets is an imperfect metaphor, intended as a gesture toward inclusion. The future for deep nets will benefit by reaching out to a broad audience of potential users, including people with little or no programming skills, and little interest in training models. That paper focused on inference, the use of pre-trained models, as is, without fine-tuning. The goal of this paper is to make fine-tuning more accessible to a broader audience. Since fine-tuning is more challenging than inference, the examples in this paper will require modest programming skills, as well as access to a GPU. Fine-tuning starts with a general purpose base (foundation) model and uses a small training set of labeled data to produce a model for a specific downstream application. There are many examples of fine-tuning in natural language processing (question answering (SQuAD) and GLUE benchmark), as well as vision and speech.

Compositional Syntax From Cultural Transmission

2002 ◽  
Vol 8 (1) ◽  
pp. 25-54 ◽  
Author(s):  
Henry Brighton
Keyword(s):  
Cultural Transmission ◽  
Language Evolution ◽  
Syntactic Structure ◽  
Language Learner ◽  
Characteristic Structure ◽  
Language Structure ◽  
Compositional Language ◽  
Acquisition Device ◽  
Knowledge Of Language ◽  
Language Exposure

A growing body of work demonstrates that syntactic structure can evolve in populations of genetically identical agents. Traditional explanations for the emergence of syntactic structure employ an argument based on genetic evolution: Syntactic structure is specified by an innate language acquisition device (LAD). Knowledge of language is complex, yet the data available to the language learner are sparse. This incongruous situation, termed the “poverty of the stimulus,” is accounted for by placing much of the specification of language in the LAD. The assumption is that the characteristic structure of language is somehow coded genetically. The effect of language evolution on the cultural substrate, in the absence of genetic change, is not addressed by this explanation. We show that the poverty of the stimulus introduces a pressure for compositional language structure when we consider language evolution resulting from iterated observational learning. We use a mathematical model to map the space of parameters that result in compositional syntax. Our hypothesis is that compositional syntax cannot be explained by understanding the LAD alone: Compositionality is an emergent property of the dynamics resulting from sparse language exposure.

Language Engineering

1950 ◽  
Vol 22 (6) ◽  
pp. 720-725 ◽  
Author(s):  
George A. Miller
Keyword(s):  
Language Engineering

Two artists and two mélodies

2021 ◽  
Vol 21 (3) ◽  
pp. 375-398
Author(s):  
Clare Wilson
Keyword(s):  
Poetic Language ◽  
The Poor ◽  
Musical Structures ◽  
Compositional Language ◽  
Poetic Imagery ◽  
Insight Into ◽  
Musical Character

André Caplet (1878-1925) set just two of Baudelaire’s poems: La Cloche fêlée [‘The Cracked Bell’] and La Mort des pauvres [‘The Death of the Poor’]. These mélodies were composed in 1922, just three years before the artist’s death. For a composer with a tendency to shy away from setting poetry of the French giants of literature, the questions of how and why Caplet chose to translate Baudelaire’s poetry into the mélodie are intriguing. This exploration of La Cloche fêlée and La Mort des pauvres considers the ways in which Caplet reflects the poetic imagery of Baudelaire’s texts within musical structures. Caplet’s compositional language is distinctive, and his artistic approach to musically illuminating poetic meaning is perceptive and sensitive. Through viewing the creative intersection of these two artists, this article offers an interpretation that presents a perspective on Caplet’s musical character and reveals insight into his connection to Baudelaire’s poetic language.

Sign in / Sign up

Export Citation Format

Share Document