scholarly journals Non-commutative Logic for Compositional Distributional Semantics

2017 ◽  
pp. 110-124
Author(s):  
Karin Cvetko-Vah ◽  
Mehrnoosh Sadrzadeh ◽  
Dimitri Kartsaklis ◽  
Benjamin Blundell
Keyword(s):  
Distributional Semantics ◽  
Compositional Distributional Semantics

scholarly journals Compositional Distributional Semantics with Syntactic Dependencies and Selectional Preferences

2021 ◽  
Vol 11 (12) ◽  
pp. 5743
Author(s):  
Pablo Gamallo
Keyword(s):  
English Language ◽  
State Of The Art ◽  
Current Work ◽  
Distributional Semantics ◽  
Compositional Model ◽  
Compositional Approach ◽  
Sentence Similarity ◽  
Selectional Preferences ◽  
Syntactic Dependencies ◽  
Compositional Distributional Semantics

This article describes a compositional model based on syntactic dependencies which has been designed to build contextualized word vectors, by following linguistic principles related to the concept of selectional preferences. The compositional strategy proposed in the current work has been evaluated on a syntactically controlled and multilingual dataset, and compared with Transformer BERT-like models, such as Sentence BERT, the state-of-the-art in sentence similarity. For this purpose, we created two new test datasets for Portuguese and Spanish on the basis of that defined for the English language, containing expressions with noun-verb-noun transitive constructions. The results we have obtained show that the linguistic-based compositional approach turns out to be competitive with Transformer models.

scholarly journals When the Whole Is Not Greater Than the Combination of Its Parts: A “Decompositional” Look at Compositional Distributional Semantics

2015 ◽  
Vol 41 (1) ◽  
pp. 165-173 ◽  
Author(s):  
Fabio Massimo Zanzotto ◽  
Lorenzo Ferrone ◽  
Marco Baroni
Keyword(s):  
Distributional Semantics ◽  
Important Class ◽  
Strong Link ◽  
Composition Methods ◽  
Convolution Kernels ◽  
Composition Operations ◽  
Compositional Distributional Semantics

Distributional semantics has been extended to phrases and sentences by means of composition operations. We look at how these operations affect similarity measurements, showing that similarity equations of an important class of composition methods can be decomposed into operations performed on the subparts of the input phrases. This establishes a strong link between these models and convolution kernels.

scholarly journals A generalised quantifier theory of natural language in categorical compositional distributional semantics with bialgebras

2019 ◽  
Vol 29 (06) ◽  
pp. 783-809
Author(s):  
Jules Hedges ◽  
Mehrnoosh Sadrzadeh
Keyword(s):  
Natural Language ◽  
Vector Space ◽  
Generative Grammar ◽  
Distributional Semantics ◽  
Compositional Semantics ◽  
Finite Dimensional ◽  
Linear Maps ◽  
First Time ◽  
Quantifier Theory ◽  
Compositional Distributional Semantics

AbstractCategorical compositional distributional semantics is a model of natural language; it combines the statistical vector space models of words with the compositional models of grammar. We formalise in this model the generalised quantifier theory of natural language, due to Barwise and Cooper. The underlying setting is a compact closed category with bialgebras. We start from a generative grammar formalisation and develop an abstract categorical compositional semantics for it, and then instantiate the abstract setting to sets and relations and to finite-dimensional vector spaces and linear maps. We prove the equivalence of the relational instantiation to the truth theoretic semantics of generalised quantifiers. The vector space instantiation formalises the statistical usages of words and enables us to, for the first time, reason about quantified phrases and sentences compositionally in distributional semantics.

scholarly journals Aligning Packed Dependency Trees: A Theory of Composition for Distributional Semantics

2016 ◽  
Vol 42 (4) ◽  
pp. 727-761 ◽  
Author(s):  
David Weir ◽  
Julie Weeds ◽  
Jeremy Reffin ◽  
Thomas Kober
Keyword(s):  
Distributional Semantics ◽  
Dependency Trees ◽  
Distributional Knowledge ◽  
Compositional Distributional Semantics ◽  
New Framework

We present a new framework for compositional distributional semantics in which the distributional contexts of lexemes are expressed in terms of anchored packed dependency trees. We show that these structures have the potential to capture the full sentential contexts of a lexeme and provide a uniform basis for the composition of distributional knowledge in a way that captures both mutual disambiguation and generalization.

scholarly journals Frege in Space: A Program for Compositional Distributional Semantics

2014 ◽  
Vol 9 ◽  
Author(s):  
Marco Baroni ◽  
Raffaella Bernardi ◽  
Roberto Zamparelli
Keyword(s):  
Formal Semantics ◽  
Word Meaning ◽  
Distributional Semantics ◽  
Huge Number ◽  
Word Meanings ◽  
New Approach ◽  
Lexical Meaning ◽  
Text Corpora ◽  
Distinct Word ◽  
Compositional Distributional Semantics

The lexicon of any natural language encodes a huge number of distinct word meanings. Just to understand this article, you will need to know what thousands of words mean. The space of possible sentential meanings is infinite: In this article alone, you will encounter many sentences that express ideas you have never heard before, we hope. Statistical semantics has addressed the issue of the vastness of word meaning by proposing methods to harvest meaning automatically from large collections of text (corpora). Formal semantics in the Fregean tradition has developed methods to account for the infinity of sentential meaning based on the crucial insight of compositionality, the idea that meaning of sentences is built incrementally by combining the meanings of their constituents. This article sketches a new approach to semantics that brings together ideas from statistical and formal semantics to account, in parallel, for the richness of lexical meaning and the combinatorial power of sentential semantics. We adopt, in particular, the idea that word meaning can be approximated by the patterns of co-occurrence of words in corpora from statistical semantics, and the idea that compositionality can be captured in terms of a syntax-driven calculus of function application from formal semantics.

scholarly journals Sentence entailment in compositional distributional semantics

2018 ◽  
Vol 82 (4) ◽  
pp. 189-218 ◽  
Author(s):  
Mehrnoosh Sadrzadeh ◽  
Dimitri Kartsaklis ◽  
Esma Balkır
Keyword(s):  
Distributional Semantics ◽  
Compositional Distributional Semantics
Sign in / Sign up

Export Citation Format

Share Document