Annotation of Spatial Relations in Natural Language

Author(s):  
Qijun Shen ◽  
Xueying Zhang ◽  
Wenming Jiang
2015 ◽  
Vol 52 ◽  
pp. 601-713 ◽  
Author(s):  
Haonan Yu ◽  
N. Siddharth ◽  
Andrei Barbu ◽  
Jeffrey Mark Siskind

We present an approach to simultaneously reasoning about a video clip and an entire natural-language sentence. The compositional nature of language is exploited to construct models which represent the meanings of entire sentences composed out of the meanings of the words in those sentences mediated by a grammar that encodes the predicate-argument relations. We demonstrate that these models faithfully represent the meanings of sentences and are sensitive to how the roles played by participants (nouns), their characteristics (adjectives), the actions performed (verbs), the manner of such actions (adverbs), and changing spatial relations between participants (prepositions) affect the meaning of a sentence and how it is grounded in video. We exploit this methodology in three ways. In the first, a video clip along with a sentence are taken as input and the participants in the event described by the sentence are highlighted, even when the clip depicts multiple similar simultaneous events. In the second, a video clip is taken as input without a sentence and a sentence is generated that describes an event in that clip. In the third, a corpus of video clips is paired with sentences which describe some of the events in those clips and the meanings of the words in those sentences are learned. We learn these meanings without needing to specify which attribute of the video clips each word in a given sentence refers to. The learned meaning representations are shown to be intelligible to humans.


Author(s):  
Massimo Mugnai

In his 1677 Dialogue, Leibniz answers the question of how it is possible that speakers of different languages agree on the same truths by postulating “a certain correspondence between characters and things”. In the mid-1680s, he arguably attempts to specify this “correspondence” by explaining how linguistic particles are connected to our perception of spatial relations among things in the world. Firstly, this paper focuses on the role that, according to Leibniz, signs and characters play in our knowledge. Secondly, it introduces the solution that can be found in the Dialogue to the problem of how the same truth can be expressed in different languages. After briefly expounding Leibniz’s theory of natural languages, the paper gives an account of Leibniz’s analysis of the nature of prepositions and of how they contribute, in a natural language, to determine the correspondence between characters and things that is mentioned in the Dialogue.


2006 ◽  
Vol 9 (1) ◽  
pp. 55-64 ◽  
Author(s):  
Du Shihong ◽  
Wang Qiao ◽  
Qin Qiming

Sign in / Sign up

Export Citation Format

Share Document