Reference in Robotics

Author(s):  
Tom Williams ◽  
Matthias Scheutz

As robots become increasingly prevalent in our society, it becomes increasingly important to endow them with natural language capabilities, including the ability to both understand and generate so-called referring expressions. In recent work, we have sought to enable referring expression understanding capabilities by leveraging the Givenness Hierarchy (GH), which provides an elegant linguistic framework for reasoning about notions of reference in human discourse. This chapter first provides an overview of the GH and discusses previous GH-theoretic approaches to reference resolution. It then describes our own GH-theoretic approach, the GH-POWER algorithm, and suggests future refinements of our algorithm with respect to the theoretical commitments of the GH. Next, the chapter briefly surveys other prominent approaches to reference resolution in robotics, and discusses how these compare to our approach. Finally, it concludes with a discussion of possible directions for future work.

2020 ◽  
Vol 34 (05) ◽  
pp. 9081-9089
Author(s):  
Takuma Udagawa ◽  
Akiko Aizawa

Common grounding is the process of creating, repairing and updating mutual understandings, which is a fundamental aspect of natural language conversation. However, interpreting the process of common grounding is a challenging task, especially under continuous and partially-observable context where complex ambiguity, uncertainty, partial understandings and misunderstandings are introduced. Interpretation becomes even more challenging when we deal with dialogue systems which still have limited capability of natural language understanding and generation. To address this problem, we consider reference resolution as the central subtask of common grounding and propose a new resource to study its intermediate process. Based on a simple and general annotation schema, we collected a total of 40,172 referring expressions in 5,191 dialogues curated from an existing corpus, along with multiple judgements of referent interpretations. We show that our annotation is highly reliable, captures the complexity of common grounding through a natural degree of reasonable disagreements, and allows for more detailed and quantitative analyses of common grounding strategies. Finally, we demonstrate the advantages of our annotation for interpreting, analyzing and improving common grounding in baseline dialogue systems.


2021 ◽  
pp. 103530462110147
Author(s):  
Mark Dean ◽  
Al Rainnie ◽  
Jim Stanford ◽  
Dan Nahum

This article critically analyses the opportunities for Australia to revitalise its strategically important manufacturing sector in the wake of the COVID-19 pandemic. It considers Australia’s industry policy options on the basis of both advances in the theory of industrial policy and recent policy proposals in the Australian context. It draws on recent work from The Australia Institute’s Centre for Future Work examining the prospects for Australian manufacturing renewal in a post-COVID-19 economy, together with other recent work in political economy, economic geography and labour process theory critically evaluating the Fourth Industrial Revolution (i4.0) and its implications for the Australian economy. The aim of the article is to contribute to and further develop the debate about the future of government intervention in manufacturing and industry policy in Australia. Crucially, the argument links the future development of Australian manufacturing with a focus on renewable energy. JEL Codes: L50; L52; L78; O10; O13: O25; O44; P18; Q42


2017 ◽  
Vol 54 (4) ◽  
pp. 475-488
Author(s):  
MATTHEW McKEEVER

AbstractIn this article, I argue that recent work in analytic philosophy on the semantics of names and the metaphysics of persistence supports two theses in Buddhist philosophy, namely the impermanence of objects and a corollary about how referential language works. According to this latter package of views, the various parts of what we call one object (say, King Milinda) possess no unity in and of themselves. Unity comes rather from language, in that we have terms (say, ‘King Milinda’) which stand for all the parts taken together. Objects are mind- (or rather language-)generated fictions. I think this package can be cashed out in terms of two central contemporary views. The first is that there are temporal parts: just as an object is spatially extended by having spatial parts at different spatial locations, so it is temporally extended by having temporal parts at different temporal locations. The second is that names are predicates: rather than standing for any one thing, a name stands for a range of things. The natural language term ‘Milinda’ is not akin to a logical constant, but akin to a predicate.Putting this together, I'll argue that names are predicates with temporal parts in their extension, which parts have no unity apart from falling under the same predicate. ‘Milinda’ is a predicate which has in its extension all Milinda's parts. The result is an interesting and original synthesis of plausible positions in semantics and metaphysics, which makes good sense of a central Buddhist doctrine.


Author(s):  
Yixin Nie ◽  
Yicheng Wang ◽  
Mohit Bansal

Success in natural language inference (NLI) should require a model to understand both lexical and compositional semantics. However, through adversarial evaluation, we find that several state-of-the-art models with diverse architectures are over-relying on the former and fail to use the latter. Further, this compositionality unawareness is not reflected via standard evaluation on current datasets. We show that removing RNNs in existing models or shuffling input words during training does not induce large performance loss despite the explicit removal of compositional information. Therefore, we propose a compositionality-sensitivity testing setup that analyzes models on natural examples from existing datasets that cannot be solved via lexical features alone (i.e., on which a bag-of-words model gives a high probability to one wrong label), hence revealing the models’ actual compositionality awareness. We show that this setup not only highlights the limited compositional ability of current NLI models, but also differentiates model performance based on design, e.g., separating shallow bag-of-words models from deeper, linguistically-grounded tree-based models. Our evaluation setup is an important analysis tool: complementing currently existing adversarial and linguistically driven diagnostic evaluations, and exposing opportunities for future work on evaluating models’ compositional understanding.


2018 ◽  
Author(s):  
Gabriela K. Fragiadakis ◽  
Samuel A. Smits ◽  
Erica D. Sonnenburg ◽  
William Van Treuren ◽  
Gregor Reid ◽  
...  

AbstractThe study of traditional populations provides a view of human-associated microbes unperturbed by industrialization, as well as a window into the microbiota that co-evolved with humans. Here we discuss our recent work characterizing the microbiota from the Hadza hunter-gatherers of Tanzania. We found seasonal shifts in bacterial taxa, diversity, and carbohydrate utilization by the microbiota. When compared to the microbiota composition from other populations around the world, the Hadza microbiota shares bacterial families with other traditional societies that are rare or absent from microbiotas of industrialized nations. We present additional observations from the Hadza microbiota and their lifestyle and environment, including microbes detected on hands, water, and animal sources, how the microbiota varies with sex and age, and the shortterm effects of introducing agricultural products into the diet. In the context of our previously published findings and of these additional observations, we discuss a path forward for future work.


2015 ◽  
Vol 7 (1) ◽  
Author(s):  
António Teixeira ◽  
José Casimiro Pereira ◽  
Pedro Goucha Francisco ◽  
Nuno Almeida

Automatic translation is usually related to conversion between human languages. Nevertheless, in human-machine interaction scenarios new forms of translation emerged. This work presents two examples. First, from the area of Natural Language Generation, is presented a data-to-text system, where data stored in a database regarding a medication plan is translated to Portuguese. As second example, is presented a system addressing the transmission of information from humans to computers, showing that automatic translation can be useful in the development of systems that use voice commands for interaction and having multilingualism as a requirement. The examples presented, part of our recent work, demonstrate the increase of application areas for automatic translation, area that received many and valuable contributions from Belinda Maia.


Author(s):  
Michaela Regneri ◽  
Marcus Rohrbach ◽  
Dominikus Wetzel ◽  
Stefan Thater ◽  
Bernt Schiele ◽  
...  

Recent work has shown that the integration of visual information into text-based models can substantially improve model predictions, but so far only visual information extracted from static images has been used. In this paper, we consider the problem of grounding sentences describing actions in visual information extracted from videos. We present a general purpose corpus that aligns high quality videos with multiple natural language descriptions of the actions portrayed in the videos, together with an annotation of how similar the action descriptions are to each other. Experimental results demonstrate that a text-based model of similarity between actions improves substantially when combined with visual information from videos depicting the described actions.


2019 ◽  
Vol 119 (2) ◽  
pp. 157-178 ◽  
Author(s):  
Nicholas K Jones

Abstract There are two broad approaches to theorizing about ontological categories. Quineans use first-order quantifiers to generalize over entities of each category, whereas type theorists use quantification on variables of different semantic types to generalize over different categories. Does anything of import turn on the difference between these approaches? If so, are there good reasons to go type-theoretic? I argue for positive answers to both questions concerning the category of propositions. I also discuss two prominent arguments for a Quinean conception of propositions, concerning their role in natural language semantics and apparent quantification over propositions within natural language. It will emerge that even if these arguments are sound, there need be no deep question about Quinean propositions’ true nature, contrary to much recent work on the metaphysics of propositions.


Sign in / Sign up

Export Citation Format

Share Document