scholarly journals Modelling Multimodal Dialogues for Social Robots Using Communicative Acts

Sensors ◽  
2020 ◽  
Vol 20 (12) ◽  
pp. 3440 ◽  
Author(s):  
Enrique Fernández-Rodicio ◽  
Álvaro Castro-González ◽  
Fernando Alonso-Martín ◽  
Marcos Maroto-Gómez ◽  
Miguel Á. Salichs
Keyword(s):  
Multimodal Interaction ◽  
Social Robots ◽  
Atomic Interaction ◽  
Communicative Acts ◽  
Input And Output ◽  
Multimodal Information ◽  
Key Factor ◽  
Dialogue Modelling ◽  
Dialogue Design ◽  
New Applications

Social Robots need to communicate in a way that feels natural to humans if they are to effectively bond with the users and provide an engaging interaction. Inline with this natural, effective communication, robots need to perceive and manage multimodal information, both as input and output, and respond accordingly. Consequently, dialogue design is a key factor in creating an engaging multimodal interaction. These dialogues need to be flexible enough to adapt to unforeseen circumstances that arise during the conversation but should also be easy to create, so the development of new applications gets simpler. In this work, we present our approach to dialogue modelling based on basic atomic interaction units called Communicative Acts. They manage basic interactions considering who has the initiative (the robot or the user), and what is his/her intention. The two possible intentions are either ask for information or give information. In addition, because we focus on one-to-one interactions, the initiative can only be taken by the robot or the user. Communicative Acts can be parametrised and combined in a hierarchical manner to fulfil the needs of the robot’s applications, and they have been equipped with built-in functionalities that are in charge of low-level communication tasks. These tasks include communication error handling, turn-taking or user disengagement. This system has been integrated in Mini, a social robot that has been created to assist older adults with cognitive impairment. In a case of use, we demonstrate the operation of our system as well as its performance in real human–robot interactions.

scholarly journals Human-Robot Handshaking: A Review

2021 ◽  
Author(s):  
Vignesh Prasad ◽  
Ruth Stock-Homburg ◽  
Jan Peters
Keyword(s):  
Facial Expressions ◽  
Social Contexts ◽  
Social Robots ◽  
Human Robot Interaction ◽  
Robot Interaction ◽  
Natural Interaction ◽  
Internal Factors ◽  
Verbal Behaviour ◽  
Key Factor ◽  
Physical Touch

AbstractFor some years now, the use of social, anthropomorphic robots in various situations has been on the rise. These are robots developed to interact with humans and are equipped with corresponding extremities. They already support human users in various industries, such as retail, gastronomy, hotels, education and healthcare. During such Human-Robot Interaction (HRI) scenarios, physical touch plays a central role in the various applications of social robots as interactive non-verbal behaviour is a key factor in making the interaction more natural. Shaking hands is a simple, natural interaction used commonly in many social contexts and is seen as a symbol of greeting, farewell and congratulations. In this paper, we take a look at the existing state of Human-Robot Handshaking research, categorise the works based on their focus areas, draw out the major findings of these areas while analysing their pitfalls. We mainly see that some form of synchronisation exists during the different phases of the interaction. In addition to this, we also find that additional factors like gaze, voice facial expressions etc. can affect the perception of a robotic handshake and that internal factors like personality and mood can affect the way in which handshaking behaviours are executed by humans. Based on the findings and insights, we finally discuss possible ways forward for research on such physically interactive behaviours.

Application of Improved BP Neural Networks Based on LM Algorithm in Characteristic Curve Fitting of Fiber-Optic Micro-Bend Sensor

2014 ◽  
Vol 889-890 ◽  
pp. 825-828 ◽  
Author(s):  
Shuo Ding ◽  
Xiao Heng Chang
Keyword(s):  
Fiber Optic ◽  
Characteristic Curve ◽  
Back Propagation ◽  
Back Propagation Neural Network ◽  
Testing System ◽  
Input And Output ◽  
Key Factor ◽  
Simulation Results ◽  
Lm Algorithm ◽  
Bend Sensor

As a key factor in a testing system, sensor nonlinearity has always been the study focus in the field of engineering and techniques. In order to accurately reflect the practical characteristics of a fiber-optic micro-bend sensor, Levenberg-Marguardt (LM) algorithm is used to optimize the correction of the weight values of standard back propagation neural network (BPNN). The learning process of improved BPNN based on LM algorithm (LM-BPNN) is also illustrated mathematically, and LM-BPNN is applied in fitting the input and output characteristic curve of a fiber-optic micro-bend sensor. The simulation results show that LM-BPNN is superior both in its convergence rate and fitting precision over standard BPNN.

Enhancement of Conversational Agents By Means of Multimodal Interaction

2011 ◽  
pp. 223-252 ◽  
Author(s):  
Ramón López-Cózar ◽  
Zoraida Callejas ◽  
Gonzalo Espejo ◽  
David Griol
Keyword(s):  
Multimodal Interaction ◽  
Daily Activities ◽  
Conversational Agent ◽  
Conversational Agents ◽  
Evaluation Methodologies ◽  
The Core ◽  
Implementation Techniques ◽  
Multimodal Information ◽  
The Moment ◽  
Dialogue Manager

The main objective of multimodal conversational agents is to provide a more engaged and participative communication by allowing users to employ more than one input methodologies and providing output channels that are different to exclusively using voice. This chapter presents a detailed study on the benefits, disadvantages, and implications of incorporating multimodal interaction in conversational agents. Initially, it focuses on implementation techniques. Next, it explains the fusion and fission of multimodal information and focuses on the core module of these agents: the dialogue manager. Later on, the chapter addresses architectures, tools to develop some typical components of the agents, and evaluation methodologies. As a case of study, it describes the multimodal conversational agent in which we are working at the moment to provide assistance to professors and students in some of their daily activities in an academic centre, for example, a University’s Faculty.

On Device Driver Architectures for Virtual Reality Toolkits

2010 ◽  
Vol 19 (2) ◽  
pp. 83-94
Author(s):  
Ingo Assenmacher ◽  
Dominik Rausch ◽  
Torsten Kuhlen
Keyword(s):  
Virtual Reality ◽  
Data Processing ◽  
General Model ◽  
Multimodal Interaction ◽  
Device Driver ◽  
Research Community ◽  
Major Goal ◽  
Input And Output ◽  
Output System

One major goal for the development of virtual reality (VR) toolkits is to provide interfaces for novel input or output hardware to support multimodal interaction. The research community has produced several implementations that feature a large variety of device interfaces and abstractions. As a lesson learned from existing approaches, we sum up the requirements for the design of a driver layer that is the basis for a multimodal input and output system in this paper. We derive a general model for driver architectures based on these requirements. This model can be used for reasoning about different implementations of available architectures. As the flow of data through the system is of interest, we take a closer look at common patterns of data processing. Finally, we discuss a number of openly accessible driver architectures currently used for VR development.

Special Issue on Haptics: Interfaces, Applications, and Perception

2006 ◽  
Vol 18 (4) ◽  
pp. 367-367
Author(s):  
Haruhisa Kawasaki ◽  
◽  
Osama Halabi ◽  
Keyword(s):  
Multimodal Interaction ◽  
Haptic Rendering ◽  
Tactile Display ◽  
Design And Technology ◽  
Haptic Interfaces ◽  
Special Issue ◽  
Potential Applications ◽  
The Many ◽  
New Applications

The last decade has seen significant advances in research on haptics and haptic interfaces. Device performance has improved, and the many commercial devices now available at reasonable prices indicate how haptic research will grow and new applications involving haptics will touch all aspects of daily life. Sophisticated systems require research beyond physical devices, such as modeling the physical properties of virtual objects, human physiology, and haptic evaluation. This special issue focuses on state-of-the-art design and development of haptic interfaces and explores potential applications of this technology and related issues such as tactile display, haptic rendering, physiology, and evaluation methodologies. The 15 papers were selected after a rigorous peer review from around the world and include diverse topics such as haptic device design and technology, tactile display and tactile sensing, collaborative multiuser haptic environments, haptic cognition, haptic rendering, tele-existence and multimodal interaction, and medical and rehabilitation applications. We thank the Editorial Board of JRM Journal for making this special issue possible. We also thank the authors for contributing their fine work and revising their papers for this issue, and extend our thanks and appreciation to the reviewers for their constructive comments and suggestions.

Stakeholder Identification and Analysis for Service Lifecycle Management

2014 ◽  
Vol 11 (1) ◽  
pp. 30-56
Author(s):  
Wenge Rong ◽  
Qinfen Wu ◽  
Yuanxin Ouyang ◽  
Kecheng Liu ◽  
Zhang Xiong
Keyword(s):  
Service Oriented Architecture ◽  
Competitive Edge ◽  
Business Environments ◽  
Stakeholder Identification ◽  
Key Factor ◽  
Research Problems ◽  
Service Oriented ◽  
New Applications ◽  
Business Requirements ◽  
Lifecycle Management

The convergence of information technology and diverse business requirements is making the organization information systems more complex. Quickly integrating existing systems and developing new applications to serve the requirement of flexible business environments have become a key factor for organizations to gain a competitive edge. To meet this challenge, the concept of Service Oriented Architecture (SOA) has been proposed and widely lauded as an innovative business oriented solution. To better utilize SOA's advantages, several research problems should be attached much importance among which service lifecycle management is a notable one, which is one of the critical mechanisms leading to higher service quality. A large number of service lifecycle models have been proposed in the literature while few of them clearly indicate the integration of the lifecycle processes with stakeholders. In this research, a conceptual stakeholder identification and analysis framework is proposed by which stakeholders are analyzed within different service lifecycle stages. It is believed that this method can offer the researchers in the community further insight into service lifecycle management from the stakeholder's perspective.

scholarly journals Facilitating Innovation in the Economy of Choice: A Case Study of Research on Museum

2019 ◽  
Vol 5 (2) ◽  
pp. 7-22
Author(s):  
Duan Wu ◽  
Chenxi Yao ◽  
Jiping Wang
Keyword(s):  
Open Innovation ◽  
Social Inclusion ◽  
Design Thinking ◽  
Social Innovation ◽  
Technological Advancement ◽  
Strategic Design ◽  
Practical Strategy ◽  
Key Factor ◽  
New Applications

Over the past decade, museums all over the world have faced increasing pressures to transform as a result of visitor changes and technological advancement. “Excellence and Equity: Education and Public Dimension of Museums” published by the American Association of Museums (AAM) describe that the museum has become an intermediary and public education centers for social inclusion. (Yuha Jung, 2011) In the economy of choice, it is no longer collections that drive the priorities of museums but rather the needs of communities. At the same time, museums increasingly rely on the interpretation of their resources to provide distinctive experiences that attract and engage visitors. New challenges lead to new applications. With this background, Innovation, which in essence can be defined as “the development of new customer’s value through solutions that meet new needs, inarticulate needs, or old customer and market” (Alshammari, A. A., Rasli, A., Alnajem, M., & Arshad, A. S, 2014) has become a key factor for the success of museum. Through case studies and analysis with multiple design methods in open innovation and social innovation, the research seeks to better understand the role of “innovation” in the interpretation projects in a modern museum perspective, and the role of strategic design in the transforming complicated context of modern museum to help reach out the most practical strategy. Moreover, the paper presents a new framework for innovation methods to be used in the modern museum context. The theoretical framework of the framework is based on three concepts: open innovation, social innovation, and innovative design thinking toolkit. The framework is structured to make innovation in the museum more replicable, scalable and operable, and it could be used as a planning tool to carry out innovation or evaluate innovation. This paper argues that museum innovation is a field of specialized interdisciplinary practice that exemplifies the highly collaborative and strategic nature of contemporary design practice. Designer’s role in this transforming context should be the leader, the facilitator, the generalist, the user advocate, and the analyst. This article is still at an early step in the challenges of museum innovation and the research will continue.

1250-kilovolt scanning transmission electron microscope

1984 ◽  
Vol 42 ◽  
pp. 624-625
Author(s):  
T. Imura ◽  
S. Maruse ◽  
K. Mihama ◽  
M. Iseki ◽  
M. Hibino ◽  
...  
Keyword(s):  
High Voltage ◽  
Electron Probe ◽  
Scanning Transmission Electron Microscope ◽  
Pressure Vessels ◽  
Practical Applications ◽  
Voltage Generator ◽  
Transmission Electron ◽  
Scanning Transmission ◽  
New Applications ◽  
High Voltage Generator

Ultra high voltage STEM has many inherent technical advantages over CTEM. These advantages include better signal detectability and signal processing capability. It is hoped that it will explore some new applications which were previously not possible. Conventional STEM (including CTEM with STEM attachment), however, has been unable to provide these inherent advantages due to insufficient performance and engineering problems. Recently we have developed a new 1250 kV STEM and completed installation at Nagoya University in Japan. It has been designed to break through conventional engineering limitations and bring about theoretical advantage in practical applications.In the design of this instrument, we exercised maximum care in providing a stable electron probe. A high voltage generator and an accelerator are housed in two separate pressure vessels and they are connected with a high voltage resistor cable.(Fig. 1) This design minimized induction generated from the high voltage generator, which is a high frequency Cockcroft-Walton type, being transmitted to the electron probe.

Attachment of oral bacteria to titanium surfaces: An SEM study

1994 ◽  
Vol 52 ◽  
pp. 468-469
Author(s):  
J. E. Laffoon ◽  
R. L. Anderson ◽  
J. C. Keller ◽  
C. D. Wu-Yuan
Keyword(s):  
Technical Problem ◽  
Titanium Implant ◽  
Oral Bacteria ◽  
Bacterial Cells ◽  
Thin Sections ◽  
Surface Ultrastructure ◽  
Sem Study ◽  
Key Factor ◽  
Titanium Surfaces

Titanium (Ti) dental implants have been used widely for many years. Long term implant failures are related, in part, to the development of peri-implantitis frequently associated with bacteria. Bacterial adherence and colonization have been considered a key factor in the pathogenesis of many biomaterial based infections. Without the initial attachment of oral bacteria to Ti-implant surfaces, subsequent polymicrobial accumulation and colonization leading to peri-implant disease cannot occur. The overall goal of this study is to examine the implant-oral bacterial interfaces and gain a greater understanding of their attachment characteristics and mechanisms. Since the detailed cell surface ultrastructure involved in attachment is only discernible at the electron microscopy level, the study is complicated by the technical problem of obtaining titanium implant and attached bacterial cells in the same ultra-thin sections. In this study, a technique was developed to facilitate the study of Ti implant-bacteria interface.Discs of polymerized Spurr’s resin (12 mm x 5 mm) were formed to a thickness of approximately 3 mm using an EM block holder (Fig. 1). Titanium was then deposited by vacuum deposition to a film thickness of 300Å (Fig. 2).

Sign in / Sign up

Export Citation Format

Share Document