Emerging affordances in telecollaborative multimodal interactions

Author(s):  
Aparajita Dey-Plissonneau ◽  
Françoise Blin
Electronics ◽  
2021 ◽  
Vol 10 (6) ◽  
pp. 666
Author(s):  
Davide Calvaresi ◽  
Jean-Paul Calbimonte ◽  
Enrico Siboni ◽  
Stefan Eggenschwiler ◽  
Gaetano Manzo ◽  
...  

Context. Asynchronous messaging is increasingly used to support human–machine interactions, generally implemented through chatbots. Such virtual entities assist the users in activities of different kinds (e.g., work, leisure, and health-related) and are becoming ingrained into humans’ habits due to factors including (i) the availability of mobile devices such as smartphones and tablets, (ii) the increasingly engaging nature of chatbot interactions, (iii) the release of dedicated APIs from messaging platforms, and (iv) increasingly complex AI-based mechanisms to power the bots’ behaviors. Nevertheless, most of the modern chatbots rely on state machines (implementing conversational rules) and one-fits-all approaches, neglecting personalization, data-stream privacy management, multi-topic management/interconnection, and multimodal interactions. Objective. This work addresses the challenges above through an agent-based framework for chatbot development named EREBOTS. Methods. The foundations of the framework are based on the implementation of (i) multi-front-end connectors and interfaces (i.e., Telegram, dedicated App, and web interface), (ii) enabling the configuration of multi-scenario behaviors (i.e., preventive physical conditioning, smoking cessation, and support for breast-cancer survivors), (iii) online learning, (iv) personalized conversations and recommendations (i.e., mood boost, anti-craving persuasion, and balance-preserving physical exercises), and (v) responsive multi-device monitoring interface (i.e., doctor and admin). Results. EREBOTS has been tested in the context of physical balance preservation in social confinement times (due to the ongoing pandemic). Thirteen individuals characterized by diverse age, gender, and country distribution have actively participated in the experimentation, reporting advancements in the physical balance and overall satisfaction of the interaction and exercises’ variety they have been proposed.


2018 ◽  
Vol 4 (11) ◽  
pp. 1578-1586 ◽  
Author(s):  
Rohit H. Subramanian ◽  
Sarah J. Smith ◽  
Robert G. Alberstein ◽  
Jake B. Bailey ◽  
Ling Zhang ◽  
...  

2021 ◽  
Vol 9 (1) ◽  
pp. 493-497
Author(s):  
Branko Medic

During the coronavirus pandemic research on video conferencing effects on young language learners is more than ever relevant. During the sharp transition, educators need to fully understand the benefits and possible pitfalls of video conferencing, but also overcome resistance to change through knowledge. As author Philip Pullman rightly points out, “You cannot change what you are, only what you do.” This article summarised key research and provided evidence for and against the use of video conferencing in foreign language education. Thus, it gives food for thought and reflection, as well as directions for possible interventions.  However, the research was limited in terms of time and available literature, and the topic certainly requires more attention. In future, it is recommended to further research the use of multimodal interactions (sound, audio, text) in video conferencing, as well as coping strategies for dealing with the lack of interaction in the video conferencing-enabled classroom.


Author(s):  
Christopher Simons ◽  
Jay Slack

2009 ◽  
pp. 3494-3510
Author(s):  
Louise E. Moser ◽  
P. M. Melliar-Smith

The use of a voice interface; along with textual; graphical; video; tactile; and audio interfaces; can improve the experience of the user of a mobile device. Many applications can benefit from voice input and output on a mobile device; including applications that provide travel directions; weather information; restaurant and hotel reservations; appointments and reminders; voice mail; and e-mail. We have developed a prototype system for a mobile device that supports client-side; voice-enabled applications. In fact; the prototype supports multimodal interactions but; here; we focus on voice interaction. The prototype includes six voice-enabled applications and a program manager that manages the applications. In this chapter we describe the prototype; including design issues that we faced; and evaluation methods that we employed in developing a voice-enabled user interface for a mobile device.


Sign in / Sign up

Export Citation Format

Share Document