Multimodal Communication, Natural Language and Direct Manipulation (Gestures) in Human-Computer Interaction

Author(s):  
Karl-Heinz Hanne
2021 ◽  
Vol 11 (13) ◽  
pp. 6057
Author(s):  
Ching-Han Chen ◽  
Ming-Fang Shiu ◽  
Shu-Hui Chen

Dialogue in natural language is the most important communication method for the visually impaired. Therefore, the dialogue system is the main subsystem in the visually impaired navigation system. The purpose of the dialogue system is to understand the user’s intention, gradually establish context through multiple conversations, and finally provide an accurate destination for the navigation system. We use the knowledge graph as the basis of reasoning in the dialogue system, and then update the knowledge graph so that the system gradually conforms to the user’s background. Based on the experience of using the knowledge graph in the navigation system of the visually impaired, we expect that the same framework can be applied to more fields in order to improve the practicality of natural language dialogue in human–computer interaction.


1996 ◽  
Vol 28 (3) ◽  
pp. 102-107 ◽  
Author(s):  
Oliviero Stock ◽  
Carlo Strapparava ◽  
Massimo Zancanaro

2020 ◽  
Vol 7 (1) ◽  
pp. 95
Author(s):  
Endang Retnoningsih ◽  
Ari Nurul Alfian

Abstrak: Open Journal Systems (OJS) adalah aplikasi perangkat lunak open source untuk mengelola dan menerbitkan jurnal ilmiah, untuk mendukung fungsinya tersebut Open Journal Systems (OJS) secara umum memiliki fitur yang dalam perkembangan setiap versinya mengalami perbaikan dan penyesuaian dengan kebutuhan. Proses penerbitan jurnal sangat berdampak pada proses akreditasi jurnal, oleh karena itu perlu dipahami proses bisnis alur pengiriman artikel dari author menggunakan Open Journal Systems (OJS) hingga artikel di publish. Dalam sistem diperlukan pemodelan perencanaan, desain dan penggunaan interface antara pengguna dan komputer, interaksi ini dikenal sebagai interaksi antara manusia dengan komputer (Human Computer Interaction). Framework digunakan untuk memahami interaksi sistem komputer memberikan fasilitas bahasa antara bahasa user  dan bahasa sistem. Pengguna (user) dan sistem komputer (system) dapat saling berinteraksi menggunakan beberapa cara interaksi yaitu style kombinasi form fill-in dan direct manipulation. Open Journal Systems (OJS) 3.x. memiliki tampilan yang lebih ringkas, mudah dan flexible karena dibangun dengan prinsip Interaction Framework melibatkan user, input, system, output.  Kata kunci: framework, HCI, jurnal, OJS, PKP  Abstract: Open Journal Systems (OJS) is an open source software application to manage and publish scientific journals, to support this function Open Journal Systems (OJS) generally has features that in each version's development experience improvements and adjustments to the needs. The process of publishing a journal greatly affects the accreditation process of the journal, therefore it is necessary to understand the business process of sending articles from the author using Open Journal Systems (OJS) until the article is published. In the system required modeling planning, design and use of interfaces between users and computers, this interaction is known as the interaction between humans and computers (Human Computer Interaction). Framework is used to understand the interaction of computer systems to provide language facilities between the user's language and system language. Users (users) and computer systems (systems) can interact with each other using several modes of interaction, namely the combination style form fill-in and direct manipulation. Open Journal Systems (OJS) 3.x. has a more concise, easy and flexible appearance because it is built on the principle of Interaction Framework involving users, input, system, output.  Keywords: framework, HCI, journals, OJS, PKP


2020 ◽  
Vol 48 (1) ◽  
pp. 79-100
Author(s):  
Dorthe Duncker

This paper investigates the kind of sign making that goes on in text-based human–computer interaction, between human users and chatbots, from the point of view of integrational linguistics. A chatbot serves as a “conversational” user interface, allowing users to control computer programs in “natural language”. From the user’s perspective, the interaction is a case of semiologically integrated activity, but even if the textual traces of a chat may look like a written conversation between two humans the correspondence is not one-to-one. It is argued that chatbots cannot engage in communication processes, although they may display communicative behaviour. They presuppose a (second-order) language model, they can only communicate at the level of sentences, not utterances, and they implement communicational sequels by selecting from an inventory of executable skills. Instead of seeing them as interlocutors in silico, chatbots should be seen as powerful devices for humans to make signs with.


Sign in / Sign up

Export Citation Format

Share Document