Towards a Universal Human-Computer Interaction Model for Multimodal Interactions

AbstractThis study presents the issues why gamers prefer mobility-augmented reality games to other types of game and what specific characteristics cause them to invest a large amount of their time on tireless game-play. Furthermore, the appeal of mobility-augmented reality games was studied to solve the above mentioned issues. Then, how human–computer interaction based on mobility-augmented reality games was promoted to create a new marketing mode was explored. Then, Pokémon GO, as the worldwide major mobility-augmented reality game, was selected as the research target in this study. The researcher interviewed 9 experts, collected 235 Knasei words from 33 articles, and surveyed 335 gamers through a questionnaire to collect the data about users’ preferences. A preference-based study was believed to disclose the motivated reasons for the appeal of mobility-augmented reality games. The researcher analyzed the gathered Kansei concepts and questionnaires using the two-stage procedures, including evaluation grid method (EGM) and Quantification Theory Type I. During the first stage the hierarchy of the relationship among the types of appeal factors, the reasons for users’ preferences, and the explicit design characteristics of Pokémon GO present the semantic structure of appeal and were determined using EGM through the accumulation of the review of articles and the interviews of experts. During the second stage the strongest two original evaluation items of Pokémon GO are determined as “social interaction” and “scenario interaction” based on the statistical analysis of Quantification Theory Type I, and their corresponding “upper-level” and “lower-level” considerations are proved to have influence on them. Finally, the paper found that the popularity of Pokémon GO can be ascribed to the design of the innovative models of game interaction, which targets the psychological preferences of gamers. This means that the interaction model between a customer and an enterprise can be developed outside the box and a new type of marketing can be formed. The study proved that the innovative models of interaction successfully drove gamers’ motivations to play Pokémon GO. Designers and researchers of mobility-augmented reality games can absorb important information through this study. This study enriches the field of mobile communication, online marketing, and human–computer interaction in cyberspace.

Download Full-text

Interacting with personal fabrication devices

it - Information Technology ◽

10.1515/itit-2017-0041 ◽

2018 ◽

Vol 60 (2) ◽

pp. 113-117

Author(s):

Stefanie Mueller

Keyword(s):

Human Computer Interaction ◽

3D Model ◽

Interaction Model ◽

3D Models ◽

Interactive Systems ◽

3D Printer ◽

3D Printers ◽

Model Database ◽

Domain I ◽

Computer Interaction

AbstractPersonal fabrication tools, such as 3D printers, are on the way of enabling a future in which non-technical users will be able to create custom objects. While the hardware is now affordable and the number of people who own a 3D printer is increasing, only few create new 3D models. Most users download models from a 3D model database and after downloading fabricate them on their 3D printers. At most, users adjust a few parameters of the model, such as changing its color or browsing between predetermined shape options.I argue that personal fabrication has the potential for more: Instead of only consuming existing content, I envision a future in which non-technical users will create objects only trained experts can create today. While there are many open challenges for human-computer interaction, such as abstracting away the necessarydomainandmachineknowledge, I focus on improving theinteraction modelunderlying current personal fabrication devices.In this article, I illustrate why today’s interaction model for personal fabrication tools is not suitable for non-technical users. For this, I draw an analogy to the development of the user interface in personal computing and show how solutions developed by human-computer interaction researchers over the last decades can be applied to this new domain. I analyze the challenges when creating interactive systems for personal fabrication and describe six research prototypes I built to overcome these challenges. I discuss the limitations of these systems and conclude with an overview of recent advancements in personal fabrication that will allow us to go beyond what is possible today.

Download Full-text

MuMIA: Multimodal Interactions to Better Understand Art Contexts

Applied Sciences ◽

10.3390/app11062695 ◽

2021 ◽

Vol 11 (6) ◽

pp. 2695

Author(s):

George E. Raptis ◽

Giannis Kavvetsos ◽

Christina Katsini

Keyword(s):

Human Computer Interaction ◽

Cultural Heritage ◽

Evaluation Study ◽

Multimodal Interfaces ◽

Interactive System ◽

Visitor Experience ◽

Multimodal Interactions ◽

Key Factor ◽

Natural Interactions ◽

Computer Interaction

Cultural heritage is a challenging domain of application for novel interactive technologies, where varying aspects in the way that cultural assets are delivered play a major role in enhancing the visitor experience, either onsite or online. Technology-supported natural human–computer interaction that is based on multimodalities is a key factor in enabling wider and enriched access to cultural heritage assets. In this paper, we present the design and evaluation of an interactive system that aims to support visitors towards a better understanding of art contexts through the use of a multimodal interface, based on visual and audio interactions. The results of the evaluation study shed light on the dimensions of evoking natural interactions within cultural heritage environments, using micro-narratives for self-exploration and understanding of cultural content, and the intersection between human–computer interaction and artificial intelligence within cultural heritage. We expect our findings to provide useful insights for practitioners and researchers of the broad human–computer interaction and cultural heritage communities on designing and evaluating multimodal interfaces to better support visitor experiences.

Download Full-text

DETEKSI GERAKAN KEPALA DAN KEDIPAN MATA DENGAN HAAR CASCADE CLASSIFIER CONTOUR DAN MORFOLOGI DALAM PENGOPERASIAN KOMPUTER UNTUK KAUM DIFABLE

JURTEKSI ◽

10.33330/jurteksi.v5i1.273 ◽

2019 ◽

Vol 5 (1) ◽

pp. 29-36

Author(s):

I Komang Setia Buana

Keyword(s):

Human Computer Interaction ◽

Computer Technology ◽

Interaction Model ◽

Human Head ◽

Head Movements ◽

Interaction Techniques ◽

Entertainment Education ◽

Natural Interaction ◽

Haar Cascade ◽

Computer Interaction

Abstrack: Diffable or the word that has defenition is “ Different Abled People” the term for disabled people. One example of disabled is people who do not have hands, so to write even have to use their feet. Along with the increasingprogress of computer technology, the role of computer technology has also increased for the benefit of humans. One of them is the field of human and computer interaction ( IMK) or also called Human Computer Interaction ( HCI) . Although computer technology equipment is accurate and reliable, but the interaction model that is carried out is not natural as humans interact with each other, the use of such equipment to operate it requires direct contact between user and the computer. For people who dissabilities who do not have hands, it will be difficult to do so. Computer vision based interaction techniques are candidates for natural interaction techniques. The human head can also be used to replace the function of a mouse that can be used to move the cursor up and down left or right for and to click on the mouse using the blik an eye. Detection using head movements has been widely applied including in the fields of entertainment, education, and security. The camera is a tool used to make head recognition. The camera is used as a sensor to detect head movements. Head motion detection is implemented by using opency phython. Keyword: difabel, head, webcame, opencv pythonAbstrak: Difabel atau kata yang memiliki definisi “Different Abled People” ini adalah sebutan bagi orang cacat. Salah satu contoh kaum difabel adalah orang yang tidak mempunyai tangan, sehingga untuk menulispun harus menggunakan kaki. Seiring meningkatnya kemajuan teknologi komputer, peranan teknologi komputer juga semakin meningkat yang digunakan untuk kepentingan manusia. salah satunya adalah bidang interaksi manusia dan komputer (IMK), atau sering disebut Human Computer Interaction (HCI). Keyboard, mouse, dan joystick merupakan salah satu perangkat keras yang sering digunakan untuk interaksi antara manusia dan komputer yang bersifat mekanis. Meskipun peralatan-peralatan tersebut akurat dan handal (reliable), tetapi model interaksi yang dilakukan tidak bersifat alami sebagaimana manusia berinteraksi dengan sesamanya, penggunaan peralatan-peralatan tersebut untuk mengoperasikannya membutuhkan adanya kontak langsung antara user dengan komputer. Untuk kaum difabel yang tidak mempunyai tangan, akan susah melakukan hal tersebut. Teknik interaksi berbasis visi komputer menjadi kandidat teknik interaksi yang bersifat alami. kepala manusia bisa juga digunakan untuk menggantikan fungsi mouse yang bisa digunakan untuk menggerakan cursor keatas kebawah kekiri maupun kekanan dan untuk melakukan klik pada mouse menggunakan kedipan mata. Pendeteksian menggunakan gerakan kepala telah diaplikasikan secara luas diantaranya pada bidang hiburan, pendidikan serta keamanan. Kamera (webcam) merupakan alat yang digunakan untuk melakukan pengenalan kepala. Kamera ini digunakan sebagai sensor untuk mendeteksi pergerakan kepala. Pendeteksian gerakan kepala diimplementasikan dengan menggunakan opencv python.

Download Full-text