A Survey on Haptic Technologies for Mobile Augmented Reality

Augmented reality (AR) applications have gained much research and industry attention. Moreover, the mobile counterpart—mobile augmented reality (MAR) is one of the most explosive growth areas for AR applications in the mobile environment (e.g., smartphones). The technical improvements in the hardware of smartphones, tablets, and smart-glasses provide an advantage for the wide use of mobile AR in the real world and experience these AR applications anywhere. However, the mobile nature of MAR applications can limit users’ interaction capabilities, such as input and haptic feedback. In this survey, we analyze current research issues in the area of human-computer interaction for haptic technologies in MAR scenarios. The survey first presents human sensing capabilities and their applicability in AR applications. We classify haptic devices into two groups according to the triggered sense: cutaneous/tactile : touch, active surfaces, and mid-air; kinesthetic : manipulandum, grasp, and exoskeleton. Due to MAR applications’ mobile capabilities, we mainly focus our study on wearable haptic devices for each category and their AR possibilities. To conclude, we discuss the future paths that haptic feedback should follow for MAR applications and their challenges.

Edge-assisted Collaborative Image Recognition for Mobile Augmented Reality

Mobile Augmented Reality (AR), which overlays digital content on the real-world scenes surrounding a user, is bringing immersive interactive experiences where the real and virtual worlds are tightly coupled. To enable seamless and precise AR experiences, an image recognition system that can accurately recognize the object in the camera view with low system latency is required. However, due to the pervasiveness and severity of image distortions, an effective and robust image recognition solution for “in the wild” mobile AR is still elusive. In this article, we present CollabAR, an edge-assisted system that provides distortion-tolerant image recognition for mobile AR with imperceptible system latency . CollabAR incorporates both distortion-tolerant and collaborative image recognition modules in its design. The former enables distortion-adaptive image recognition to improve the robustness against image distortions, while the latter exploits the spatial-temporal correlation among mobile AR users to improve recognition accuracy. Moreover, as it is difficult to collect a large-scale image distortion dataset, we propose a Cycle-Consistent Generative Adversarial Network-based data augmentation method to synthesize realistic image distortion. Our evaluation demonstrates that CollabAR achieves over 85% recognition accuracy for “in the wild” images with severe distortions, while reducing the end-to-end system latency to as low as 18.2 ms.

Evaluating system usability of mobile augmented reality application for teaching Karnaugh-Maps

The education system evolves and transforms towards interactive and immersive learning tools in this digital age. Augmented reality has also evolved as a ubiquitous, robust, and effective technology for providing innovative educational tools. In engineering education, many abstract concepts require technological intervention for conceptual understanding and better instructional content. While learning through the immersive tools, system usability has great importance in terms of effectiveness, efficiency, and satisfaction. Effectiveness refers to users' accuracy and completeness in achieving defined goals; efficiency relates to expended resources about the precision and completeness with which users achieve their objectives; satisfaction deals with a positive attitude towards using the product. If the system fails to provide good usability, it may cause adverse effects such as increasing stress, lacking necessary features, increasing the users' cognitive load, and negatively impacting the student's motivation. In this study, two mobile augmented reality (MAR) applications were developed as an instructional tool to teach the students about Karnaugh maps in the digital electronics course. The first application is a Keypad-based MAR application that uses a keypad matrix for user interaction and the second application is a Marker-based MAR application that uses multiple markers to solve K-Map for producing an optimum solution of the given problem. An experimental study was conducted to determine the student's opinion of the developed MAR applications. The study was designed to determine the system usability of the two MAR applications using the System Usability Score (SUS) and Handheld Augmented Reality Usability Score (HARUS) models. 90 engineering students participated in the study, and they were randomly divided into two different groups: keypad-based group and Marker-based group. The keypad-based group included 47 students who had hands-on experience with a keypad-based MAR application, whereas the marker-based group included 43 students who had hands-on experience with multiple marker-based MAR applications. The experimental outcomes indicated that the keypad-based MAR application has better SUS and HARUS scores than the marker-based MAR application which suggests that the keypad-based MAR application has provided better user interaction.

The Urban CoCreation Lab—An Integrated Platform for Remote and Simultaneous Collaborative Urban Planning and Design through Web-Based Desktop 3D Modeling, Head-Mounted Virtual Reality and Mobile Augmented Reality: Prototyping a Minimum Viable Product and Developing Specifications for a Minimum Marketable Product

Both policy and research highlight the importance of diverse stakeholder input in urban development processes but visualizing future built environments and creating two-way design communication for non-expert stakeholders are challenging. The present study develops an intuitive and simplified 3D modeling platform that integrates web-based desktop, virtual reality and mobile augmented reality technologies for remote simultaneous urban design collaboration. Through iterative prototyping, based on two series of workshops with stakeholders, the study resulted in such an integrated platform as a minimum viable product as well as specifications for a minimum marketable product to be used in real projects. Further study is required to evaluate the minimum level of detail in the 3D modeling necessary for good perception of scale and environmental impact simulation.

Utilizing Animal Characters of a Mobile Augmented Reality (AR) Reading Kit to Improve Preschoolers’ Reading Skills, Motivation, and Self-Learning: An Initial Study

This study developed and used a mobile Augmented Reality (AR) reading kit to help preschool students recognize alphabets and read simple words more effectively. This study was based on the quantitative approach involving an experimental methodology that used a one-group pretest-posttest design. In this study, the variables of interest to be measured were students’ reading skills, motivation, and self-learning. The learning treatment involved a series of reading sessions using the novel learning application that spanned three weeks, with each session lasting for two hours. The sample of this study comprised 60 preschool students, whose ages ranged from four to six, who were selected from three different preschools. The effectiveness of the novel-reading kit was evaluated in terms of students’ learning performance, learning motivation in reading, and self-learning. The data for the former were gathered from pre-testing and post-testing. At the same time, a survey was administered to the students to elicit their opinions and feedback on the last two factors. Furthermore, all descriptive and inferential statistical procedures have been selected to analyze the data. Specifically, a one-way analysis of variance (ANOVA) was applied to analyze the data, which demonstrated significant differences in the students’ reading skills, motivation, and self-learning before and after the learning interventions. These findings showed the students could recognize alphabets more accurately, read simple words more intelligently, become more motivated to read and be highly engaged in self-learning using the mobile AR reading kit.

Implementation and Evaluation of User Experience on Mobile Augmented Reality Technology-Based Brochure Applications

Along with the spread of the COVID-19 virus which has an impact on new student admissions at various universities in Indonesia. This impact was also felt at the Politeknik Negeri Banjarmasin (POLIBAN) with the decline in the number of registrants and the public's interest in continuing higher education. So, we need a promotion that is not monotonous and must be innovative. Various kinds of technology have been created to support and facilitate all activities in various fields, one of which is in the field of promotional media. Promotion is very important for a university to offer or show the facilities and infrastructure contained in the university and show its quality. The purpose of this study is to implement mobile augmented reality technology as a POLIBAN promotional media solution and evaluate the user experience of the application. The research method used is the Extreme Programming (XP) development method and a technique for evaluating user experience using the User Experience Questionnaire (UEQ). The results of the research conducted based on the results of the implementation stated that functionally all the features offered by the application can function properly and the results of the evaluation of user experience as a non-functional assessment of 50 respondents with an average value of 2.87 with an excellent predicate.

An Interactive Information System That Supports an Augmented Reality Game in the Context of Game-Based Learning

Mobile augmented reality applications are gaining prominence in education, but there is a need to design appropriate and enjoyable games to be used in educational contexts such as classrooms. This paper presents an interactive information system designed to support the implementation of an augmented reality application in the context of game-based learning. PlanetarySystemGO includes a location-based mobile augmented reality game designed to promote learning about the celestial bodies and planetary systems of the Universe, and a web application that interacts with the mobile device application. Besides face-to-face classes, this resource can also be used in online classes, which is very useful in social isolation situations as the ones caused by the COVID-19 pandemic. Furthermore, it is the inclusion of the web application, with a back-office, in the information system that makes it possible to include curricula contents according to the grade level of students. Moreover, it is intended that teachers use the information system to include the contents they find appropriate to the grade level they teach. Therefore, it is crucial to provide their professional development to be able to use this resource. In this regard, a pilot study was conducted with teachers who participated in a STEM professional development programme in order to assess if the system is appropriate to be used by them. It is concluded that teachers found this resource relevant to motivate students to learn, and also acknowledged that the web application facilitated the introduction of appropriate curricula contents and also was useful to assess student performance during the game. Teachers need support, however, to implement these types of technologies which are not familiar to them. The necessary support can be provided through collaboration among the researchers and teachers in their schools. Besides engaging students to learn about celestial bodies, it is concluded that the information system can be used by teachers to introduce appropriate curricula contents and to be implemented in class.

Saving Species in a Snap: On the Feasibility and Efficacy of Augmented Reality-based Wildlife Interactions for Biodiversity Conservation

Interactions with wildlife can contribute to biodiversity conservation outcomes, though safety and accessibility considerations limit animal encounters from being a viable strategy. This investigation explores the feasibility of mobile augmented reality to facilitate interactions with wildlife and encourage biodversity conservation. A mobile augmented reality experience (Snapchat lens), titled “Penguin Rescue!”, was created to allow users to rehabilitate an oil-slicked virtual penguin. Study 1 distributed the lens globally to Snapchat users (N=63,605) who spent an average of 47 seconds rehabilitating the penguin; psychographic data showed pro-environmental interests were not associated with the lens’ use. Study 2 employed a within-subjects experimental design (N=80) to examine the effects of Penguin Rescue! on conservation outcomes. Results showed that the interaction increased connectedness with the species. Moreover, social presence and plausibility served as key mechanisms contributing to environmental concern and behavioral intentions. Overall, results clarify how biophilic interactions via augmented reality can benefit biodiversity conservation.

Toy or Tool? Utilitaristischer und hedonischer Nutzen mobiler Augmented Reality-Apps

ZusammenfassungMobile Augmented Reality (MAR)-Apps für private Konsument:innen existieren zwischenzeitlich für verschiedene Anwendungsbereiche und sie können zahlreiche Funktionen erfüllen. Der vorliegende Beitrag untersucht, welche Faktoren den wahrgenommenen Nutzen und die Bewertung von Konsument:innen beeinflussen. Hierzu werden 100 MAR-Apps anhand der Kategorien Information Layer, Unterhaltung, Bildung, virtuelle Produktproben und sonstige Hilfestellungen systematisiert und hinsichtlich ihres utilitaristischen und hedonischen Nutzens beurteilt. Während der hedonische Nutzen bei MAR-Apps der Kategorie Unterhaltung im Vordergrund steht, zielen MAR-Apps der Kategorien hilfreiche Tools und Information Layer hauptsächlich auf den funktionalen Nutzen ab. Für MAR-Apps der Kategorien Bildung und virtuelle Produktproben sind hedonische und utilitaristische Komponenten gleichermaßen wichtig. Die Untersuchung belegt, dass die von Konsument:innen auf App-Stores abgegebenen Ratings der MAR-Apps zwar von diesen hedonischen und utilitaristischen Nutzenkomponenten getrieben werden. Allerdings zeigt sich eine wichtige Interaktion. Der hedonische Nutzen wirkt sich insbesondere dann auf die Nutzerbewertungen aus, wenn der utilitaristische Nutzen gering ist. Aus den Befunden leiten sich wichtige Implikationen für App-Entwickler und Unternehmen ab.