An Inertial Device-based User Interaction with Occlusion-free Object Handling in a Handheld Augmented Reality

2018 ◽  
Vol 10 (6) ◽  
Author(s):  
Goh Eg Su ◽  
◽  
Mohd Sharizal Sunar ◽  
Rino Andias ◽  
Ajune Wanis Ismail ◽  
...  
Keyword(s):  
Augmented Reality ◽  
User Interaction ◽  
Free Object

scholarly journals ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2234
Author(s):  
Sebastian Kapp ◽  
Michael Barz ◽  
Sergey Mukhametov ◽  
Daniel Sonntag ◽  
Jochen Kuhn
Keyword(s):  
Augmented Reality ◽  
Eye Tracking ◽  
User Interaction ◽  
R Package ◽  
Eye Tracker ◽  
Unity 3D ◽  
Accuracy And Precision ◽  
Head Mounted Displays ◽  
Virtual And Augmented Reality ◽  
Microsoft Hololens

Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (n=21). On average, we found that gaze estimates are reported with an angular accuracy of 0.83 degrees and a precision of 0.27 degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.

Development of a Low-Cost Augmented Reality Head-Mounted Display Prototype

2018 ◽  
pp. 1-28
Author(s):  
Thiago D'Angelo ◽  
Saul Emanuel Delabrida Silva ◽  
Ricardo A. R. Oliveira ◽  
Antonio A. F. Loureiro
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
User Experience ◽  
Low Cost ◽  
User Interaction ◽  
Daily Activities ◽  
Head Mounted Display ◽  
Time Performance ◽  
Work Tasks ◽  
Head Mounted Displays

Virtual Reality and Augmented Reality Head-Mounted Displays (HMDs) have been emerging in the last years. These technologies sound like the new hot topic for the next years. Head-Mounted Displays have been developed for many different purposes. Users have the opportunity to enjoy these technologies for entertainment, work tasks, and many other daily activities. Despite the recent release of many AR and VR HMDs, two major problems are hindering the AR HMDs from reaching the mainstream market: the extremely high costs and the user experience issues. In order to minimize these problems, we have developed an AR HMD prototype based on a smartphone and on other low-cost materials. The prototype is capable of running Eye Tracking algorithms, which can be used to improve user interaction and user experience. To assess our AR HMD prototype, we choose a state-of-the-art method for eye center location found in the literature and evaluate its real-time performance in different development boards.

Real-Time 3D Design Modelling of Outdoor Structures Using Mobile Augmented Reality Systems

2009 ◽  
pp. 937-951
Author(s):  
Wayne Piekarski
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
User Interaction ◽  
Physical World ◽  
Iterative Refinement ◽  
3D Design ◽  
Real Objects ◽  
Modelling Techniques ◽  
Head Gestures ◽  
The Mind

This chapter presents a series of new augmented reality user interaction techniques to support the capture and creation of 3D geometry of large outdoor structures. Named construction at a distance, these techniques are based on the action at a distance concepts employed by other virtual environments researchers. These techniques address the problem of AR systems traditionally being consumers of information, rather than being used to create new content. By using information about the user’s physical presence along with hand and head gestures, AR systems can be used to capture and create the geometry of objects that are orders of magnitude larger than the user, with no prior information or assistance. While existing scanning techniques can only be used to capture existing physical objects, construction at a distance also allows the creation of new models that exist only in the mind of the user. Using a single AR interface, users can enter geometry and verify its accuracy in real-time. Construction at a distance is a collection of 3D modelling techniques based on the concept of AR working planes, landmark alignment, constructive solid geometry operations, and iterative refinement to form complex shapes. This chapter presents a number of different construction at a distance techniques, and are demonstrated with examples of real objects that have been modelled in the physical world.

scholarly journals ARGarden: 3D outdoor landscape design using handheld augmented reality with multi-user interaction

2020 ◽  
Vol 979 ◽  
pp. 012001
Author(s):  
F E Fadzli ◽  
M A Mohd Yusof ◽  
A W Ismail ◽  
M S Hj Salam ◽  
N A Ismail
Keyword(s):  
Augmented Reality ◽  
User Interaction ◽  
Landscape Design

Educational and Cultural Environments Enriched Using Augmented Reality Technology

2018 ◽  
Vol 4 (8) ◽  
pp. 52-59 ◽  
Author(s):  
Paola A. Cepeda-Galvis
Keyword(s):  
Augmented Reality ◽  
Learning Environments ◽  
User Experience ◽  
User Interaction ◽  
Easy Access ◽  
Innovative Technology ◽  
Design Development ◽  
History Museum ◽  
Implementation Methodology ◽  
Development Evaluation

The domain of cultural-educational and tourist environments has entered the digital age, this allows the implementation of technologies of Augmented Reality (AR) to improve the user experience in these environments, and entails the possibility of providing greater satisfaction to the user visiting these locations. Hence, the problem was formulated. What is the effect of integrating AR to improve the user interaction of a cultural-educational environment? Case: UPTC natural history museum. It presents a documentary research that analyzes studies on AR, view it as a tool of support for learning and entertainment processes through the recognition of cultural, educational and tourist locations. We sought to identify the applicability of AR in cultural settings for didactic, adaptive and learning purposes, based on the concept of ‘Edutainment’. Research methods: logical analysis and generaliaation of scientific literature, both absolute and relative statistical data and case studies. The analysis, obtaining, design, development, evaluation and implementation, methodology for projects based on AR was used for thi work; applied in 34% of the works identified. It sought to recognise the characteristics and advantages of using AR technology as a resource to improve the user experience, combined technology and entertainment to achieve learning objectives. In total, 210 papers were identified and reviewed  The technical and operational viability of the AR is deduced; this is an innovative technology that captivates the attention of the user. The combination of the real and the virtual; and its easy access are the characteristics of an application based on AR, implemented in cultural and learning environments. Keywords: Augmented reality, cultural and learning environments, edutainment, e-learning. 

scholarly journals Towards the Internet of Augmented Things: An Open-source Framework to Interconnect IoT Devices and Augmented Reality Systems

Proceedings ◽  
2019 ◽  
Vol 42 (1) ◽  
pp. 50 ◽  
Author(s):  
Óscar Blanco-Novoa ◽  
Paula Fraga-Lamas ◽  
Miguel Vilar-Montesinos ◽  
Tiago Fernández-Caramés
Keyword(s):  
Augmented Reality ◽  
Open Source ◽  
Mixed Reality ◽  
User Interaction ◽  
Physical World ◽  
The Internet ◽  
Full Potential ◽  
Smart Power ◽  
Open Source Framework ◽  
Iot Devices

The latest Augmented Reality (AR) and Mixed Reality (MR) systems are able to provide innovative methods for user interaction, but their full potential can only be achieved when they are able to exchange bidirectional information with the physical world that surround them, including the objects that belong to the Internet of Things (IoT). The problem is that elements like AR display devices or IoT sensors/actuators often use heterogeneous technologies that make it difficult to intercommunicate them in an easy way, thus requiring a high degree of specialization to carry out such a task. This paper presents an open-source framework that eases the integration of AR and IoT devices as well as the transfer of information among them, both in real time and in a dynamic way. The proposed framework makes use of widely used standard protocols and open-source tools like MQTT, HTTPS or Node-RED. In order to illustrate the operation of the framework, this paper presents the implementation of a practical home automation example: an AR/MR application for energy consumption monitoring that allows for using a pair of Microsoft HoloLens smart glasses to interact with smart power outlets.

Sign in / Sign up

Export Citation Format

Share Document