scholarly journals ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2234
Author(s):  
Sebastian Kapp ◽  
Michael Barz ◽  
Sergey Mukhametov ◽  
Daniel Sonntag ◽  
Jochen Kuhn
Keyword(s):  
Augmented Reality ◽  
Eye Tracking ◽  
User Interaction ◽  
R Package ◽  
Eye Tracker ◽  
Unity 3D ◽  
Accuracy And Precision ◽  
Head Mounted Displays ◽  
Virtual And Augmented Reality ◽  
Microsoft Hololens

Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (n=21). On average, we found that gaze estimates are reported with an angular accuracy of 0.83 degrees and a precision of 0.27 degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.

Immersive reading in virtual and augmented reality environment

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Pei-Luen Patrick Rau ◽  
Jian Zheng ◽  
Zhi Guo
Keyword(s):  
Augmented Reality ◽  
Liquid Crystal Display ◽  
Reading Speed ◽  
Reading Performance ◽  
Multiple Choice Questions ◽  
Content Type ◽  
Head Mounted Displays ◽  
Virtual And Augmented Reality ◽  
Display Quality ◽  
Speed And Accuracy

Purpose This study aims to investigate “immersive reading,” which occurs when individuals read text while in a virtual reality (VR) or augmented reality (AR) environment. Design/methodology/approach In Experiment 1, 64 participants read text passages and answered multiple-choice questions in VR and AR head-mounted displays (HMDs) compared with doing the same task on liquid crystal display (LCD). In Experiment 2, 31 participants performed the same reading tasks but with two VR HMDs of different display quality. Findings Compared with reading on LCD as the baseline, participants reading in VR and AR HMDs got 82% (VR) and 88% (AR) of the information accurately. Participants tended to respond more accurately and faster, though not statistically significant, with the VR HMD of higher pixel density in the speed-reading task. Originality/value The authors observed the speed and accuracy of reading in VR and AR environments, compared with the reading speed and accuracy on an LCD monitor. The authors also compared the reading performance on two VR HMDs that differed in display quality but were otherwise similar in every way.

Development of a Low-Cost Augmented Reality Head-Mounted Display Prototype

2018 ◽  
pp. 1-28
Author(s):  
Thiago D'Angelo ◽  
Saul Emanuel Delabrida Silva ◽  
Ricardo A. R. Oliveira ◽  
Antonio A. F. Loureiro
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
User Experience ◽  
Low Cost ◽  
User Interaction ◽  
Daily Activities ◽  
Head Mounted Display ◽  
Time Performance ◽  
Work Tasks ◽  
Head Mounted Displays

Virtual Reality and Augmented Reality Head-Mounted Displays (HMDs) have been emerging in the last years. These technologies sound like the new hot topic for the next years. Head-Mounted Displays have been developed for many different purposes. Users have the opportunity to enjoy these technologies for entertainment, work tasks, and many other daily activities. Despite the recent release of many AR and VR HMDs, two major problems are hindering the AR HMDs from reaching the mainstream market: the extremely high costs and the user experience issues. In order to minimize these problems, we have developed an AR HMD prototype based on a smartphone and on other low-cost materials. The prototype is capable of running Eye Tracking algorithms, which can be used to improve user interaction and user experience. To assess our AR HMD prototype, we choose a state-of-the-art method for eye center location found in the literature and evaluate its real-time performance in different development boards.

Piezo-actuated varifocal head-mounted displays for virtual and augmented reality

2019 ◽  
Author(s):  
Pierre-Yves Laffont ◽  
Ali Hasnain ◽  
Shukri B. Jalil ◽  
Kutluhan Buyukburc ◽  
Pierre-Yves Guillemet ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Head Mounted Displays ◽  
Virtual And Augmented Reality

scholarly journals P300 Brain–Computer Interface-Based Drone Control in Virtual and Augmented Reality

Sensors ◽  
2021 ◽  
Vol 21 (17) ◽  
pp. 5765
Author(s):  
Soram Kim ◽  
Seungyun Lee ◽  
Hyunsuk Kang ◽  
Sion Kim ◽  
Minkyu Ahn
Keyword(s):  
Augmented Reality ◽  
Brain Computer Interface ◽  
Self Control ◽  
Computer Interface ◽  
Head Mounted Displays ◽  
Before And After ◽  
Virtual And Augmented Reality ◽  
Program Environment ◽  
Control Application ◽  
Drone Control

Since the emergence of head-mounted displays (HMDs), researchers have attempted to introduce virtual and augmented reality (VR, AR) in brain–computer interface (BCI) studies. However, there is a lack of studies that incorporate both AR and VR to compare the performance in the two environments. Therefore, it is necessary to develop a BCI application that can be used in both VR and AR to allow BCI performance to be compared in the two environments. In this study, we developed an opensource-based drone control application using P300-based BCI, which can be used in both VR and AR. Twenty healthy subjects participated in the experiment with this application. They were asked to control the drone in two environments and filled out questionnaires before and after the experiment. We found no significant (p > 0.05) difference in online performance (classification accuracy and amplitude/latency of P300 component) and user experience (satisfaction about time length, program, environment, interest, difficulty, immersion, and feeling of self-control) between VR and AR. This indicates that the P300 BCI paradigm is relatively reliable and may work well in various situations.

scholarly journals Virtual and Augmented Reality Direct Ophthalmoscopy Tool: A Comparison between Interactions Methods

2021 ◽  
Vol 5 (11) ◽  
pp. 66
Author(s):  
Michael Chan ◽  
Alvaro Uribe-Quevedo ◽  
Bill Kapralos ◽  
Michael Jenkin ◽  
Norman Jaimes ◽  
...  
Keyword(s):  
Augmented Reality ◽  
User Interfaces ◽  
Tracking System ◽  
Hand Tracking ◽  
Medical Procedure ◽  
Computer Based ◽  
Eye Examination ◽  
Virtual And Augmented Reality ◽  
Microsoft Hololens ◽  
Direct Ophthalmoscopy

Direct ophthalmoscopy (DO) is a medical procedure whereby a health professional, using a direct ophthalmoscope, examines the eye fundus. DO skills are in decline due to the use of interactive diagnostic equipment and insufficient practice with the direct ophthalmoscope. To address the loss of DO skills, physical and computer-based simulators have been developed to offer additional training. Among the computer-based simulations, virtual and augmented reality (VR and AR, respectively) allow simulated immersive and interactive scenarios with eye fundus conditions that are difficult to replicate in the classroom. VR and AR require employing 3D user interfaces (3DUIs) to perform the virtual eye examination. Using a combination of a between-subjects and within-subjects paradigm with two groups of five participants, this paper builds upon a previous preliminary usability study that compared the use of the HTC Vive controller, the Valve Index controller, and the Microsoft HoloLens 1 hand gesticulation interaction methods when performing a virtual direct ophthalmoscopy eye examination. The work described in this paper extends our prior work by considering the interactions with the Oculus Quest controller and Oculus Quest hand-tracking system to perform a virtual direct ophthalmoscopy eye examination while allowing us to compare these methods without our prior interaction techniques. Ultimately, this helps us develop a greater understanding of usability effects for virtual DO examinations and virtual reality in general. Although the number of participants was limited, n = 5 for Stage 1 (including the HTC Vive controller, the Valve Index controller, and the Microsoft HoloLens hand gesticulations), and n = 13 for Stage 2 (including the Oculus Quest controller and the Oculus Quest hand tracking), given the COVID-19 restrictions, our initial results comparing VR and AR 3D user interactions for direct ophthalmoscopy are consistent with our previous preliminary study where the physical controllers resulted in higher usability scores, while the Oculus Quest’s more accurate hand motion capture resulted in higher usability when compared to the Microsoft HoloLens hand gesticulation.

scholarly journals Impact of virtual and augmented reality on theme parks

2021 ◽  
Author(s):  
Trevor Nelson
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
Mixed Reality ◽  
Business Case ◽  
Theme Park ◽  
Theme Parks ◽  
Head Mounted Displays ◽  
Virtual And Augmented Reality ◽  
Physical Spaces ◽  
The Impact

Virtual Reality (VR) and Augmented Reality (AR), provide immersive experiences that are increasingly considered for implementation within Theme Parks. This paper seeks to determine the impact of virtual technologies on the Theme Parks. The method for this paper involved interviews with industry leading experts from the Theme Park industry. The interviews were structured to determine more detailed information on how they are approaching VR/AR in Theme Park attractions. Theme Parks need to provide guests with something they can’t get at home. There are many challenges with head mounted displays (HMD) in Theme Parks, as a result, several participants pointed to Mixed Reality (MR) as a better current solution. It mixes physical spaces with digital overlays with less complicated and operationally challenging technology. New attractions using VR/AR/MR technologies need to carefully consider what content they will use, mechanics of the experience and the business case to ultimately achieve overall success.

A Comparative Study of Virtual Footwear Try-on Applications in Virtual and Augmented Reality

2021 ◽  
pp. 1-29
Author(s):  
Chih-Hsing Chu ◽  
Yi-An Chen ◽  
Ying-Yin Huang ◽  
Yun-Ju Lee
Keyword(s):  
Augmented Reality ◽  
User Experience ◽  
User Study ◽  
Affective Responses ◽  
Eye Tracker ◽  
Psychological Measures ◽  
Fashion Products ◽  
Sense Of Presence ◽  
Virtual And Augmented Reality

Abstract Virtual try-on technology (VTO) in virtual reality (VR) and augmented reality (AR) has been developed for years to create novel shopping experiences for users by allowing them to virtually wear fashion products. Compared to garments or facial accessories, fewer studies have focused on virtual footwear try-on, regardless of user study or technical development. Thus, it is necessary to examine the effectiveness of existing VTO applications on the user's affective responses. In this study, we compared the user experience of three different footwear try-on methods (real, VR, and AR) with both physiological and psychological measures. Subjects conducted a try-on experiment on different pairs of sneakers. Each subject's gaze trajectory was recorded using an eye tracker and analyzed to show his/her visual attention in each method. Afterward, the subjects completed questionnaires to assess the sense of presence, usability, and the user experience score for the try-on processes, and subsequently attended a think-aloud procedure to express their thoughts. The analysis results of the collected data showed that the user experience produced by the VR and AR try-on is not comparable to that of the real environment. The results also revealed factors that negatively affect the quality of the user's interaction with the processes. These findings may provide insights into further improvements in VTO technology.

scholarly journals Wearable Augmented Reality Application for Shoulder Rehabilitation

Electronics ◽  
2019 ◽  
Vol 8 (10) ◽  
pp. 1178 ◽  
Author(s):  
Sara Condino ◽  
Giuseppe Turini ◽  
Rosanna Viglialoro ◽  
Marco Gesi ◽  
Vincenzo Ferrari
Keyword(s):  
Augmented Reality ◽  
Frame Rate ◽  
Markerless Tracking ◽  
Head Mounted Displays ◽  
Target Frame ◽  
Microsoft Hololens ◽  
Technical Features ◽  
Wearable Augmented Reality ◽  
Real Patients ◽  
Rehabilitation Exercise

Augmented reality (AR) technology is gaining popularity and scholarly interest in the rehabilitation sector because of the possibility to generate controlled, user-specific environmental and perceptual stimuli which motivate the patient, while still preserving the possibility to interact with the real environment and other subjects, including the rehabilitation specialist. The paper presents the first wearable AR application for shoulder rehabilitation, based on Microsoft HoloLens, with real-time markerless tracking of the user’s hand. Potentialities and current limits of commercial head-mounted displays (HMDs) are described for the target medical field, and details of the proposed application are reported. A serious game was designed starting from the analysis of a traditional rehabilitation exercise, taking into account HoloLens specifications to maximize user comfort during the AR rehabilitation session. The AR application implemented consistently meets the recommended target frame rate for immersive applications with HoloLens device: 60 fps. Moreover, the ergonomics and the motivational value of the proposed application were positively evaluated by a group of five rehabilitation specialists and 20 healthy subjects. Even if a larger study, including real patients, is necessary for a clinical validation of the proposed application, the results obtained encourage further investigations and the integration of additional technical features for the proposed AR application.

Sign in / Sign up

Export Citation Format

Share Document