scholarly journals Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

2020 ◽  
Vol 4 (4) ◽  
pp. 78
Author(s):  
Andoni Rivera Pinto ◽  
Johan Kildal ◽  
Elena Lazkano
Keyword(s):  
Augmented Reality ◽  
Industrial Production ◽  
User Study ◽  
Haptic Feedback ◽  
Mixed Reality ◽  
Robot Arm ◽  
Pick And Place ◽  
Place Task ◽  
Guidance Technique ◽  
The Impact

In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm which we found to be beneficial.

scholarly journals Enhancing Interaction with Augmented Reality through Mid-Air Haptic Feedback: Architecture Design and User Feedback

2019 ◽  
Vol 9 (23) ◽  
pp. 5123 ◽  
Author(s):  
Diego Vaquero-Melchor ◽  
Ana M. Bernardos
Keyword(s):  
Augmented Reality ◽  
User Study ◽  
Haptic Feedback ◽  
Form Perception ◽  
Natural Interaction ◽  
Head Mounted Displays ◽  
Flexible Architecture ◽  
Immersive Visualization ◽  
Study Participants ◽  
Interface Metaphor

Nowadays, Augmented-Reality (AR) head-mounted displays (HMD) deliver a more immersive visualization of virtual contents, but the available means of interaction, mainly based on gesture and/or voice, are yet limited and obviously lack realism and expressivity when compared to traditional physical means. In this sense, the integration of haptics within AR may help to deliver an enriched experience, while facilitating the performance of specific actions, such as repositioning or resizing tasks, that are still dependent on the user’s skills. In this direction, this paper gathers the description of a flexible architecture designed to deploy haptically enabled AR applications both for mobile and wearable visualization devices. The haptic feedback may be generated through a variety of devices (e.g., wearable, graspable, or mid-air ones), and the architecture facilitates handling the specificity of each. For this reason, within the paper, it is discussed how to generate a haptic representation of a 3D digital object depending on the application and the target device. Additionally, the paper includes an analysis of practical, relevant issues that arise when setting up a system to work with specific devices like HMD (e.g., HoloLens) and mid-air haptic devices (e.g., Ultrahaptics), such as the alignment between the real world and the virtual one. The architecture applicability is demonstrated through the implementation of two applications: (a) Form Inspector and (b) Simon Game, built for HoloLens and iOS mobile phones for visualization and for UHK for mid-air haptics delivery. These applications have been used to explore with nine users the efficiency, meaningfulness, and usefulness of mid-air haptics for form perception, object resizing, and push interaction tasks. Results show that, although mobile interaction is preferred when this option is available, haptics turn out to be more meaningful in identifying shapes when compared to what users initially expect and in contributing to the execution of resizing tasks. Moreover, this preliminary user study reveals some design issues when working with haptic AR. For example, users may be expecting a tailored interface metaphor, not necessarily inspired in natural interaction. This has been the case of our proposal of virtual pressable buttons, built mimicking real buttons by using haptics, but differently interpreted by the study participants.

scholarly journals Comparing VR- and AR-Based Try-On Systems Using Personalized Avatars

Electronics ◽  
2020 ◽  
Vol 9 (11) ◽  
pp. 1814
Author(s):  
Yuzhao Liu ◽  
Yuhan Liu ◽  
Shihui Xu ◽  
Kelvin Cheng ◽  
Soh Masuko ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
Mobile Application ◽  
User Study ◽  
User Studies ◽  
Apparel Shopping ◽  
Shopping Experience ◽  
Online Experience ◽  
The Impact ◽  
Virtual Body

Despite the convenience offered by e-commerce, online apparel shopping presents various product-related risks, as consumers can neither physically see nor try products on themselves. Augmented reality (AR) and virtual reality (VR) technologies have been used to improve the shopping online experience. Therefore, we propose an AR- and VR-based try-on system that provides users a novel shopping experience where they can view garments fitted onto their personalized virtual body. Recorded personalized motions are used to allow users to dynamically interact with their dressed virtual body in AR. We conducted two user studies to compare the different roles of VR- and AR-based try-ons and validate the impact of personalized motions on the virtual try-on experience. In the first user study, the mobile application with the AR- and VR-based try-on is compared to a traditional e-commerce interface. In the second user study, personalized avatars with pre-defined motion and personalized motion is compared to a personalized no-motion avatar with AR-based try-on. The result shows that AR- and VR-based try-ons can positively influence the shopping experience, compared with the traditional e-commerce interface. Overall, AR-based try-on provides a better and more realistic garment visualization than VR-based try-on. In addition, we found that personalized motions do not directly affect the user’s shopping experience.

scholarly journals Impact of virtual and augmented reality on theme parks

2021 ◽  
Author(s):  
Trevor Nelson
Keyword(s):  
Virtual Reality ◽  
Augmented Reality ◽  
Mixed Reality ◽  
Business Case ◽  
Theme Park ◽  
Theme Parks ◽  
Head Mounted Displays ◽  
Virtual And Augmented Reality ◽  
Physical Spaces ◽  
The Impact

Virtual Reality (VR) and Augmented Reality (AR), provide immersive experiences that are increasingly considered for implementation within Theme Parks. This paper seeks to determine the impact of virtual technologies on the Theme Parks. The method for this paper involved interviews with industry leading experts from the Theme Park industry. The interviews were structured to determine more detailed information on how they are approaching VR/AR in Theme Park attractions. Theme Parks need to provide guests with something they can’t get at home. There are many challenges with head mounted displays (HMD) in Theme Parks, as a result, several participants pointed to Mixed Reality (MR) as a better current solution. It mixes physical spaces with digital overlays with less complicated and operationally challenging technology. New attractions using VR/AR/MR technologies need to carefully consider what content they will use, mechanics of the experience and the business case to ultimately achieve overall success.

scholarly journals Optimum Utilization of Energy Consumption in Arm Robot

2019 ◽  
Vol 13 (5) ◽  
pp. 57
Author(s):  
Hairol Nizam Mohd Shah ◽  
Zalina Kamis ◽  
Ahmad Zaki Shukor ◽  
Mohd Rizuan Baharon ◽  
Marizan Sulaiman ◽  
...  
Keyword(s):  
Inverse Kinematics ◽  
Position Angle ◽  
Optimization Process ◽  
Control Parameters ◽  
Robot Arm ◽  
Theoretical Simulation ◽  
Pick And Place ◽  
Optimum Utilization ◽  
Place Task ◽  
And Performance

This paper introduced on how to minimize the energy and performance of arm robot. The objective is to design the optima; performance of the arm robot movement in performing certain tasks. There are three process involved in minimize the energy which are hardware assembly selection, Denavit Haternberg (D-H) parameters and optimization process of robot movements. A 3 degree of freedom ROB0036 robot arm is use as hardware selection. Then determine the Denavit Haternberg (D-H) parameters for robot through theoretical, simulation and practical forward and inverse kinematics. The optimization process involved how to control parameters know as position angle and the speed of motor of three main axes of arm robot. The performance is measured respect to the two movement, which are reference and optimized. The energy efficiency analysis is performs to reduce this energy consumed. The simulation resulted show that the minimum motor’s movement of joint, the less time taken to achieve of to complete the pick and place task. Directly, it results on less energy used and increase the robot arm performance.

scholarly journals Using Augmented Reality Application to Reduce Time Completion and Error Rate in PC Assembly

2020 ◽  
Vol 4 (3) ◽  
pp. 166
Author(s):  
Safiani Osman ◽  
Danakorn Nincarean Eh Phon ◽  
Nurul Aswa Omar ◽  
Mohd Rustam Mohd Rameli ◽  
Najua Syuhada Ahmad Alhassora ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Error Rate ◽  
User Study ◽  
New Technology ◽  
Task Completion ◽  
Traditional Group ◽  
Assembly Task ◽  
Augmented Reality Application ◽  
3D Information ◽  
The Impact

In the present context of globalization, the demand for assembly skill has increased and play an essential role in today’s industry. The traditional assembly instruction, face-to-face and manual instruction, may contain unimportant information that can result in misinterpretation, which in turn may increase the number of error and takes longer time to complete the task. A new technology (AR) claims to increase the efficiency of assembly task by directly visualizing computer generated 3D information in the real environment. Therefore, this study aims to determine the impact of AR on the time of task completion and the number of error made during the assembly task. The comparative user study was quantitative involving 18 users divided into either AR group or traditional group performing a pc assembly task. Statistical analysis revealed that the time of completion and error rate for two different group is statistically significant. The findings showed that the use of AR application has resulted in decreasing the number of error made and shorten the time to complete the task than the traditional instructional manual in assemble a pc. Considering these result, it can conclude that augmented reality application is an effective and beneficial tool to be applied in assembly and education.

scholarly journals Evaluating Virtual Human Role-Players for the Practice and Development of Leadership Skills

2021 ◽  
Vol 2 ◽  
Author(s):  
Gonzalo Suárez ◽  
Sungchul Jung ◽  
Robert W. Lindeman
Keyword(s):  
Leadership Training ◽  
User Study ◽  
Mixed Reality ◽  
Leadership Skills ◽  
Training Session ◽  
Virtual Human ◽  
Training Experience ◽  
Significant Difference ◽  
Role Players ◽  
The Impact

This article reports on a study to evaluate the effectiveness of virtual human (VH) role-players as leadership training tools within two computer-generated environments, virtual reality (VR) and mixed reality (MR), compared to a traditional training method, real human (RH) role-players in a real-world (RW) environment. We developed an experimental training platform to assess the three conditions: RH role-players in RW (RH-RW), VH role-players in VR (VH-VR), and VH role-players in MR (VH-MR), during two practice-type opportunities, namely pre-session and post-session. We conducted a user study where 30 participants played the role of leaders in interacting with either RHs or VHs before and after receiving a leadership training session. We then investigated (1) if VH role-players were as effective as RH role-players during pre- and post-sessions, and (2) the impact that the human-type (RH, VH) in conjunction with the environment-type (RW, VR, MR) had on the outcomes. We also collected user reactions and learning data from the overall training experience. The results showed a regular increase in performance from pre- to post-sessions in all three conditions. However, we did not find a significant difference between VHs and RHs. Interestingly, the VH-MR condition had a more significant influence on performance and task engagement compared to the VH-VR and RH-RW conditions. Based on our findings, we conclude that VH role-players can be as effective as RH role-players to support the practice of leadership skills, where VH-MR could be the best method due to its effectiveness.

Sign in / Sign up

Export Citation Format

Share Document