Mixed reality head-mounted display

2005 ◽  
Author(s):  
C.S.-T. Choy ◽  
Ka-Chun Lu ◽  
Wing-Ming Chow ◽  
Ka-Man Sit ◽  
Ka-Hing Lay ◽  
...  
Keyword(s):  
Mixed Reality ◽  
Head Mounted Display

Visual Coherence in Mixed Reality: A Systematic Enquiry

2017 ◽  
Vol 26 (1) ◽  
pp. 16-41 ◽  
Author(s):  
Jonny Collins ◽  
Holger Regenbrecht ◽  
Tobias Langlotz
Keyword(s):  
Augmented Reality ◽  
Mixed Reality ◽  
Focus Of Attention ◽  
User Experiences ◽  
Head Mounted Display ◽  
Virtual And Augmented Reality

Virtual and augmented reality, and other forms of mixed reality (MR), have become a focus of attention for companies and researchers. Before they can become successful in the market and in society, those MR systems must be able to deliver a convincing, novel experience for the users. By definition, the experience of mixed reality relies on the perceptually successful blending of reality and virtuality. Any MR system has to provide a sensory, in particular visually coherent, set of stimuli. Therefore, issues with visual coherence, that is, a discontinued experience of a MR environment, must be avoided. While it is very easy for a user to detect issues with visual coherence, it is very difficult to design and implement a system for coherence. This article presents a framework and exemplary implementation of a systematic enquiry into issues with visual coherence and possible solutions to address those issues. The focus is set on head-mounted display-based systems, notwithstanding its applicability to other types of MR systems. Our framework, together with a systematic discussion of tangible issues and solutions for visual coherence, aims at guiding developers of mixed reality systems for better and more effective user experiences.

scholarly journals Exploring the Use of Immersive Technology in Education to Bring Abstract Theoretical Concepts to Life

2020 ◽  
Vol 1 (1) ◽  
pp. 70-80
Author(s):  
Ekerin Oluseye Michael ◽  
Heidi Tan Yeen-Ju ◽  
Neo Tse Kian
Keyword(s):  
Virtual Reality ◽  
Subject Matter ◽  
Mixed Reality ◽  
Learning Experience ◽  
Health Sector ◽  
Virtual Technology ◽  
Theoretical Concepts ◽  
Head Mounted Display ◽  
The Subject ◽  
Immersive Technology

Over the years educators have adopted a variety of technologies in a bid to improve student engagement, interest and understanding of abstract topics taught in the classroom. There has been an increasing interest in immersive technology such as Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). The ability of VR to bring ideas to life in three dimensional spaces in a way that is easy for students to understand the subject matter makes it one of the important tools available today for education. A key feature of VR is the ability to provide multi-sensory visuals and virtual interaction to students wearing a Head Mounted Display thus providing students better learning experience and connection to the subject matter. Virtual Reality has been used for training purposes in the health sector, military, workplace training, gamification and exploration of sites and countless others. With the potential benefits of virtual technology in visualizing abstract concepts in a realistic virtual world, this paper presents a plan to study the use of situated cognition theory as a learning framework to develop an immersive VR application that would be used to train and prepare students studying Telecommunications Engineering for the workplace. This paper presents a review of literature in the area of Virtual Reality in education, offers insight into the motivation behind this research and the planned methodology in carrying out the research.

Low Cost Mixed Reality System Using Projectors for Evaluation of Product Design (Shape and Function Structure)

2013 ◽  
Author(s):  
Yuko Chinone ◽  
Hideki Aoyama ◽  
Tetsuo Oya
Keyword(s):  
Mixed Reality ◽  
Low Cost ◽  
Three Dimensional ◽  
Design Evaluation ◽  
Manufacturing Processes ◽  
Head Mounted Display ◽  
Cad Models ◽  
Three Dimensional Models ◽  
And Function ◽  
Cam Systems

Three-dimensional models (CAD models) are constructed in the design processes of products because they are effective for design evaluation processes using CAE systems and manufacturing processes using CAM systems. However, mock-ups or prototypes are still required in the evaluation processes of designability and operability of products because the evaluation of the operations of real products is essential. It is however time-consuming and costly to make prototypes or to develop trial products for evaluation. For this problem, considerable studies have been conducted on the use of mixed reality technology by overlaying an image of the design model onto a physical model using a Head-Mounted Display (HMD) to evaluate the designability and operability of a product. Such technology reduces the need for making physical mock-ups (prototypes and trial products), but HMDs have drawbacks such as causing motion sickness and physical weight, bulkiness of the display, and high costs. In this paper, a method using projectors is proposed to establish mixed reality technology which does not have the drawbacks of HMDs. A mixed reality system was constructed according to the proposed method, and applied for evaluating designability and operability of products without physical mock-ups. In the mixed reality space built by the system, the functions of a product can be held in the hand as if they were real products.

scholarly journals HoloLens-Based AR System with a Robust Point Set Registration Algorithm

Sensors ◽  
2019 ◽  
Vol 19 (16) ◽  
pp. 3555 ◽  
Author(s):  
Jong-Chih Chien ◽  
Yao-Ren Tsai ◽  
Chieh-Tsai Wu ◽  
Jiann-Der Lee
Keyword(s):  
Mixed Reality ◽  
Medical Images ◽  
Main Idea ◽  
Mapping Function ◽  
Medical Data ◽  
Coordinate Space ◽  
Display System ◽  
Point Set Registration ◽  
Head Mounted Display ◽  
Physical Surface

By the standard of today’s image-guided surgery (IGS) technology, in order to check and verify the progress of the surgery, the surgeons still require divert their attention from the patients occasionally to check against the display. In this paper, a mixed-reality system for medical use is proposed that combines an Intel RealSense sensor with Microsoft’s Hololens head-mounted display system, for superimposing medical data onto the physical surface of a patient, so the surgeons do not need to divert their attention from their patients. The main idea of our proposed system is to display the 3D medical images of the patients on the actual patients themselves by placing the medical images and the patients in the same coordinate space. However, the virtual medical data may contain noises and outliers, so the transformation mapping function must be able to handle these problems. The transform function in our system is performed by the use of our proposed Denoised-Resampled-Weighted-and-Perturbed-Iterative Closest Points (DRWP-ICP) algorithm, which performs denoising and removal of outliers before aligning the pre-operative medical image data points to the patient’s physical surface position before displaying the result using the Microsoft HoloLens display system. The experimental results shows that our proposed mixed-reality system using DRWP-ICP is capable of performing accurate and robust mapping despite the presence of noise and outliers.

scholarly journals Telementoring in Leg Fasciotomies via Mixed-Reality: Clinical Evaluation of the STAR Platform

2020 ◽  
Vol 185 (Supplement_1) ◽  
pp. 513-520
Author(s):  
Edgar Rojas-Muñoz ◽  
Maria Eugenia Cabrera ◽  
Chengyuan Lin ◽  
Natalia Sánchez-Tamayo ◽  
Dan Andersen ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Mixed Reality ◽  
Confidence Score ◽  
Experimental Conditions ◽  
Surgical Guidance ◽  
Head Mounted Display ◽  
Operating Field ◽  
Life Saving ◽  
Health Practitioners ◽  
Expert Surgeon

ABSTRACT Introduction Point-of-injury (POI) care requires immediate specialized assistance but delays and expertise lapses can lead to complications. In such scenarios, telementoring can benefit health practitioners by transmitting guidance from remote specialists. However, current telementoring systems are not appropriate for POI care. This article clinically evaluates our System for Telementoring with Augmented Reality (STAR), a novel telementoring system based on an augmented reality head-mounted display. The system is portable, self-contained, and displays virtual surgical guidance onto the operating field. These capabilities can facilitate telementoring in POI scenarios while mitigating limitations of conventional telementoring systems. Methods Twenty participants performed leg fasciotomies on cadaveric specimens under either one of two experimental conditions: telementoring using STAR; or without telementoring but reviewing the procedure beforehand. An expert surgeon evaluated the participants’ performance in terms of completion time, number of errors, and procedure-related scores. Additional metrics included a self-reported confidence score and postexperiment questionnaires. Results STAR effectively delivered surgical guidance to nonspecialist health practitioners: participants using STAR performed fewer errors and obtained higher procedure-related scores. Conclusions This work validates STAR as a viable surgical telementoring platform, which could be further explored to aid in scenarios where life-saving care must be delivered in a prehospital setting.

Inhabitat: An Imaginary Ecosystem in a Children’s Science Museum

Leonardo ◽  
2018 ◽  
Vol 51 (4) ◽  
pp. 343-348
Author(s):  
Haru Hyunkyung Ji ◽  
Graham Wakefield
Keyword(s):  
Virtual Reality ◽  
Mixed Reality ◽  
Science Museum ◽  
Imaginary World ◽  
Large Screen ◽  
Head Mounted Display ◽  
Artificial Nature

Inhabitat is a mixed-reality artwork in which participants become part of an imaginary ecology through three simultaneous perspectives of scale and agency; three distinct ways to see with other eyes. This imaginary world was exhibited at a children’s science museum for five months, using an interactive projection-augmented sculpture, a large screen and speaker array, and a virtual reality head-mounted display. This paper documents the work’s motivations and design contributions, along with accounts of visitors’ playful engagements and reflections within the complex interconnectivity of an artificial nature.

scholarly journals Integrating Animated Computational Fluid Dynamics into Mixed Reality for Building-Renovation Design

Technologies ◽  
2019 ◽  
Vol 8 (1) ◽  
pp. 4 ◽  
Author(s):  
Yuehan Zhu ◽  
Tomohiro Fukuda ◽  
Nobuyoshi Yabuki
Keyword(s):  
Fluid Dynamics ◽  
Computational Fluid Dynamics ◽  
Change Process ◽  
Mixed Reality ◽  
Thermal Environment ◽  
Integrated System ◽  
Prototype System ◽  
Efficient Manner ◽  
Thermal Change ◽  
Head Mounted Display

In advanced society, the existing building stock has a high demand for stock renovation, which gives existing buildings new lives, rather than building new ones. During the renovation process, it is necessary to simultaneously achieve architectural, facilities, structural, and environmental design in order to accomplish a healthy, comfortable, and energy-saving indoor environment, prevent delays in problem-solving, and achieve a timely feedback process. This study tackled the development of an integrated system for stock renovation by considering computational fluid dynamics (CFD) and mixed reality (MR) in order to allow the simultaneous design of a building plan and thermal environment. The CFD analysis enables simulation of the indoor thermal environment, including the entire thermal change process. The MR system, which can be operated by voice command and operated on head-mounted display (HMD), enables intuitive visualization of the thermal change process and, in a very efficient manner, shows how different renovation projects perform for various stakeholders. A prototype system is developed with Unity3D engine and HoloLens HMD. In the integrated system, a new CFD visualization method generating 3D CFD animation sequence for the MR system is proposed that allows stakeholders to consider the entirety of changes in the thermal environment.

scholarly journals Exploring the Effects of Scale and Color Differences on Users’ Perception for Everyday Mixed Reality (MR) Experience: Toward Comparative Analysis Using MR Devices

Electronics ◽  
2020 ◽  
Vol 9 (10) ◽  
pp. 1623
Author(s):  
Kwang-seong Shin ◽  
Howon Kim ◽  
Jeong gon Lee ◽  
Dongsik Jo
Keyword(s):  
Mixed Reality ◽  
Real Life ◽  
Technological Innovations ◽  
Virtual Objects ◽  
Head Mounted Display ◽  
Color Differences ◽  
Design And Manufacturing ◽  
Different Types ◽  
Real Objects ◽  
Different Parts

With continued technological innovations in the fields of mixed reality (MR), wearable type MR devices, such as head-mounted display (HMD), have been released and are frequently used in various fields, such as entertainment, training, education, and shopping. However, because each product has different parts and specifications in terms of design and manufacturing process, users feel that the virtual objects overlaying real environments in MR are visualized differently, depending on the scale and color used by the MR device. In this paper, we compare the effect of scale and color parameters on users’ perceptions in using different types of MR devices to improve their MR experiences in real life. We conducted two experiments (scale and color), and our experimental study showed that the subjects who participated in the scale perception experiment clearly tended to underestimate virtual objects, in comparison with real objects, and overestimated color in MR environments.

scholarly journals Mixed reality interactive visualization of cardiovascular anatomy in interventional lab – clinical implementation in transvascular patent ductus arteriosus closure

2020 ◽  
Vol 41 (Supplement_2) ◽  
Author(s):  
J.D Kasprzak ◽  
M Kierepka ◽  
A Zlahoda-Huzior ◽  
M Stanuch ◽  
D Zolna ◽  
...  
Keyword(s):  
Computed Tomography ◽  
Patent Ductus Arteriosus ◽  
Spatial Data ◽  
Mixed Reality ◽  
Ductus Arteriosus ◽  
Practical Implementation ◽  
Funding Source ◽  
Private Company ◽  
Head Mounted Display ◽  
Patent Ductus

Abstract Aim Three-dimensional (3D) noninvasively acquired datasets containing anatomical information about the heart are a modern option for procedural support during percutaneous cardiac interventions. We present initial experience of patent ductus arteriosus (PDA) closure with workflow integrated with innovative mixed reality display (MRD) to improve 3D perception and navigation in 3D computed tomography angiographic (CTA) datasets. Methods We report incorporation of intraprocedural mixed-reality display of segmented CTA (computed tomography angiography) data using a voice- and gesture controlled head-mounted display during routine percutaneous occlusions of PDA in adults. A dedicated software pathway was used for files conversion, real-time Wi-Fi streaming of 3D rendering from PC to device and manipulation of spatial data during the procedures. Results Pre-recorded CTA studies of aorta and ductus were manually segmented and uploaded into custom designed 3D DICOM for realtime export to MRD device. 3D holograms were successfully displayed during the procedure by commercially available head-mounted display allowing touchless control and image sharing within cath-lab. Wiring of PDA aortic orifice was assisted by 3D hologram controlled by the imaging specialist and shared by the operator. Thus, MRD using evolving versions of custom software was successfully executed with segmented data presented as a semitransparent cubic hologram positioned in a convenient part of visual field allowing real-world action and with touchless control by medical team. Operator appreciated the use of MRD hologram realistically visualizing spatial relationships as practical aid to establish anatomical relationships and facilitate entry into ductus orifice. Procedures were successfully completed using arteriovenous guidewire loop to implant vascular occluders. Conclusions We demonstrate the methodology and software evolution (segmentation, data fusion) allowing practical implementation of intraprocedural mixed reality display of 3D CTA data, with sterile, touchless control of holographic image shared by interventional and imaging team to support percutaneous PDA closure. Funding Acknowledgement Type of funding source: Private company. Main funding source(s): MEDAPP

Sign in / Sign up

Export Citation Format

Share Document