Augmented Reality Based Navigation for Distal Interlocking of Intramedullary Nails Utilizing Microsoft HoloLens 2

2021 ◽  
pp. 104402
Author(s):  
Puxun Tu ◽  
Yao Gao ◽  
Abel J. Lungu ◽  
Dongyuan Li ◽  
Huixiang Wang ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Intramedullary Nails ◽  
Distal Interlocking ◽  
Microsoft Hololens

Demonstration: Virtual Patient Immersive Trainer to Train Perceptual Skills Using Augmented Reality

2020 ◽  
Vol 64 (1) ◽  
pp. 470-472
Author(s):  
Christen E. Sushereba ◽  
Laura G. Militello
Keyword(s):  
Medical Students ◽  
Augmented Reality ◽  
Student Performance ◽  
Group Interaction ◽  
Virtual Patient ◽  
Perceptual Cues ◽  
Perceptual Skills ◽  
Individual Interaction ◽  
Severity Of Injury ◽  
Microsoft Hololens

In this session, we will demonstrate the Virtual Patient Immersive Trainer (VPIT). The VPIT system uses augmented reality (AR) to allow medics and medical students to experience a photorealistic, life-sized virtual patient. The VPIT supports learners in obtaining the perceptual skills required to recognize and interpret subtle perceptual cues critical to assessing a patient’s condition. We will conduct an interactive demonstration of the virtual patient using both a tablet (for group interaction) and an AR-enabled headset (Microsoft HoloLens) for individual interaction. In addition, we will demonstrate use of the instructor tablet to control what the learner sees (e.g., injury types, severity of injury) and to monitor student performance.

scholarly journals ARETT: Augmented Reality Eye Tracking Toolkit for Head Mounted Displays

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2234
Author(s):  
Sebastian Kapp ◽  
Michael Barz ◽  
Sergey Mukhametov ◽  
Daniel Sonntag ◽  
Jochen Kuhn
Keyword(s):  
Augmented Reality ◽  
Eye Tracking ◽  
User Interaction ◽  
R Package ◽  
Eye Tracker ◽  
Unity 3D ◽  
Accuracy And Precision ◽  
Head Mounted Displays ◽  
Virtual And Augmented Reality ◽  
Microsoft Hololens

Currently an increasing number of head mounted displays (HMD) for virtual and augmented reality (VR/AR) are equipped with integrated eye trackers. Use cases of these integrated eye trackers include rendering optimization and gaze-based user interaction. In addition, visual attention in VR and AR is interesting for applied research based on eye tracking in cognitive or educational sciences for example. While some research toolkits for VR already exist, only a few target AR scenarios. In this work, we present an open-source eye tracking toolkit for reliable gaze data acquisition in AR based on Unity 3D and the Microsoft HoloLens 2, as well as an R package for seamless data analysis. Furthermore, we evaluate the spatial accuracy and precision of the integrated eye tracker for fixation targets with different distances and angles to the user (n=21). On average, we found that gaze estimates are reported with an angular accuracy of 0.83 degrees and a precision of 0.27 degrees while the user is resting, which is on par with state-of-the-art mobile eye trackers.

Estimating Distances in Action Space in Augmented Reality

2021 ◽  
Vol 18 (2) ◽  
pp. 1-16
Author(s):  
Holly C. Gagnon ◽  
Carlos Salas Rosales ◽  
Ryan Mileris ◽  
Jeanine K. Stefanucci ◽  
Sarah H. Creem-Regehr ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Real World ◽  
Distance Measure ◽  
Distance Perception ◽  
Action Space ◽  
Indoor Environments ◽  
Verbal Reports ◽  
Visual Matching ◽  
Microsoft Hololens ◽  
Real Person

Augmented reality ( AR ) is important for training complex tasks, such as navigation, assembly, and medical procedures. The effectiveness of such training may depend on accurate spatial localization of AR objects in the environment. This article presents two experiments that test egocentric distance perception in augmented reality within and at the boundaries of action space (up to 35 m) in comparison with distance perception in a matched real-world ( RW ) environment. Using the Microsoft HoloLens, in Experiment 1, participants in two different RW settings judged egocentric distances (ranging from 10 to 35 m) to an AR avatar or a real person using a visual matching measure. Distances to augmented targets were underestimated compared to real targets in the two indoor, RW contexts. Experiment 2 aimed to generalize the results to an absolute distance measure using verbal reports in one of the indoor environments. Similar to Experiment 1, distances to augmented targets were underestimated compared to real targets. We discuss these findings with respect to the importance of methodologies that directly compare performance in real and mediated environments, as well as the inherent differences present in mediated environments that are “matched” to the real world.

scholarly journals Real Time Shadow Mapping for Augmented Reality Photorealistic Rendering

2019 ◽  
Vol 9 (11) ◽  
pp. 2225 ◽  
Author(s):  
Francesco Osti ◽  
Gian Maria Santi ◽  
Gianni Caligiana
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Real Life ◽  
Shadow Mapping ◽  
Photorealistic Rendering ◽  
Real Time Image ◽  
Image Capturing ◽  
Microsoft Hololens ◽  
The Right ◽  
Time Image

In this paper, we present a solution for the photorealistic ambient light render of holograms into dynamic real scenes, in augmented reality applications. Based on Microsoft HoloLens, we achieved this result with an Image Base Lighting (IBL) approach. The real-time image capturing that has been designed is able to automatically locate and position directional lights providing the right illumination to the holograms. We also implemented a negative “shadow drawing” shader that contributes to the final photorealistic and immersive effect of holograms in real life. The main focus of this research was to achieve a superior photorealism through the combination of real-time lights placement and negative “shadow drawing” shader. The solution was evaluated in various Augmented Reality case studies, from classical ones (using Vuforia Toolkit) to innovative applications (using HoloLens).

A Wearable Augmented Reality Navigation System for Surgical Telementoring Based on Microsoft HoloLens

2020 ◽  
Vol 49 (1) ◽  
pp. 287-298
Author(s):  
Peng Liu ◽  
Chenmeng Li ◽  
Changlin Xiao ◽  
Zeshu Zhang ◽  
Junqi Ma ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Navigation System ◽  
Microsoft Hololens ◽  
Wearable Augmented Reality

scholarly journals Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology

2018 ◽  
Vol 142 (5) ◽  
pp. 638-644 ◽  
Author(s):  
Matthew G. Hanna ◽  
Ishtiaque Ahmed ◽  
Jeffrey Nine ◽  
Shyam Prajapati ◽  
Liron Pantanowitz
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Mixed Reality ◽  
Digital Pathology ◽  
Remote Supervision ◽  
Augmented Reality Technology ◽  
Microsoft Hololens ◽  
Microscopic Pathology ◽  
Areas Of Interest ◽  
Whole Slide Images

Context Augmented reality (AR) devices such as the Microsoft HoloLens have not been well used in the medical field. Objective To test the HoloLens for clinical and nonclinical applications in pathology. Design A Microsoft HoloLens was tested for virtual annotation during autopsy, viewing 3D gross and microscopic pathology specimens, navigating whole slide images, telepathology, as well as real-time pathology-radiology correlation. Results Pathology residents performing an autopsy wearing the HoloLens were remotely instructed with real-time diagrams, annotations, and voice instruction. 3D-scanned gross pathology specimens could be viewed as holograms and easily manipulated. Telepathology was supported during gross examination and at the time of intraoperative consultation, allowing users to remotely access a pathologist for guidance and to virtually annotate areas of interest on specimens in real-time. The HoloLens permitted radiographs to be coregistered on gross specimens and thereby enhanced locating important pathologic findings. The HoloLens also allowed easy viewing and navigation of whole slide images, using an AR workstation, including multiple coregistered tissue sections facilitating volumetric pathology evaluation. Conclusions The HoloLens is a novel AR tool with multiple clinical and nonclinical applications in pathology. The device was comfortable to wear, easy to use, provided sufficient computing power, and supported high-resolution imaging. It was useful for autopsy, gross and microscopic examination, and ideally suited for digital pathology. Unique applications include remote supervision and annotation, 3D image viewing and manipulation, telepathology in a mixed-reality environment, and real-time pathology-radiology correlation.

scholarly journals Perceptions and Realities for Distal Freehand Interlocking of Intramedullary Nails

2015 ◽  
Vol 2015 ◽  
pp. 1-5
Author(s):  
Robert F. Ostrum
Keyword(s):  
Fracture Pattern ◽  
Orthopaedic Trauma ◽  
Intramedullary Nails ◽  
Orthopaedic Surgeons ◽  
Distal Interlocking

There is a perception that distal freehand interlocking (DFHI) of intramedullary nails can be difficult and time consuming. This study consists of a survey of surgeons’ practices for DFHI screws and their reasons for not using this technique. A survey was sent to 1400 orthopaedic surgeons who were asked to agree or disagree with statements regarding the difficulty and indications for the usage of distal freehand interlocking screws. The results were analyzed by practice demographics, resident availability, and completion of an orthopaedic trauma fellowship. Overall, 316 surgeons (22.6%) responded to the survey. Fellowship trained surgeons were 60% less likely to find DFHI difficult when compared to nonfellowship surgeons and surgeons with residents were 76% less likely to perceive DFHI as difficult than surgeons without residents. In all groups, 40–43% of surgeons used distal interlocking based on their comfort with the technique and not the fracture pattern. Distal freehand interlocking is perceived as difficult by community orthopaedic surgeons without residents and surgeons who have not done an orthopaedic trauma fellowship. Forty percent of surgeons based their usage of DFHI screws on their comfort with the technique and not the fracture pattern.

scholarly journals Development of a Magnetic Targeting Device Applied to Interlocking of Distal Intramedullary Nail Screw Holes

2003 ◽  
Author(s):  
David C. Szakelyhidi
Keyword(s):  
Radiation Exposure ◽  
Intramedullary Nail ◽  
Magnetic Targeting ◽  
The Novel ◽  
Intramedullary Nails ◽  
Current Technology ◽  
Novel Device ◽  
Distal Interlocking ◽  
Correct Location

A magnetic targeting device was developed to assist orthopedic surgeon’s with distal interlocking of intramedullary nails, in which the novel device aligns the surgeon’s drill at the correct location for drilling. This device has significant advantages over current technology, being percutaneous, portable, and using no fluoroscopy for targeting. This device can allow shorter surgery, decreased radiation exposure, and fewer complications for the surgeon and patient.

Sign in / Sign up

Export Citation Format

Share Document