scholarly journals MIXED REALITY IN MEDICAL SIMULATION: A COMPREHENSIVE DESIGN METHODOLOGY

2021 ◽  
Vol 1 ◽  
pp. 2107-2116
Author(s):  
Agnese Brunzini ◽  
Alessandra Papetti ◽  
Michele Germani ◽  
Erica Adrario
Keyword(s):  
Mixed Reality ◽  
Clinical Simulation ◽  
Simulation Performance ◽  
Prototype Development ◽  
Comprehensive Method ◽  
Scenario Design ◽  
Study Results ◽  
Microsoft Hololens ◽  
Real Practice ◽  
Complete Framework

AbstractIn the medical education field, the use of highly sophisticated simulators and extended reality (XR) simulations allow training complex procedures and acquiring new knowledge and attitudes. XR is considered useful for the enhancement of healthcare education; however, several issues need further research.The main aim of this study is to define a comprehensive method to design and optimize every kind of simulator and simulation, integrating all the relevant elements concerning the scenario design and prototype development.A complete framework for the design of any kind of advanced clinical simulation is proposed and it has been applied to realize a mixed reality (MR) prototype for the simulation of the rachicentesis. The purpose of the MR application is to immerse the trainee in a more realistic environment and to put him/her under pressure during the simulation, as in real practice.The application was tested with two different devices: the headset Vox Gear Plus for smartphone and the Microsoft Hololens. Eighteen students of the 6th year of Medicine and Surgery Course were enrolled in the study. Results show the comparison of user experience related to the two different devices and simulation performance using the Hololens.

scholarly journals Space-Time Cube and Mixed Reality – New Approaches to Support Understanding Historical Landscape Changes

2019 ◽  
Vol 2 ◽  
pp. 1-7
Author(s):  
Mathias Jahnke ◽  
Edyta P. Bogucka ◽  
Maria Turchenko
Keyword(s):  
Cultural Landscape ◽  
Mixed Reality ◽  
New Technology ◽  
Space Time ◽  
Field Of View ◽  
Landscape Changes ◽  
Huge Amount ◽  
Visual Variables ◽  
Spatio Temporal ◽  
Microsoft Hololens

<p><strong>Abstract.</strong> Mixed reality is a rather new technology but came to its nowadays success through the availability of devices like Microsoft HoloLens which easily support the users and developers to use such devices. Therefore, visualization specialists like cartographers paid attention due to interaction possibilities such devices provide. In particular, to utilize the huge amount of opportunities such device gave. The applicability within the cartographic domain needs to be further investigated.</p><p>The main goal of this contribution is to evaluate the applicability of a mixed reality device in the domain of spatio-temporal representations on the example of the space-time cube to show cultural landscape changes. The hologram of the space-time cube provides the changes of the Royal Castle in Warsaw and their surrounding elements. The hologram therefore incorporated the different buildings of the castle, space-time prisms and space-time links to connect building elements over the years. The visual variables colour hue, colour value and transparency are mainly used to feature distinguishable space-time prisms and to show the space-time links. Different colour schemes are developed which features the characteristics of a mixed reality device. The possibilities of input actions are ranging from gaze/head movement, to gesture and voice.</p><p>The usability evaluation of the mixed reality hologram showed the overall comfort of interactions, perception of the visual components of the space-time cube and determines advantageous features and limitations of the technology. Most of the found limitations are connected to current devices, like e.g. resolution or field of view. An important aspect which came out is, that the experience the user has which such devices/technology plays an important role in successfully use and knowledge discovery from such applications.</p>

scholarly journals Beyond the lab: Virtual reality for undergraduate Anatomy and Physiology students

2021 ◽  
Vol 82 (4) ◽  
pp. 186
Author(s):  
Kathleen Phillips ◽  
Valerie A. Lynn ◽  
Amie Yenser ◽  
Christina Wissinger
Keyword(s):  
Virtual Reality ◽  
Teaching Practice ◽  
Mixed Reality ◽  
Cleveland Clinic ◽  
Physical Models ◽  
Human Anatomy ◽  
Anatomy And Physiology ◽  
Instructional Methodologies ◽  
Technological Advances ◽  
Microsoft Hololens

Current teaching practice in undergraduate higher education anatomy and physiology courses incorporates the use of various instructional methodologies to reinforce the anatomical relationships between structures.1,2 These methods can include basic hands-on physical models, human and animal dissection labs, and interactive technology. Technological advances continue to drive the production of innovative anatomy and physiology electronic tools, including:virtual dissection in 3-D (e.g., Virtual Dissection Boards from Anatomage, 3D4Medical, and Anatomy.TV),augmented reality (AR) (e.g., Human Anatomy Atlas),mixed reality (e.g., Microsoft HoloLens Case Western Reserve Medical School and Cleveland Clinic digital anatomy app), and3-D virtual reality (VR) (e.g., 3D Organon VR Anatomy and YOU by Sharecare apps).

scholarly journals Mixed Reality Anatomy Using Microsoft HoloLens and Cadaveric Dissection: A Comparative Effectiveness Study

2019 ◽  
Vol 30 (1) ◽  
pp. 173-178 ◽  
Author(s):  
M. Stojanovska ◽  
G. Tingle ◽  
L. Tan ◽  
L. Ulrey ◽  
S. Simonson-Shick ◽  
...  
Keyword(s):  
Comparative Effectiveness ◽  
Mixed Reality ◽  
Effectiveness Study ◽  
Cadaveric Dissection ◽  
Comparative Effectiveness Study ◽  
Microsoft Hololens

scholarly journals Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology

2018 ◽  
Vol 142 (5) ◽  
pp. 638-644 ◽  
Author(s):  
Matthew G. Hanna ◽  
Ishtiaque Ahmed ◽  
Jeffrey Nine ◽  
Shyam Prajapati ◽  
Liron Pantanowitz
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Mixed Reality ◽  
Digital Pathology ◽  
Remote Supervision ◽  
Augmented Reality Technology ◽  
Microsoft Hololens ◽  
Microscopic Pathology ◽  
Areas Of Interest ◽  
Whole Slide Images

Context Augmented reality (AR) devices such as the Microsoft HoloLens have not been well used in the medical field. Objective To test the HoloLens for clinical and nonclinical applications in pathology. Design A Microsoft HoloLens was tested for virtual annotation during autopsy, viewing 3D gross and microscopic pathology specimens, navigating whole slide images, telepathology, as well as real-time pathology-radiology correlation. Results Pathology residents performing an autopsy wearing the HoloLens were remotely instructed with real-time diagrams, annotations, and voice instruction. 3D-scanned gross pathology specimens could be viewed as holograms and easily manipulated. Telepathology was supported during gross examination and at the time of intraoperative consultation, allowing users to remotely access a pathologist for guidance and to virtually annotate areas of interest on specimens in real-time. The HoloLens permitted radiographs to be coregistered on gross specimens and thereby enhanced locating important pathologic findings. The HoloLens also allowed easy viewing and navigation of whole slide images, using an AR workstation, including multiple coregistered tissue sections facilitating volumetric pathology evaluation. Conclusions The HoloLens is a novel AR tool with multiple clinical and nonclinical applications in pathology. The device was comfortable to wear, easy to use, provided sufficient computing power, and supported high-resolution imaging. It was useful for autopsy, gross and microscopic examination, and ideally suited for digital pathology. Unique applications include remote supervision and annotation, 3D image viewing and manipulation, telepathology in a mixed-reality environment, and real-time pathology-radiology correlation.

Network Anomaly Analysis using the Microsoft HoloLens

2018 ◽  
Vol 62 (1) ◽  
pp. 2094-2098
Author(s):  
Steve Beitzel ◽  
Josiah Dykstra ◽  
Paul Toliver ◽  
Jason Youzwak
Keyword(s):  
User Study ◽  
Mixed Reality ◽  
Eye Gaze ◽  
Lessons Learned ◽  
Time Dimension ◽  
Desktop Computer ◽  
Novel Approach ◽  
Anomaly Analysis ◽  
Microsoft Hololens ◽  
Future Work

We investigate the feasibility of using Microsoft HoloLens, a mixed reality device, to visually analyze network capture data and locate anomalies. We developed MINER, a prototype application to visualize details from network packet captures as 3D stereogram charts. MINER employs a novel approach to time-series visualization that extends the time dimension across two axes, thereby taking advantage of the immersive 3D space available via the HoloLens. Users navigate the application through eye gaze and hand gestures to view summary and detailed bar graphs. Callouts display additional detail based on the user’s immediate gaze. In a user study, volunteers used MINER to locate network attacks in a dataset from the 2013 VAST Challenge. We compared the time and effort with a similar test using traditional tools on a desktop computer. Our findings suggest that network anomaly analysis with the HoloLens achieved comparable effectiveness, efficiency and satisfaction. We describe user metrics and feedback collected from these experiments; lessons learned and suggested future work.

Sign in / Sign up

Export Citation Format

Share Document