scholarly journals Infrared marker tracking with the HoloLens for neurosurgical interventions

2020 ◽  
Vol 6 (1) ◽  
Author(s):  
Christian Kunz ◽  
Paulina Maurer ◽  
Fabian Kees ◽  
Pit Henrich ◽  
Christian Marzi ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Operating Room ◽  
Near Field ◽  
Medical Applications ◽  
Tracking Accuracy ◽  
Depth Sensor ◽  
Patient Tracking ◽  
Marker Tracking ◽  
Patient Registration ◽  
Augmented Reality System

AbstractPatient tracking is an essential part in a surgical augmented reality system for correct hologram to patient registration. Augmented reality can support a surgeon with visual assistance to navigate more precisely during neurosurgical interventions. In this work, a system for patient tracking based on infrared markers is proposed. These markers are widely used in medical applications and meet the special medical requirements such as sterilizability. A tracking accuracy of 0.76 mm is achieved when using the near field reflectivity and depth sensor of the HoloLens. On the HoloLens a performance of 55–60 fps is reached, which grants a sufficiently stable placement of the holograms in the operating room.

Stereo Augmented Reality in the Surgical Microscope

2000 ◽  
Vol 9 (4) ◽  
pp. 360-368 ◽  
Author(s):  
A. P. King ◽  
P. J. Edwards ◽  
C. R. Maurer ◽  
D. A. de Cunha ◽  
R. P. Gaston ◽  
...  
Keyword(s):  
Numerical Simulation ◽  
Augmented Reality ◽  
Operating Room ◽  
Focal Plane ◽  
Optical Path ◽  
Surgical Microscope ◽  
Augmented Reality System ◽  
Radiological Images ◽  
Quantitative Assessments ◽  
Better Than

This paper describes the MAGI (microscope-assisted guided interventions) augmented-reality system, which allows surgeons to view virtual features segmented from preoperative radiological images accurately overlaid in stereo in the optical path of a surgical microscope. The aim of the system is to enable the surgeon to see in the correct 3-D position the structures that are beneath the physical surface. The technical challenges involved are calibration, segmentation, registration, tracking, and visualization. This paper details our solutions to these problems. As it is difficult to make reliable quantitative assessments of the accuracy of augmented-reality systems, results are presented from a numerical simulation, and these show that the system has a theoretical overlay accuracy of better than 1 mm at the focal plane of the microscope. Implementations of the system have been tested on volunteers, phantoms, and seven patients in the operating room. Observations are consistent with this accuracy prediction.

scholarly journals A Navigation and Augmented Reality System for Visually Impaired People

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3061
Author(s):  
Alice Lo Valvo ◽  
Daniele Croce ◽  
Domenico Garlisi ◽  
Fabrizio Giuliano ◽  
Laura Giarré ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Visually Impaired ◽  
Virtual Path ◽  
Physical Support ◽  
Augmented Reality System ◽  
Virtual Paths ◽  
Visually Impaired People ◽  
Impaired People ◽  
Autonomous Mobility ◽  
Indoor And Outdoor

In recent years, we have assisted with an impressive advance in augmented reality systems and computer vision algorithms, based on image processing and artificial intelligence. Thanks to these technologies, mainstream smartphones are able to estimate their own motion in 3D space with high accuracy. In this paper, we exploit such technologies to support the autonomous mobility of people with visual disabilities, identifying pre-defined virtual paths and providing context information, reducing the distance between the digital and real worlds. In particular, we present ARIANNA+, an extension of ARIANNA, a system explicitly designed for visually impaired people for indoor and outdoor localization and navigation. While ARIANNA is based on the assumption that landmarks, such as QR codes, and physical paths (composed of colored tapes, painted lines, or tactile pavings) are deployed in the environment and recognized by the camera of a common smartphone, ARIANNA+ eliminates the need for any physical support thanks to the ARKit library, which we exploit to build a completely virtual path. Moreover, ARIANNA+ adds the possibility for the users to have enhanced interactions with the surrounding environment, through convolutional neural networks (CNNs) trained to recognize objects or buildings and enabling the possibility of accessing contents associated with them. By using a common smartphone as a mediation instrument with the environment, ARIANNA+ leverages augmented reality and machine learning for enhancing physical accessibility. The proposed system allows visually impaired people to easily navigate in indoor and outdoor scenarios simply by loading a previously recorded virtual path and providing automatic guidance along the route, through haptic, speech, and sound feedback.

An Augmented Reality System for Epidural Anesthesia (AREA): Prepuncture Identification of Vertebrae

2013 ◽  
Vol 60 (9) ◽  
pp. 2636-2644 ◽  
Author(s):  
Hussam Al-Deen Ashab ◽  
Victoria A. Lessoway ◽  
Siavash Khallaghi ◽  
Alexis Cheng ◽  
Robert Rohling ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Epidural Anesthesia ◽  
Augmented Reality System

Landmark-based augmented reality system for paranasal and transnasal endoscopic surgeries

2009 ◽  
Vol 5 (4) ◽  
pp. 415-422 ◽  
Author(s):  
Ramesh Thoranaghatte ◽  
Jaime Garcia ◽  
Marco Caversaccio ◽  
Daniel Widmer ◽  
Miguel A. Gonzalez Ballester ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Augmented Reality System
Sign in / Sign up

Export Citation Format

Share Document