Three-dimensional augmented reality surgical navigation with hybrid optical and electromagnetic tracking for distal intramedullary nail interlocking

2018 ◽  
Vol 14 (4) ◽  
pp. e1909 ◽  
Author(s):  
Longfei Ma ◽  
Zhe Zhao ◽  
Boyu Zhang ◽  
Weipeng Jiang ◽  
Ligong Fu ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Intramedullary Nail ◽  
Surgical Navigation ◽  
Three Dimensional ◽  
Electromagnetic Tracking

scholarly journals Augmented Reality as a Tool to Guide PSI Placement in Pelvic Tumor Resections

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 7824
Author(s):  
Mónica García-Sevilla ◽  
Rafael Moreta-Martinez ◽  
David García-Mato ◽  
Alicia Pose-Diez-de-la-Lastra ◽  
Rubén Pérez-Mañanes ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Surgical Navigation ◽  
Tumor Resection ◽  
Three Dimensional ◽  
Target Surface ◽  
Patient Specific ◽  
Resection Margins ◽  
Navigation Systems ◽  
Pelvic Tumor ◽  
Similar Accuracy

Patient-specific instruments (PSIs) have become a valuable tool for osteotomy guidance in complex surgical scenarios such as pelvic tumor resection. They provide similar accuracy to surgical navigation systems but are generally more convenient and faster. However, their correct placement can become challenging in some anatomical regions, and it cannot be verified objectively during the intervention. Incorrect installations can result in high deviations from the planned osteotomy, increasing the risk of positive resection margins. In this work, we propose to use augmented reality (AR) to guide and verify PSIs placement. We designed an experiment to assess the accuracy provided by the system using a smartphone and the HoloLens 2 and compared the results with the conventional freehand method. The results showed significant differences, where AR guidance prevented high osteotomy deviations, reducing maximal deviation of 54.03 mm for freehand placements to less than 5 mm with AR guidance. The experiment was performed in two versions of a plastic three-dimensional (3D) printed phantom, one including a silicone layer to simulate tissue, providing more realism. We also studied how differences in shape and location of PSIs affect their accuracy, concluding that those with smaller sizes and a homogeneous target surface are more prone to errors. Our study presents promising results that prove AR’s potential to overcome the present limitations of PSIs conveniently and effectively.

scholarly journals HoloLens-Based Vascular Localization System: Precision Evaluation Study With a Three-Dimensional Printed Model (Preprint)

2019 ◽  
Author(s):  
Taoran Jiang ◽  
Dewang Yu ◽  
Yuqi Wang ◽  
Tao Zan ◽  
Shuyi Wang ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Performance Indicator ◽  
Surgical Navigation ◽  
Three Dimensional ◽  
Perforator Flap ◽  
Safe Procedure ◽  
Localization System ◽  
Head Mounted Display ◽  
Precision Evaluation ◽  
3D Printed

BACKGROUND Vascular localization is crucial for perforator flap transfer. Augmented reality offers a novel method to seamlessly combine real information with virtual objects created by computed tomographic angiography to help the surgeon “see through” the skin and precisely localize the perforator. The head-mounted display augmented reality system HoloLens (Microsoft) could facilitate augmented reality–based perforator localization for a more convenient and safe procedure. OBJECTIVE The aim of this study was to evaluate the precision of the HoloLens-based vascular localization system, as the most important performance indicator of a new localization system. METHODS The precision of the HoloLens-based vascular localization system was tested in a simulated operating room under different conditions with a three-dimensional (3D) printed model. The coordinates of five pairs of points on the vascular map that could be easily identified on the 3D printed model and virtual model were detected by a probe, and the distance between the corresponding points was calculated as the navigation error. RESULTS The mean errors were determined under different conditions, with a minimum error of 1.35 mm (SD 0.43) and maximum error of 3.18 mm (SD 1.32), which were within the clinically acceptable range. There were no significant differences in the errors obtained under different visual angles, different light intensities, or different states (static or motion). However, the error was larger when tested with light compared with that tested without light. CONCLUSIONS This precision evaluation demonstrated that the HoloLens system can precisely localize the perforator and potentially help the surgeon accomplish the operation. The authors recommend using HoloLens-based surgical navigation without light.

Smart Glasses for Neurosurgical Navigation by Augmented Reality

2018 ◽  
Vol 15 (5) ◽  
pp. 551-556 ◽  
Author(s):  
Keisuke Maruyama ◽  
Eiju Watanabe ◽  
Taichi Kin ◽  
Kuniaki Saito ◽  
Atsushi Kumakiri ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Computer Graphics ◽  
Brain Tumors ◽  
Surgical Navigation ◽  
Three Dimensional ◽  
Magnetic Resonance Images ◽  
Brain Surface ◽  
Smart Glasses ◽  
Image Overlay ◽  
Optical Markers

Abstract BACKGROUND Wearable devices with heads-up displays or smart glasses can overlay images onto the sight of the wearer. This technology has never been applied to surgical navigation. OBJECTIVE To assess the applicability and accuracy of smart glasses for augmented reality (AR)-based neurosurgical navigation. METHODS Smart glasses were applied to AR-based neurosurgical navigation. Three-dimensional computer graphics were created based on preoperative magnetic resonance images and visualized in see-through smart glasses. Optical markers were attached to the smart glasses and the patient's head for accurate navigation. Two motion capture cameras were used for registration and continuous monitoring of the location of the smart glasses in relation to the patient's head. After the accuracy was assessed with a phantom, this technique was applied in 2 patients with brain tumors located in the brain surface. RESULTS A stereoscopic view by image overlay through the smart glasses was successful in the phantom and in both patients. Hands-free neuronavigation inside the operative field was available from any angles and distances. The targeting error in the phantom measured in 75 points ranged from 0.2 to 8.1 mm (mean 3.1 ± 1.9 mm, median 2.7 mm). The intraoperative targeting error between the visualized and real locations in the 2 patients (measured in 40 points) ranged from 0.6 to 4.9 mm (mean 2.1 ± 1.1 mm, median 1.8 mm). CONCLUSION Smart glasses enabled AR-based neurosurgical navigation in a hands-free fashion. Stereoscopic computer graphics of targeted brain tumors corresponding to the surgical field were clearly visualized during surgery.

scholarly journals HoloLens-Based Vascular Localization System: Precision Evaluation Study With a Three-Dimensional Printed Model

10.2196/16852 ◽  
2020 ◽  
Vol 22 (4) ◽  
pp. e16852
Author(s):  
Taoran Jiang ◽  
Dewang Yu ◽  
Yuqi Wang ◽  
Tao Zan ◽  
Shuyi Wang ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Performance Indicator ◽  
Surgical Navigation ◽  
Three Dimensional ◽  
Perforator Flap ◽  
Safe Procedure ◽  
Localization System ◽  
Head Mounted Display ◽  
Precision Evaluation ◽  
3D Printed

Background Vascular localization is crucial for perforator flap transfer. Augmented reality offers a novel method to seamlessly combine real information with virtual objects created by computed tomographic angiography to help the surgeon “see through” the skin and precisely localize the perforator. The head-mounted display augmented reality system HoloLens (Microsoft) could facilitate augmented reality–based perforator localization for a more convenient and safe procedure. Objective The aim of this study was to evaluate the precision of the HoloLens-based vascular localization system, as the most important performance indicator of a new localization system. Methods The precision of the HoloLens-based vascular localization system was tested in a simulated operating room under different conditions with a three-dimensional (3D) printed model. The coordinates of five pairs of points on the vascular map that could be easily identified on the 3D printed model and virtual model were detected by a probe, and the distance between the corresponding points was calculated as the navigation error. Results The mean errors were determined under different conditions, with a minimum error of 1.35 mm (SD 0.43) and maximum error of 3.18 mm (SD 1.32), which were within the clinically acceptable range. There were no significant differences in the errors obtained under different visual angles, different light intensities, or different states (static or motion). However, the error was larger when tested with light compared with that tested without light. Conclusions This precision evaluation demonstrated that the HoloLens system can precisely localize the perforator and potentially help the surgeon accomplish the operation. The authors recommend using HoloLens-based surgical navigation without light.

scholarly journals Combining Augmented Reality and 3D Printing to Improve Surgical Workflows in Orthopedic Oncology: Smartphone Application and Clinical Evaluation

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1370
Author(s):  
Rafael Moreta-Martinez ◽  
Alicia Pose-Díez-de-la-Lastra ◽  
José Antonio Calvo-Haro ◽  
Lydia Mediavilla-Santos ◽  
Rubén Pérez-Mañanes ◽  
...  
Keyword(s):  
Augmented Reality ◽  
3D Printing ◽  
Surgical Navigation ◽  
Three Dimensional ◽  
Smartphone Application ◽  
Navigation Systems ◽  
Surgical Workflow ◽  
Orthopedic Oncology ◽  
Innovative Solution ◽  
3D Printed

During the last decade, orthopedic oncology has experienced the benefits of computerized medical imaging to reduce human dependency, improving accuracy and clinical outcomes. However, traditional surgical navigation systems do not always adapt properly to this kind of interventions. Augmented reality (AR) and three-dimensional (3D) printing are technologies lately introduced in the surgical environment with promising results. Here we present an innovative solution combining 3D printing and AR in orthopedic oncological surgery. A new surgical workflow is proposed, including 3D printed models and a novel AR-based smartphone application (app). This app can display the patient’s anatomy and the tumor’s location. A 3D-printed reference marker, designed to fit in a unique position of the affected bone tissue, enables automatic registration. The system has been evaluated in terms of visualization accuracy and usability during the whole surgical workflow. Experiments on six realistic phantoms provided a visualization error below 3 mm. The AR system was tested in two clinical cases during surgical planning, patient communication, and surgical intervention. These results and the positive feedback obtained from surgeons and patients suggest that the combination of AR and 3D printing can improve efficacy, accuracy, and patients’ experience.

scholarly journals Real-time in situ three-dimensional integral videography and surgical navigation using augmented reality: a pilot study

2013 ◽  
Vol 5 (2) ◽  
pp. 98-102 ◽  
Author(s):  
Hideyuki Suenaga ◽  
Huy Hoang Tran ◽  
Hongen Liao ◽  
Ken Masamune ◽  
Takeyoshi Dohi ◽  
...  
Keyword(s):  
Pilot Study ◽  
Augmented Reality ◽  
Real Time ◽  
Surgical Navigation ◽  
Three Dimensional ◽  
Dimensional Integral

Virtual and augmented reality in anatomy education: Need for comparison with other three-dimensional visualization methods

Morphologie ◽  
2021 ◽  
Author(s):  
G.P. Skandalakis ◽  
D. Chytas ◽  
G. Paraskevas ◽  
G. Noussios ◽  
M. Salmas ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Three Dimensional ◽  
Anatomy Education ◽  
Virtual And Augmented Reality

scholarly journals A Novel Suture Training System for Open Surgery Replicating Procedures Performed by Experts Using Augmented Reality

2021 ◽  
Vol 45 (5) ◽  
Author(s):  
Yuri Nagayo ◽  
Toki Saito ◽  
Hiroshi Oyama
Keyword(s):  
Augmented Reality ◽  
Motion Capture ◽  
Open Surgery ◽  
Three Dimensional ◽  
Training System ◽  
Surgical Skills ◽  
Surgical Instruments ◽  
Interrupted Suture ◽  
Education Environment ◽  
Surgical Field

AbstractThe surgical education environment has been changing significantly due to restricted work hours, limited resources, and increasing public concern for safety and quality, leading to the evolution of simulation-based training in surgery. Of the various simulators, low-fidelity simulators are widely used to practice surgical skills such as sutures because they are portable, inexpensive, and easy to use without requiring complicated settings. However, since low-fidelity simulators do not offer any teaching information, trainees do self-practice with them, referring to textbooks or videos, which are insufficient to learn open surgical procedures. This study aimed to develop a new suture training system for open surgery that provides trainees with the three-dimensional information of exemplary procedures performed by experts and allows them to observe and imitate the procedures during self-practice. The proposed system consists of a motion capture system of surgical instruments and a three-dimensional replication system of captured procedures on the surgical field. Motion capture of surgical instruments was achieved inexpensively by using cylindrical augmented reality (AR) markers, and replication of captured procedures was realized by visualizing them three-dimensionally at the same position and orientation as captured, using an AR device. For subcuticular interrupted suture, it was confirmed that the proposed system enabled users to observe experts’ procedures from any angle and imitate them by manipulating the actual surgical instruments during self-practice. We expect that this training system will contribute to developing a novel surgical training method that enables trainees to learn surgical skills by themselves in the absence of experts.

Three-dimensional augmented reality transperitoneal robot assisted partial nephrectomy (3d ar-rapn): A new tool to identify the hidden tumours

2019 ◽  
Vol 18 (6) ◽  
pp. e2690 ◽  
Author(s):  
F. Porpiglia ◽  
E. Checcucci ◽  
D. Amparore ◽  
F. Piramide ◽  
P. Verri ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Partial Nephrectomy ◽  
Three Dimensional ◽  
Robot Assisted
Sign in / Sign up

Export Citation Format

Share Document