scholarly journals Closing the Calibration Loop: An Inside-Out-Tracking Paradigm for Augmented Reality in Orthopedic Surgery

2018 ◽  
pp. 299-306 ◽  
Author(s):  
Jonas Hajek ◽  
Mathias Unberath ◽  
Javad Fotouhi ◽  
Bastian Bier ◽  
Sing Chun Lee ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Orthopedic Surgery ◽  
Inside Out

scholarly journals Augmented Reality in Orthopedic Surgery Is Emerging from Proof of Concept Towards Clinical Studies: a Literature Review Explaining the Technology and Current State of the Art

2021 ◽  
Author(s):  
Fabio A. Casari ◽  
Nassir Navab ◽  
Laura A. Hruby ◽  
Philipp Kriechling ◽  
Ricardo Nakamura ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Orthopedic Surgery ◽  
Relevant Literature ◽  
Comprehensive Overview ◽  
Basic Principles ◽  
Clinical Procedures ◽  
Current State ◽  
Tremendous Progress ◽  
Orthopedic Oncology ◽  
Technological Developments

Abstract Purpose of Review Augmented reality (AR) is becoming increasingly popular in modern-day medicine. Computer-driven tools are progressively integrated into clinical and surgical procedures. The purpose of this review was to provide a comprehensive overview of the current technology and its challenges based on recent literature mainly focusing on clinical, cadaver, and innovative sawbone studies in the field of orthopedic surgery. The most relevant literature was selected according to clinical and innovational relevance and is summarized. Recent Findings Augmented reality applications in orthopedic surgery are increasingly reported. In this review, we summarize basic principles of AR including data preparation, visualization, and registration/tracking and present recently published clinical applications in the area of spine, osteotomies, arthroplasty, trauma, and orthopedic oncology. Higher accuracy in surgical execution, reduction of radiation exposure, and decreased surgery time are major findings presented in the literature. Summary In light of the tremendous progress of technological developments in modern-day medicine and emerging numbers of research groups working on the implementation of AR in routine clinical procedures, we expect the AR technology soon to be implemented as standard devices in orthopedic surgery.

scholarly journals COMBINING INDEPENDENT VISUALIZATION AND TRACKING SYSTEMS FOR AUGMENTED REALITY

2018 ◽  
Vol XLII-2 ◽  
pp. 455-462
Author(s):  
P. Hübner ◽  
M. Weinmann ◽  
M. Hillemann ◽  
B. Jutzi ◽  
S. Wursthorn
Keyword(s):  
Augmented Reality ◽  
Tracking System ◽  
Tracking Systems ◽  
Tracking Accuracy ◽  
Visualization System ◽  
System A ◽  
Augmented Reality Application ◽  
Relative Pose ◽  
Inside Out ◽  
Visualization Device

The basic requirement for the successful deployment of a mobile augmented reality application is a reliable tracking system with high accuracy. Recently, a helmet-based inside-out tracking system which meets this demand has been proposed for self-localization in buildings. To realize an augmented reality application based on this tracking system, a display has to be added for visualization purposes. Therefore, the relative pose of this visualization platform with respect to the helmet has to be tracked. In the case of hand-held visualization platforms like smartphones or tablets, this can be achieved by means of image-based tracking methods like marker-based or model-based tracking. In this paper, we present two marker-based methods for tracking the relative pose between the helmet-based tracking system and a tablet-based visualization system. Both methods were implemented and comparatively evaluated in terms of tracking accuracy. Our results show that mobile inside-out tracking systems without integrated displays can easily be supplemented with a hand-held tablet as visualization device for augmented reality purposes.

AUGMENTED REALITY AND INSIDE-OUT NAVIGATION:NEW TOOLS TO IMPROVE SURGICAL ACCURACY DURING LAPROSCOPIC PARTIAL NEPHRECTOMY. PRELIMINARY IN VITRO AND IN VIVO RESULTS

2009 ◽  
Vol 181 (4S) ◽  
pp. 275-275
Author(s):  
Dogu Teber ◽  
Esref Oguz Guven ◽  
Matthias Baumhauer ◽  
Tobias Simpfendörfer ◽  
Jens Rassweiler
Keyword(s):  
Augmented Reality ◽  
Partial Nephrectomy ◽  
Inside Out

A hand-eye calibration method for augmented reality applied to computer-assisted orthopedic surgery

2018 ◽  
Vol 15 (2) ◽  
pp. e1969 ◽  
Author(s):  
Marcelo E. de Oliveira ◽  
Henrique G. Debarba ◽  
Alexandre Lädermann ◽  
Sylvain Chagué ◽  
Caecilia Charbonnier
Keyword(s):  
Augmented Reality ◽  
Orthopedic Surgery ◽  
Calibration Method ◽  
Computer Assisted ◽  
Computer Assisted Orthopedic Surgery

A hand-eye calibration method for augmented reality applied to computer-assisted orthopedic surgery

2018 ◽  
Vol 104 (8) ◽  
pp. S110
Author(s):  
Marcelo de Oliveira ◽  
Alexandre Lädermann ◽  
Henrique Debarba ◽  
Sylvain Chagué ◽  
Philippe Collin ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Orthopedic Surgery ◽  
Calibration Method ◽  
Computer Assisted ◽  
Computer Assisted Orthopedic Surgery

scholarly journals Development of an inside-out augmented reality technique for neurosurgical navigation

2021 ◽  
Vol 51 (2) ◽  
pp. E21
Author(s):  
Yun-Sik Dho ◽  
Sang Joon Park ◽  
Haneul Choi ◽  
Youngdeok Kim ◽  
Hyeong Cheol Moon ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Navigation System ◽  
Fine Tuning ◽  
Image Feature ◽  
Patient Specific ◽  
Registration Accuracy ◽  
Pilot Model ◽  
Patient Model ◽  
3D Printed ◽  
Inside Out

OBJECTIVE With the advancement of 3D modeling techniques and visualization devices, augmented reality (AR)–based navigation (AR navigation) is being developed actively. The authors developed a pilot model of their newly developed inside-out tracking AR navigation system. METHODS The inside-out AR navigation technique was developed based on the visual inertial odometry (VIO) algorithm. The Quick Response (QR) marker was created and used for the image feature–detection algorithm. Inside-out AR navigation works through the steps of visualization device recognition, marker recognition, AR implementation, and registration within the running environment. A virtual 3D patient model for AR rendering and a 3D-printed patient model for validating registration accuracy were created. Inside-out tracking was used for the registration. The registration accuracy was validated by using intuitive, visualization, and quantitative methods for identifying coordinates by matching errors. Fine-tuning and opacity-adjustment functions were developed. RESULTS ARKit-based inside-out AR navigation was developed. The fiducial marker of the AR model and those of the 3D-printed patient model were correctly overlapped at all locations without errors. The tumor and anatomical structures of AR navigation and the tumors and structures placed in the intracranial space of the 3D-printed patient model precisely overlapped. The registration accuracy was quantified using coordinates, and the average moving errors of the x-axis and y-axis were 0.52 ± 0.35 and 0.05 ± 0.16 mm, respectively. The gradients from the x-axis and y-axis were 0.35° and 1.02°, respectively. Application of the fine-tuning and opacity-adjustment functions was proven by the videos. CONCLUSIONS The authors developed a novel inside-out tracking–based AR navigation system and validated its registration accuracy. This technical system could be applied in the novel navigation system for patient-specific neurosurgery.

scholarly journals Applicability of augmented reality in orthopedic surgery – A systematic review

2020 ◽  
Vol 21 (1) ◽  
Author(s):  
Lukas Jud ◽  
Javad Fotouhi ◽  
Octavian Andronic ◽  
Alexander Aichmair ◽  
Greg Osgood ◽  
...  
Keyword(s):  
Systematic Review ◽  
Augmented Reality ◽  
Orthopedic Surgery

scholarly journals Augmented reality in the operating room: a clinical feasibility study

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Cyrill Dennler ◽  
David E. Bauer ◽  
Anne-Gita Scheibler ◽  
José Spirig ◽  
Tobias Götschi ◽  
...  
Keyword(s):  
Image Quality ◽  
Augmented Reality ◽  
Orthopedic Surgery ◽  
Low Cost ◽  
Three Dimensional ◽  
Patient Specific ◽  
Navigation Systems ◽  
Novel Technology ◽  
Orthopedic Surgeons ◽  
Orthopedic Surgical Procedures

Abstract Background Augmented Reality (AR) is a rapidly emerging technology finding growing acceptance and application in different fields of surgery. Various studies have been performed evaluating the precision and accuracy of AR guided navigation. This study investigates the feasibility of a commercially available AR head mounted device during orthopedic surgery. Methods Thirteen orthopedic surgeons from a Swiss university clinic performed 25 orthopedic surgical procedures wearing a holographic AR headset (HoloLens, Microsoft, Redmond, WA, USA) providing complementary three-dimensional, patient specific anatomic information. The surgeon’s experience of using the device during surgery was recorded using a standardized 58-item questionnaire grading different aspects on a 100-point scale with anchor statements. Results Surgeons were generally satisfied with image quality (85 ± 17 points) and accuracy of the virtual objects (84 ± 19 point). Wearing the AR device was rated as fairly comfortable (79 ± 13 points). Functionality of voice commands (68 ± 20 points) and gestures (66 ± 20 points) provided less favorable results. The greatest potential in the use of the AR device was found for surgical correction of deformities (87 ± 15 points). Overall, surgeons were satisfied with the application of this novel technology (78 ± 20 points) and future access to it was demanded (75 ± 22 points). Conclusion AR is a rapidly evolving technology with large potential in different surgical settings, offering the opportunity to provide a compact, low cost alternative requiring a minimum of infrastructure compared to conventional navigation systems. While surgeons where generally satisfied with image quality of the here tested head mounted AR device, some technical and ergonomic shortcomings were pointed out. This study serves as a proof of concept for the use of an AR head mounted device in a real-world sterile setting in orthopedic surgery.

Sign in / Sign up

Export Citation Format

Share Document