scholarly journals Navigation of Frameless Fixation for Gammaknife Radiosurgery Using Fixed Augmented Reality

2021 ◽  
Author(s):  
Hyeong Cheol Moon ◽  
Sang Joon Park ◽  
Youngdeok Kim ◽  
Kyung Min Kim ◽  
Ho Kang ◽  
...  
Keyword(s):  
Augmented Reality ◽  
3D Scanning ◽  
Fiducial Marker ◽  
High Definition ◽  
Registration Accuracy ◽  
Motion Management ◽  
Virtual Models ◽  
Patient Model ◽  
3D Printed ◽  
Set Up

Abstract Augmented reality (AR) offers a new medical treatment approach. We aimed to evaluate frameless fixation navigation using a 3D-printed patient model with fixed-AR technology for gammaknife radiosurgery. Fixed-AR navigation was developed using the inside-out method with visual inertial odometry algorithms, and the flexible Quick Response (QR) marker was created for object-feature recognition. Virtual 3D-patient models for AR-rendering were created via 3D-scanning utilizing TrueDepth and cone-beam computed tomography (CBCT) to generate a new GammaKnife IconTM model. A 3D-printed patient model included fiducial markers, and virtual 3D-patient models were used to validate registration accuracy. Registration accuracy between initial frameless fixation and re-fixation navigated fixed-AR was validated through visualization. The quantitative method was validated through set-up errors, fiducial marker coordinates, and high-definition motion management (HDMM) values. 3D-printed models and virtual models were correctly overlapped under frameless fixation. Virtual models from both 3D-scanning and CBCT were enough to tolerate the navigated frameless re-fixation. Although the CBCT virtual model consistently delivered more accurate results, 3D-scanning was sufficient. Frameless re-fixation accuracy navigated in virtual models had mean set-up errors within 1 mm and 1.5° in all axes. Mean fiducial marker differences from coordinates in virtual models were within 2.5 mm in all axes, and mean 3D errors were within 3 mm. Mean HDMM difference values in virtual models were within 1.5 mm of initial HDMM values. The variability from navigation fixed-AR is enough to consider repositioning frameless fixation without CBCT scanning for treating patients fractionated with large multiple metastases lesions (>3 cm) who have difficulty enduring long beam-on time. This system could be applied to novel radiosurgery navigation for frameless fixation with reduced preparation time.

scholarly journals Development of an inside-out augmented reality technique for neurosurgical navigation

2021 ◽  
Vol 51 (2) ◽  
pp. E21
Author(s):  
Yun-Sik Dho ◽  
Sang Joon Park ◽  
Haneul Choi ◽  
Youngdeok Kim ◽  
Hyeong Cheol Moon ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Navigation System ◽  
Fine Tuning ◽  
Image Feature ◽  
Patient Specific ◽  
Registration Accuracy ◽  
Pilot Model ◽  
Patient Model ◽  
3D Printed ◽  
Inside Out

OBJECTIVE With the advancement of 3D modeling techniques and visualization devices, augmented reality (AR)–based navigation (AR navigation) is being developed actively. The authors developed a pilot model of their newly developed inside-out tracking AR navigation system. METHODS The inside-out AR navigation technique was developed based on the visual inertial odometry (VIO) algorithm. The Quick Response (QR) marker was created and used for the image feature–detection algorithm. Inside-out AR navigation works through the steps of visualization device recognition, marker recognition, AR implementation, and registration within the running environment. A virtual 3D patient model for AR rendering and a 3D-printed patient model for validating registration accuracy were created. Inside-out tracking was used for the registration. The registration accuracy was validated by using intuitive, visualization, and quantitative methods for identifying coordinates by matching errors. Fine-tuning and opacity-adjustment functions were developed. RESULTS ARKit-based inside-out AR navigation was developed. The fiducial marker of the AR model and those of the 3D-printed patient model were correctly overlapped at all locations without errors. The tumor and anatomical structures of AR navigation and the tumors and structures placed in the intracranial space of the 3D-printed patient model precisely overlapped. The registration accuracy was quantified using coordinates, and the average moving errors of the x-axis and y-axis were 0.52 ± 0.35 and 0.05 ± 0.16 mm, respectively. The gradients from the x-axis and y-axis were 0.35° and 1.02°, respectively. Application of the fine-tuning and opacity-adjustment functions was proven by the videos. CONCLUSIONS The authors developed a novel inside-out tracking–based AR navigation system and validated its registration accuracy. This technical system could be applied in the novel navigation system for patient-specific neurosurgery.

scholarly journals Augmented Reality to Assist Skin Paddle Harvesting in Osteomyocutaneous Fibular Flap Reconstructive Surgery: A Pilot Evaluation on a 3D-Printed Leg Phantom

2022 ◽  
Vol 11 ◽  
Author(s):  
Laura Cercenelli ◽  
Federico Babini ◽  
Giovanni Badiali ◽  
Salvatore Battaglia ◽  
Achille Tarsitano ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Success Rate ◽  
Test Session ◽  
Registration Accuracy ◽  
Skin Paddle ◽  
The Real ◽  
Virtual Models ◽  
Cad Cam ◽  
3D Printed ◽  
Fibular Flap

BackgroundAugmented Reality (AR) represents an evolution of navigation-assisted surgery, providing surgeons with a virtual aid contextually merged with the real surgical field. We recently reported a case series of AR-assisted fibular flap harvesting for mandibular reconstruction. However, the registration accuracy between the real and the virtual content needs to be systematically evaluated before widely promoting this tool in clinical practice. In this paper, after description of the AR based protocol implemented for both tablet and HoloLens 2 smart glasses, we evaluated in a first test session the achievable registration accuracy with the two display solutions, and in a second test session the success rate in executing the AR-guided skin paddle incision task on a 3D printed leg phantom.MethodsFrom a real computed tomography dataset, 3D virtual models of a human leg, including fibula, arteries and skin with planned paddle profile for harvesting, were obtained. All virtual models were imported into Unity software to develop a marker-less AR application suitable to be used both via tablet and via HoloLens 2 headset. The registration accuracy for both solutions was verified on a 3D printed leg phantom obtained from the virtual models, by repeatedly applying the tracking function and computing pose deviations between the AR-projected virtual skin paddle profile and the real one transferred to the phantom via a CAD/CAM cutting guide. The success rate in completing the AR-guided task of skin paddle harvesting was evaluated using CAD/CAM templates positioned on the phantom model surface.ResultsOn average, the marker-less AR protocol showed comparable registration errors (ranging within 1-5 mm) for tablet-based and HoloLens-based solution. Registration accuracy seems to be quite sensitive to ambient light conditions. We found a good success rate in completing the AR-guided task within an error margin of 4 mm (97% and 100% for tablet and HoloLens, respectively). All subjects reported greater usability and ergonomics for HoloLens 2 solution.ConclusionsResults revealed that the proposed marker-less AR based protocol may guarantee a registration error within 1-5 mm for assisting skin paddle harvesting in the clinical setting. Optimal lightening conditions and further improvement of marker-less tracking technologies have the potential to increase the efficiency and precision of this AR-assisted reconstructive surgery.

Introduction of augmented reality in ultrasound training – The set up for the UppStudy (Ultrasound aPP Study)

2016 ◽  
Vol 37 (S 01) ◽  
Author(s):  
K Lato ◽  
N Degregorio ◽  
C Lato ◽  
F Schochter ◽  
U Simon ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Set Up

Detection and localization of helipad in autonomous UAV landing: a coupled visual-inertial approach with artificial intelligence

2020 ◽  
Vol 71 (7) ◽  
pp. 828-839
Author(s):  
Thinh Hoang Dinh ◽  
Hieu Le Thi Hong
Keyword(s):  
Neural Network ◽  
Unmanned Aerial Vehicles ◽  
Fiducial Marker ◽  
Localization Algorithm ◽  
Challenging Problem ◽  
Autonomous Landing ◽  
Aerial Vehicles ◽  
Set Up ◽  
Detection And Localization ◽  
Rotary Wing

Autonomous landing of rotary wing type unmanned aerial vehicles is a challenging problem and key to autonomous aerial fleet operation. We propose a method for localizing the UAV around the helipad, that is to estimate the relative position of the helipad with respect to the UAV. This data is highly desirable to design controllers that have robust and consistent control characteristics and can find applications in search – rescue operations. AI-based neural network is set up for helipad detection, followed by optimization by the localization algorithm. The performance of this approach is compared against fiducial marker approach, demonstrating good consensus between two estimations

scholarly journals Laparoscopic augmented reality registration for oncological resection site repair

2021 ◽  
Author(s):  
Fabian Joeres ◽  
Tonia Mielke ◽  
Christian Hansen
Keyword(s):  
Augmented Reality ◽  
Time Pressure ◽  
Tumour Resection ◽  
Anatomical Landmarks ◽  
Proof Of Concept ◽  
Registration Accuracy ◽  
Target Registration Error ◽  
Concept Evaluation ◽  
Navigation Support ◽  
Challenges And Opportunities

Abstract Purpose Resection site repair during laparoscopic oncological surgery (e.g. laparoscopic partial nephrectomy) poses some unique challenges and opportunities for augmented reality (AR) navigation support. This work introduces an AR registration workflow that addresses the time pressure that is present during resection site repair. Methods We propose a two-step registration process: the AR content is registered as accurately as possible prior to the tumour resection (the primary registration). This accurate registration is used to apply artificial fiducials to the physical organ and the virtual model. After the resection, these fiducials can be used for rapid re-registration (the secondary registration). We tested this pipeline in a simulated-use study with $$N=18$$ N = 18 participants. We compared the registration accuracy and speed for our method and for landmark-based registration as a reference. Results Acquisition of and, thereby, registration with the artificial fiducials were significantly faster than the initial use of anatomical landmarks. Our method also had a trend to be more accurate in cases in which the primary registration was successful. The accuracy loss between the elaborate primary registration and the rapid secondary registration could be quantified with a mean target registration error increase of 2.35 mm. Conclusion This work introduces a registration pipeline for AR navigation support during laparoscopic resection site repair and provides a successful proof-of-concept evaluation thereof. Our results indicate that the concept is better suited than landmark-based registration during this phase, but further work is required to demonstrate clinical suitability and applicability.

scholarly journals Hybrid Spine Simulator Prototype for X-ray Free Pedicle Screws Fixation Training

2021 ◽  
Vol 11 (3) ◽  
pp. 1038
Author(s):  
Sara Condino ◽  
Giuseppe Turini ◽  
Virginia Mamone ◽  
Paolo Domenico Parchi ◽  
Vincenzo Ferrari
Keyword(s):  
Augmented Reality ◽  
Low Cost ◽  
Lumbar Vertebrae ◽  
Pedicle Screws ◽  
Simulation Software ◽  
Patient Specific ◽  
Innovative Strategy ◽  
X Ray ◽  
3D Printed ◽  
Harmful Radiation

Simulation for surgical training is increasingly being considered a valuable addition to traditional teaching methods. 3D-printed physical simulators can be used for preoperative planning and rehearsal in spine surgery to improve surgical workflows and postoperative patient outcomes. This paper proposes an innovative strategy to build a hybrid simulation platform for training of pedicle screws fixation: the proposed method combines 3D-printed patient-specific spine models with augmented reality functionalities and virtual X-ray visualization, thus avoiding any exposure to harmful radiation during the simulation. Software functionalities are implemented by using a low-cost tracking strategy based on fiducial marker detection. Quantitative tests demonstrate the accuracy of the method to track the vertebral model and surgical tools, and to coherently visualize them in either the augmented reality or virtual fluoroscopic modalities. The obtained results encourage further research and clinical validation towards the use of the simulator as an effective tool for training in pedicle screws insertion in lumbar vertebrae.

scholarly journals PD40-10 3D PRINTED VIRTUAL MODELS FOR PLANNING AND COUNSELING OF ROBOT-ASSISTED RADICAL PROSTATECTOMY AND PARTIAL NEPHRECTOMY

2018 ◽  
Vol 199 (4S) ◽  
Author(s):  
Francesco Porpiglia ◽  
Riccardo Bertolo ◽  
Daniele Amparore ◽  
Enrico Checcucci ◽  
Matteo Manfredi ◽  
...  
Keyword(s):  
Radical Prostatectomy ◽  
Partial Nephrectomy ◽  
Robot Assisted ◽  
Virtual Models ◽  
3D Printed

Smartphone-based DIY home microsurgical training with 3D printed microvascular clamps and Japanese noodles

2021 ◽  
Author(s):  
Zhi Yang Ng ◽  
Calum Honeyman ◽  
Alexandre G Lellouch ◽  
Ankur Pandya ◽  
Theodora Papavasiliou
Keyword(s):  
Back Wall ◽  
Internal Validation ◽  
Middle Income ◽  
Face To Face ◽  
Middle Income Countries ◽  
Video Recordings ◽  
Low Middle Income Countries ◽  
Konjac Flour ◽  
3D Printed ◽  
Set Up

We have recently incorporated simple modifications of the konjac flour noodle model to enable DIY home microsurgical training by (i) placing a smartphone on a mug to act as a microscope with at least 3.5-5x magnification, and (ii) rather than cannulating with a 22G needle as described by others, we have found that cannulation with a 23G needle followed by a second pass with an 18G needle will create a lumen (approx. 0.83 mm) without an overly thick and unrealistic “vessel” wall. The current set-up however, did not allow realistic evaluation of anastomotic patency as the noodles became macerated after application of standard microvascular clamps, which also did not facilitate practice of back-wall anastomoses. In order to simulate the actual operative environment as much as possible, we introduced the use of 3D printed microvascular clamps. These were modified from its previous iteration (suitable for use in silastic and chicken thigh vessels) and video recordings were submitted for internal validation by senior surgeons. A “wet” operative field where the knojac noodle lumen can be distended or collapsed, unlike other non-living models, was noted by senior surgeons. With the 3D clamps, the noodle could now be flipped over for back-wall anastomosis and allowed patency testing upon completion as it did not become macerated, unlike that from clinical microvascular clamps. The perceived advantages of this model are numerous. Not only does it comply with the 3Rs of simulation-based training, it can also reduce the associated costs of training by up to a hundred-fold or more when compared to a traditional rat course, and potentially, be extended to low-middle income countries (LMICs) without routine access to microsurgical training for capacity development. That it can be utilised remotely also bodes well with the current limitations on face to-face training due to COVID restrictions and lockdowns.

Dimensional Accuracy Evaluation of 3D - Printed Parts Using a 3D Scanning Surface Metrology Technique

2020 ◽  
Author(s):  
Emmanuelle R. Biglete ◽  
Jennifer C. Dela Cruz ◽  
Marvin S. Verdadero ◽  
Mark Christian E. Manuel ◽  
Allison R. Altea ◽  
...  
Keyword(s):  
Dimensional Accuracy ◽  
3D Scanning ◽  
Surface Metrology ◽  
Accuracy Evaluation ◽  
3D Printed

Bridging Children’s Reading with an Augmented Reality Story Library

Libri ◽  
2018 ◽  
Vol 68 (3) ◽  
pp. 219-229 ◽  
Author(s):  
Lih-Juan ChanLin
Keyword(s):  
Augmented Reality ◽  
Digital Information ◽  
Reading Processes ◽  
Story Content ◽  
Augmented Reality Technology ◽  
Mobile Ar ◽  
Set Up ◽  
Children's Stories ◽  
Children's Reading ◽  
Children’S Reading

Abstract In educational settings, physical objects or artwork are commonly used to convey meanings. These designs can be enhanced in ways which provide dynamic information overlay and context for children’s stories, such as how augmented reality technology (AR) uses created overlay digital information on the realistic object for enhancing interactions in learning and reading. The recent advancements in mobile AR have attracted a great deal of attention in the area of children’s learning and reading. In this context, a mobile AR story library (containing 228 picture books created by young artists from secondary schools) was developed for children’s reading. An AR platform (Hp Reveal) was used with Drupal for the management of story video clips, with children invited to immerse themselves in the artwork and stories in the library. Specific research questions were raised in this study: (1) how did teachers and the library implement the AR stories for children’s reading and (2) how did children react to AR reading? Observations and questionnaires were used to gather research data, while themes for scaffolding children’s reading in the mobile AR reading environment are summarized. It was observed that adults learned to use the AR mobile application and set up physical reading spaces (the library and classrooms) for children. When children were reading with AR, adults provided guidance and support for scaffolding children’s reading processes. The children were positive about the use of tablet with AR for reading stories and enjoyed reading the story content triggered by the AR technology.

Sign in / Sign up

Export Citation Format

Share Document