scholarly journals Augmented Reality with HoloLens® in Parotid Tumor Surgery: A Prospective Feasibility Study

ORL ◽  
2021 ◽  
pp. 1-10
Author(s):  
Claudia Scherl ◽  
Johanna Stratemeier ◽  
Nicole Rotter ◽  
Jürgen Hesser ◽  
Stefan O. Schönberg ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Tumor Surgery ◽  
Parotid Tumor ◽  
Hand Gestures ◽  
Surgical Performance ◽  
3D Images ◽  
Additional Information ◽  
Parotid Surgery ◽  
Surgical Field ◽  
Improve Planning

<b><i>Introduction:</i></b> Augmented reality can improve planning and execution of surgical procedures. Head-mounted devices such as the HoloLens® (Microsoft, Redmond, WA, USA) are particularly suitable to achieve these aims because they are controlled by hand gestures and enable contactless handling in a sterile environment. <b><i>Objectives:</i></b> So far, these systems have not yet found their way into the operating room for surgery of the parotid gland. This study explored the feasibility and accuracy of augmented reality-assisted parotid surgery. <b><i>Methods:</i></b> 2D MRI holographic images were created, and 3D holograms were reconstructed from MRI DICOM files and made visible via the HoloLens. 2D MRI slices were scrolled through, 3D images were rotated, and 3D structures were shown and hidden only using hand gestures. The 3D model and the patient were aligned manually. <b><i>Results:</i></b> The use of augmented reality with the HoloLens in parotic surgery was feasible. Gestures were recognized correctly. Mean accuracy of superimposition of the holographic model and patient’s anatomy was 1.3 cm. Highly significant differences were seen in position error of registration between central and peripheral structures (<i>p</i> = 0.0059), with a least deviation of 10.9 mm (centrally) and highest deviation for the peripheral parts (19.6-mm deviation). <b><i>Conclusion:</i></b> This pilot study offers a first proof of concept of the clinical feasibility of the HoloLens for parotid tumor surgery. Workflow is not affected, but additional information is provided. The surgical performance could become safer through the navigation-like application of reality-fused 3D holograms, and it improves ergonomics without compromising sterility. Superimposition of the 3D holograms with the surgical field was possible, but further invention is necessary to improve the accuracy.

scholarly journals Augmented Reality with HoloLens in Parotid Tumor Surgery: A prospective feasibility study

2020 ◽  
Author(s):  
C Scherl ◽  
J Stratemeier ◽  
Jürgen Hesser ◽  
S Schönberg ◽  
A Lammert ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Feasibility Study ◽  
Tumor Surgery ◽  
Parotid Tumor

scholarly journals Augmented Reality-Assisted Pancreaticoduodenectomy with Superior Mesenteric Vein Resection and Reconstruction

2021 ◽  
Vol 2021 ◽  
pp. 1-7
Author(s):  
Rui Tang ◽  
Wei Yang ◽  
Yucheng Hou ◽  
Lihan Yu ◽  
Guangdong Wu ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Tumor Invasion ◽  
Superior Mesenteric Vein ◽  
Splenic Vein ◽  
Smart Phone ◽  
Preoperative Imaging ◽  
3D Images ◽  
Mesenteric Vein ◽  
Computed Tomography Scanning ◽  
Surgical Field

Introduction. Pancreaticoduodenectomy (PD) with superior mesenteric vein (SMV) reconstruction are often required to achieve complete (R0) resection for pancreatic head cancer (PHC) with tumor invasion of the SMV. Augmented reality (AR) technology can be used to assist in determining the extent of SMV involvement by superimposing virtual 3-dimensional (3D) images of the pancreas and regional vasculature on the surgical field. Materials and Methods. Three patients with PHC and tumor invasion of the SMV underwent AR-assisted PD with SMV resection and reconstruction following preoperative computed tomography scanning. Preoperative imaging data were used to reconstruct 3D images of anatomical structures, including the tumor, portal vein (PV), SMV, and splenic vein (SV). Using AR software installed on a smart phone, the reconstructed 3D images were superimposed on the surgical field as viewed in a smart phone display to provide intermittent navigational assistance to the surgeon in identifying the boundaries of PHC tumor invasion for resection of the vessels involved. Result. All patients successfully completed the operation. Intraoperative AR applications displayed virtual images of the pancreas, SMV, bile duct, common hepatic artery (CHA), and superior mesenteric artery (SMA). Two patients required end-to-end anastomosis for reconstruction of the SMV. One patient required allogenic vascular bypass to reconstruct the SMV-PV juncture with concomitant reconstruction of the SV-SMV confluence by end-to-side anastomosis of the SV and bypass vessel. Postoperative pathology confirmed R0 resections for all patients. Conclusion. AR navigation technology based on preoperative CT image data can assist surgeons performing PD with SMV resection and reconstruction.

Augmented reality–assisted pedicle screw insertion: a cadaveric proof-of-concept study

2019 ◽  
Vol 31 (1) ◽  
pp. 139-146 ◽  
Author(s):  
Camilo A. Molina ◽  
Nicholas Theodore ◽  
A. Karim Ahmed ◽  
Erick M. Westbroek ◽  
Yigal Mirovsky ◽  
...  
Keyword(s):  
Augmented Reality ◽  
Pedicle Screw ◽  
User Experience ◽  
Pedicle Screws ◽  
Screw Insertion ◽  
Pedicle Screw Insertion ◽  
Insertion Method ◽  
Comparative Accuracy ◽  
Placement Accuracy ◽  
Surgical Field

OBJECTIVEAugmented reality (AR) is a novel technology that has the potential to increase the technical feasibility, accuracy, and safety of conventional manual and robotic computer-navigated pedicle insertion methods. Visual data are directly projected to the operator’s retina and overlaid onto the surgical field, thereby removing the requirement to shift attention to a remote display. The objective of this study was to assess the comparative accuracy of AR-assisted pedicle screw insertion in comparison to conventional pedicle screw insertion methods.METHODSFive cadaveric male torsos were instrumented bilaterally from T6 to L5 for a total of 120 inserted pedicle screws. Postprocedural CT scans were obtained, and screw insertion accuracy was graded by 2 independent neuroradiologists using both the Gertzbein scale (GS) and a combination of that scale and the Heary classification, referred to in this paper as the Heary-Gertzbein scale (HGS). Non-inferiority analysis was performed, comparing the accuracy to freehand, manual computer-navigated, and robotics-assisted computer-navigated insertion accuracy rates reported in the literature. User experience analysis was conducted via a user experience questionnaire filled out by operators after the procedures.RESULTSThe overall screw placement accuracy achieved with the AR system was 96.7% based on the HGS and 94.6% based on the GS. Insertion accuracy was non-inferior to accuracy reported for manual computer-navigated pedicle insertion based on both the GS and the HGS scores. When compared to accuracy reported for robotics-assisted computer-navigated insertion, accuracy achieved with the AR system was found to be non-inferior when assessed with the GS, but superior when assessed with the HGS. Last, accuracy results achieved with the AR system were found to be superior to results obtained with freehand insertion based on both the HGS and the GS scores. Accuracy results were not found to be inferior in any comparison. User experience analysis yielded “excellent” usability classification.CONCLUSIONSAR-assisted pedicle screw insertion is a technically feasible and accurate insertion method.

scholarly journals Spectral Tomography for 3D Element Detection and Mineral Analysis

Minerals ◽  
2021 ◽  
Vol 11 (6) ◽  
pp. 598
Author(s):  
Jose R. A. Godinho ◽  
Gabriel Westaway-Heaven ◽  
Marijn A. Boone ◽  
Axel D. Renno
Keyword(s):  
Energy Spectrum ◽  
3D Imaging ◽  
X Rays ◽  
3D Images ◽  
Characterization Methods ◽  
X Ray ◽  
Additional Information ◽  
Mineral Phases ◽  
Spectral Computed Tomography

This paper demonstrates the potential of a new 3D imaging technique, Spectral Computed Tomography (sp-CT), to identify heavy elements inside materials, which can be used to classify mineral phases. The method combines the total X-ray transmission measured by a normal polychromatic X-ray detector, and the transmitted X-ray energy spectrum measured by a detector that discriminates between X-rays with energies of about 1.1 keV resolution. An analysis of the energy spectrum allows to identify sudden changes of transmission at K-edge energies that are specific of each element. The additional information about the elements in a phase improves the classification of mineral phases from grey-scale 3D images that would be otherwise difficult due to artefacts or the lack of contrast between phases. The ability to identify the elements inside the minerals that compose ore particles and rocks is crucial to broaden the application of 3D imaging in Earth sciences research and mineral process engineering, which will represent an important complement to traditional 2D imaging mineral characterization methods. In this paper, the first applications of sp-CT to classify mineral phases are showcased and the limitations and further developments are discussed.

scholarly journals A Novel Suture Training System for Open Surgery Replicating Procedures Performed by Experts Using Augmented Reality

2021 ◽  
Vol 45 (5) ◽  
Author(s):  
Yuri Nagayo ◽  
Toki Saito ◽  
Hiroshi Oyama
Keyword(s):  
Augmented Reality ◽  
Motion Capture ◽  
Open Surgery ◽  
Three Dimensional ◽  
Training System ◽  
Surgical Skills ◽  
Surgical Instruments ◽  
Interrupted Suture ◽  
Education Environment ◽  
Surgical Field

AbstractThe surgical education environment has been changing significantly due to restricted work hours, limited resources, and increasing public concern for safety and quality, leading to the evolution of simulation-based training in surgery. Of the various simulators, low-fidelity simulators are widely used to practice surgical skills such as sutures because they are portable, inexpensive, and easy to use without requiring complicated settings. However, since low-fidelity simulators do not offer any teaching information, trainees do self-practice with them, referring to textbooks or videos, which are insufficient to learn open surgical procedures. This study aimed to develop a new suture training system for open surgery that provides trainees with the three-dimensional information of exemplary procedures performed by experts and allows them to observe and imitate the procedures during self-practice. The proposed system consists of a motion capture system of surgical instruments and a three-dimensional replication system of captured procedures on the surgical field. Motion capture of surgical instruments was achieved inexpensively by using cylindrical augmented reality (AR) markers, and replication of captured procedures was realized by visualizing them three-dimensionally at the same position and orientation as captured, using an AR device. For subcuticular interrupted suture, it was confirmed that the proposed system enabled users to observe experts’ procedures from any angle and imitate them by manipulating the actual surgical instruments during self-practice. We expect that this training system will contribute to developing a novel surgical training method that enables trainees to learn surgical skills by themselves in the absence of experts.

scholarly journals Virtual Object Position Manipulation Using ARToolKit

2015 ◽  
Vol 1 (2) ◽  
pp. 306
Author(s):  
Hoger Mahmud Hussen
Keyword(s):  
Augmented Reality ◽  
Target Position ◽  
Virtual Object ◽  
Design Solution ◽  
Test Cases ◽  
Current Version ◽  
Virtual Objects ◽  
Additional Information ◽  
Education And Health ◽  
Optical Markers

In this paper the outcome of a project is presented that aims to modify and improve one of the most widely used Augmented Reality tools. Augmented reality (AR), is a fast growing area of virtual reality research. Augmented Reality (AR) is a newly emerging technology by which user’s view of the real world is augmented with additional information from a computer model. ARToolKit is one of the most widely used toolkits for Augmented Reality applications. The toolkit tracks optical markers and overlays virtual objects on the markers. In the current version of the toolkit the overlaid object is stationary or loops regardless of the optical target position, this means that the overlaid object cannot be animated or changed based on the movement of the optical target. The aim is to improve the toolkit, therefore a design solution to modify it were designed and implement so that users can manipulate the position of the overlaid virtual object, through movements of the optical target. The design solution focuses on developing a mathematically based links between the position of the optical target and the overlaid virtual object. To test the solution test cases were developed and the results show that the design solution is effective and the principal idea can be used to develop many applications in different sectors such as education and health.

scholarly journals 3D visualization in otosurgery

2020 ◽  
Vol 19 (6) ◽  
pp. 38-49
Author(s):  
D. M. Kuz’min ◽  
◽  
A. A. Fedotova ◽  
Keyword(s):  
Middle Ear ◽  
3D Visualization ◽  
Research Work ◽  
Three Dimensional ◽  
Middle Ear Surgery ◽  
Ear Surgery ◽  
Task Load ◽  
Additional Information ◽  
Surgical Field ◽  
Nasa Task Load Index

The main priority of middle ear surgery is to create a safe and optimal view of the surgical field, as well as the most accurate visualization of anatomical structures, which is a driving factor in the evolution of otosurgery. The additional information provided by three-dimensional (3D) images has been proven to improve understanding of the temporal bone anatomy and improve the operator’s ability to assess associated diseases, thereby optimizing surgical management. In the presented experimental research work, a new technique for visualizing the surgical field is described, which improves the quality of the operator’s work and expands the possibilities of middle ear surgery. On the basis of the Chair of Otorhinolaryngology of the Mechnikov North-Western State Medical University a remote adapter for an endoscopic tube was created, which allows you to broadcast the video image received from its distal end to virtual reality glasses. For a detailed understanding of the principle of information transmission in a new three-dimensional reality, we used concepts such as disparity and stereopsis. All research results were evaluated according to the NASA Task Load Index scale. Analyzing the results of the experiment, in the conditions of three-dimensional visualization of the surgical field, a lower level of subjective workload was revealed, which was regarded as a positive effect of the realization of the phenomenon of stereopsis, when performing manipulations on the middle ear.

scholarly journals Framework for Developing a Mobile Augmented Reality for Learning Chemical Bonds

2019 ◽  
Vol 13 (07) ◽  
pp. 54
Author(s):  
Nor Farhah Saidin ◽  
Noor Dayana Abd Halim ◽  
Noraffandy Yahaya
Keyword(s):  
Augmented Reality ◽  
Chemical Bonds ◽  
Mobile Augmented Reality ◽  
Abstract Concepts ◽  
3D Images ◽  
Strong Potential

This paper presents the framework for developing a Mobile Augmented Reality (MAR) for learning Chemical Bonds, which is believed to reduce misconceptions among the students. Misconceptions always occur in classrooms, especially in science subject’s which consist of abstract concepts. It is very important that these misconceptions be reduced, because they may affect the student’s understandings of topics they have learned about. These may interfere with the student’s education, and may also affect the student’s performances afterwards. Visualization is one key approach that has been proven to help when seeking to improve the understanding of students, which has consequently led to a reduction in misconceptions. There are many technologies that have been integrated within education, and that show strong potential for producing visualizations. One of the recent popular technologies that have the potential for visualization is Mobile Augmented Reality. Mobile Augmented Reality has the ability to visualize abstract concepts through 3D images

Development of Molding Tool with Augmented Reality Technology Application

2013 ◽  
Vol 442 ◽  
pp. 203-208
Author(s):  
Jozef Novak-Marcincin
Keyword(s):  
Augmented Reality ◽  
Technology Application ◽  
Additional Information ◽  
Augmented Reality System ◽  
Real Scene ◽  
Augmented Reality Technology ◽  
Virtual And Augmented Reality ◽  
Developing Area ◽  
Molding Tool ◽  
World Environment

Augmented Reality (AR) is a developing area of virtual reality research. The world environment around us provides a wealth of information that is difficult to duplicate in a computer. This is evidenced by the worlds used in virtual environments. An augmented reality system generates a composite view for the user. It is a combination of the real scene viewed by the user and a virtual scene generated by the computer that augments the scene with additional information. In paper is presented the example of virtual and augmented reality application in area of molding tool assembly realized by author.

Sign in / Sign up

Export Citation Format

Share Document