Augmented Reality Systems and Haptic Devices for Needle Insertion Medical Training

2021 ◽  
pp. 133-151
Author(s):  
Cléber Gimenez Corrêa ◽  
Claiton de Oliveira ◽  
Silvio Ricardo Rodrigues Sanches
Author(s):  
Sarah Beadle ◽  
Randall Spain ◽  
Benjamin Goldberg ◽  
Mahdi Ebnali ◽  
Shannon Bailey ◽  
...  

Virtual environments and immersive technologies are growing in popularity for human factors purposes. Whether it is training in a low-risk environment or using simulated environments for testing future automated vehicles, virtual environments show promise for the future of our field. The purpose of this session is to have current human factors practitioners and researchers demonstrate their immersive technologies. This is the eighth iteration of the “Me and My VE” interactive session. Presenters in this session will provide a brief introduction of their virtual reality, augmented reality, or virtual environment work before engaging with attendees in an interactive demonstration period. During this period, the presenters will each have a multimedia display of their immersive technology as well as discuss their work and development efforts. The selected demonstrations cover issues of designing immersive interfaces, military and medical training, and using simulation to better understand complex tasks. This includes a mix of government, industry, and academic-based work. Attendees will be virtually immersed in the technologies and research presented allowing for interaction with the work being done in this field.


2021 ◽  
Vol 11 (5) ◽  
pp. 2338
Author(s):  
Rosanna Maria Viglialoro ◽  
Sara Condino ◽  
Giuseppe Turini ◽  
Marina Carbone ◽  
Vincenzo Ferrari ◽  
...  

Simulation-based medical training is considered an effective tool to acquire/refine technical skills, mitigating the ethical issues of Halsted’s model. This review aims at evaluating the literature on medical simulation techniques based on augmented reality (AR), mixed reality (MR), and hybrid approaches. The research identified 23 articles that meet the inclusion criteria: 43% combine two approaches (MR and hybrid), 22% combine all three, 26% employ only the hybrid approach, and 9% apply only the MR approach. Among the studies reviewed, 22% use commercial simulators, whereas 78% describe custom-made simulators. Each simulator is classified according to its target clinical application: training of surgical tasks (e.g., specific tasks for training in neurosurgery, abdominal surgery, orthopedic surgery, dental surgery, otorhinolaryngological surgery, or also generic tasks such as palpation) and education in medicine (e.g., anatomy learning). Additionally, the review assesses the complexity, reusability, and realism of the physical replicas, as well as the portability of the simulators. Finally, we describe whether and how the simulators have been validated. The review highlights that most of the studies do not have a significant sample size and that they include only a feasibility assessment and preliminary validation; thus, further research is needed to validate existing simulators and to verify whether improvements in performance on a simulated scenario translate into improved performance on real patients.


2020 ◽  
Vol 43 (5) ◽  
pp. 756-764 ◽  
Author(s):  
Rachel Hecht ◽  
Ming Li ◽  
Quirina M. B. de Ruiter ◽  
William F. Pritchard ◽  
Xiaobai Li ◽  
...  

2019 ◽  
Vol 25 (6) ◽  
pp. 2157-2167 ◽  
Author(s):  
Florian Heinrich ◽  
Fabian Joeres ◽  
Kai Lawonn ◽  
Christian Hansen

Author(s):  
Zoltán Bárdosi ◽  
Christian Plattner ◽  
Yusuf Özbek ◽  
Thomas Hofmann ◽  
Srdjan Milosavljevic ◽  
...  

Abstract Purpose  A robotic intraoperative laser guidance system with hybrid optic-magnetic tracking for skull base surgery is presented. It provides in situ augmented reality guidance for microscopic interventions at the lateral skull base with minimal mental and workload overhead on surgeons working without a monitor and dedicated pointing tools. Methods  Three components were developed: a registration tool (Rhinospider), a hybrid magneto-optic-tracked robotic feedback control scheme and a modified robotic end-effector. Rhinospider optimizes registration of patient and preoperative CT data by excluding user errors in fiducial localization with magnetic tracking. The hybrid controller uses an integrated microscope HD camera for robotic control with a guidance beam shining on a dual plate setup avoiding magnetic field distortions. A robotic needle insertion platform (iSYS Medizintechnik GmbH, Austria) was modified to position a laser beam with high precision in a surgical scene compatible to microscopic surgery. Results  System accuracy was evaluated quantitatively at various target positions on a phantom. The accuracy found is 1.2 mm ± 0.5 mm. Errors are primarily due to magnetic tracking. This application accuracy seems suitable for most surgical procedures in the lateral skull base. The system was evaluated quantitatively during a mastoidectomy of an anatomic head specimen and was judged useful by the surgeon. Conclusion  A hybrid robotic laser guidance system with direct visual feedback is proposed for navigated drilling and intraoperative structure localization. The system provides visual cues directly on/in the patient anatomy, reducing the standard limitations of AR visualizations like depth perception. The custom- built end-effector for the iSYS robot is transparent to using surgical microscopes and compatible with magnetic tracking. The cadaver experiment showed that guidance was accurate and that the end-effector is unobtrusive. This laser guidance has potential to aid the surgeon in finding the optimal mastoidectomy trajectory in more difficult interventions.


Author(s):  
Masyura A. Faudzi ◽  
Rahmita Wirza O.K. Rahmat ◽  
Puteri Suhaiza Sulaiman ◽  
Mohd Zamrin Dimon

2011 ◽  
Vol 4 (3) ◽  
pp. 199-209 ◽  
Author(s):  
Timothy R. Coles ◽  
Nigel W. John ◽  
Derek Gould ◽  
Darwin G. Caldwell

Sign in / Sign up

Export Citation Format

Share Document