scholarly journals Virtual Reality and Augmented Reality—Translating Surgical Training into Surgical Technique

2020 ◽  
Vol 13 (6) ◽  
pp. 663-674
Author(s):  
R. Randall McKnight ◽  
Christian A. Pean ◽  
J. Stewart Buck ◽  
John S. Hwang ◽  
Joseph R. Hsu ◽  
...  
2020 ◽  
Vol 3 (1) ◽  
pp. 9-10
Author(s):  
Rehan Ahmed Khan

In the field of surgery, major changes that have occurred include the advent of minimally invasive surgery and the realization of the importance of the ‘systems’ in the surgical care of the patient (Pierorazio & Allaf, 2009). Challenges in surgical training are two-fold: (i) to train the surgical residents to manage a patient clinically (ii) to train them in operative skills (Singh & Darzi,2013). In Pakistan, another issue with surgical training is that we have the shortest duration of surgical training in general surgery of four years only, compared to six to eight years in Europe and America (Zafar & Rana, 2013). Along with it, the smaller number of patients to surgical residents’ ratio is also an issue in surgical training. This warrants formal training outside the operation room. It has been reported by many authors that changes are required in the current surgical training system due to the significant deficiencies in the graduating surgeon (Carlsen et al., 2014; Jarman et al., 2009; Parsons, Blencowe, Hollowood, & Grant, 2011). Considering surgical training, it is imperative that a surgeon is competent in clinical management and operative skills at the end of the surgical training. To achieve this outcome in this challenging scenario, a resident surgeon should be provided with the opportunities of training outside the operation theatre, before s/he can perform procedures on a real patient. The need for this training was felt more when the Institute of Medicine in the USA published a report, ‘To Err is Human’ (Stelfox, Palmisani, Scurlock, Orav, & Bates, 2006), with an aim to reduce medical errors. This is required for better training and objective assessment of the surgical residents. The options for this training include but are not limited to the use of mannequins, virtual patients, virtual simulators, virtual reality, augmented reality, and mixed reality. Simulation is a technique to substitute or add to real experiences with guided ones, often immersive in nature, that reproduce substantial aspects of the real world in a fully interactive way. Mannequins, virtual simulators are in use for a long time now. They are available in low fidelity to high fidelity mannequins and virtual simulators and help residents understand the surgical anatomy, operative site and practice their skills. Virtual patients can be discussed with students in a simple format of the text, pictures, and videos as case files available online, or in the form of customized software applications based on algorithms. In a study done by Courtielle et al, they reported that knowledge retention is increased in residents when it is delivered through virtual patients as compared to lecturing (Courteille et al., 2018).But learning the skills component requires hands-on practice. This gap can be bridged with virtual, augmented, or mixed reality. There are three types of virtual reality (VR) technologies: (i) non-immersive, (ii) semi-immersive, and (iii) fully immersive. Non-immersive (VR) involves the use of software and computers. In semi-immersive and immersive VR, the virtual image is presented through the head-mounted display(HMD), the difference being that in the fully immersive type, the virtual image is completely obscured from the actual world. Using handheld devices with haptic feedback the trainee can perform a procedure in the virtual environment (Douglas, Wilke, Gibson, Petricoin, & Liotta, 2017). Augmented reality (AR) can be divided into complete AR or mixed reality (MR). Through AR and MR, a trainee can see a virtual and a real-world image at the same time, making it easy for the supervisor to explain the steps of the surgery. Similar to VR, in AR and MR the user wears an HMD that shows both images. In AR, the virtual image is transparent whereas, in MR, it appears solid (Douglas et al., 2017). Virtual augmented and mixed reality has more potential to train surgeons as they provide fidelity very close to the real situation and require fewer physical resources and space compared to the simulators. But they are costlier, and affordability is an issue. To overcome this, low-cost solutions to virtual reality have been developed. It is high time that we also start thinking on the same lines and develop this means of training our surgeons at an affordable cost.


Author(s):  
Solveig Hoppe ◽  
Marta De Andres Crespo ◽  
Matthew Williams ◽  
Ashok Handa ◽  
James McVeigh

The section on changes in training from the Future in Surgery Report by the Royal College of Surgeons of England outlined key ideas for improving surgical training in the future. These ideas included the use of augmented reality, virtual reality and simulation, as well as increased support for surgeons to diverge from traditional surgical training pathways to undertake research and act as entrepreneurs. The Second Oxford Surgical Innovation Conference (OxSI) had similar aims to prepare delegates for these changes in surgery. The event took place on Friday 13th March 2020 at St Catherine's College, Oxford, and included talks and workshops from world-renowned surgeons, which covered a vast range of topics but ultimately all gave a fascinating insight into what is needed to improve surgical practice and policy.


Author(s):  
Muhammad Fadzil Bin Kamarudin ◽  
Nabil Zary

Background: Since the advent of virtual reality (VR), it has been used in medical education for surgical training and anatomy teaching. Recently, other modalities of extended reality (XR) such as augmented reality (AR) and mixed reality (MR) has also made its way into medical education. Although there has been research validating XR’s use in medical education, there have been few studies on the research trends of the different XR modalities. The paper aims to compare the research trends of the XR modalities in general and in terms of the medical fields studied and outcomes measured. Methods: Web of Science was searched, and preliminary data was extracted to analyze the general trend. Inclusion and exclusion criteria were then applied, and finalized articles were analyzed and grouped based on the medical field studied and outcomes measured. Results: 31 articles on VR, eight on AR and one on MR were included in the final analysis. We found that there is increasing research in VR since 1990 and AR since 2008. The research in MR is constant. Most of the papers on VR studied endoscopic surgery and anatomy whereas AR studied mostly anatomy and endovascular procedures. Using Miller’s prism of clinical competence, the competency measured most for VR and AR is “show”. Discussion and conclusion: Advancement in computing, communication and display technologies since 1990 may contribute to the increase in research on VR whereas the ubiquity of smartphone since 2008 may explain the increase in research on AR. Although both VR and AR are used in surgical training and anatomy teaching, we found possible strengths of VR in counseling and AR in practical skills. The competency "show" was measured most as most of the papers were on surgery, and the XR simulators used can capture surgical parameters


2012 ◽  
Author(s):  
R. A. Grier ◽  
H. Thiruvengada ◽  
S. R. Ellis ◽  
P. Havig ◽  
K. S. Hale ◽  
...  

2019 ◽  
Vol 16 (2) ◽  
pp. 22-31
Author(s):  
Christian Zabel ◽  
Gernot Heisenberg

Getrieben durch populäre Produkte und Anwendungen wie Oculus Rift, Pokémon Go oder der Samsung Gear stößt Virtual Reality, Augmented Reality und auch Mixed Reality auf zunehmend großes Interesse. Obwohl die zugrunde liegenden Technologien bereits seit den 1990er Jahren eingesetzt werden, ist eine breitere Adoption erst seit relativ kurzer Zeit zu beobachten. In der Folge ist ein sich schnell entwickelndes Ökosystem für VR und AR entstanden (Berg & Vance, 2017). Aus einer (medien-) politischen Perspektive interessiert dabei, welche Standortfaktoren die Ansiedlung und Agglomeration dieser Firmen begünstigen. Da die Wertschöpfungsaktivitäten sowohl hinsichtlich der Zielmärkte als auch der Leistungserstellung (z. B. starker Einsatz von IT und Hardware in der Produkterstellung) von denen klassischer Medienprodukte deutlich abweichen, kann insbesondere gefragt werden, ob die VR-, MR- und AR-Unternehmen mit Blick auf die Ansiedlungspolitik als Teil der Medienbranche aufzufassen sind und somit auf die für Medienunternehmen besonders relevanten Faktoren in ähnlichem Maße reagieren. Der vorliegende Aufsatz ist das Ergebnis eines Forschungsprojekts im Auftrag des Mediennetzwerks NRW, einer Tochterfirma der Film- und Medienstiftung NRW.


2021 ◽  
Vol 11 (7) ◽  
pp. 3253
Author(s):  
Umile Giuseppe Longo ◽  
Sergio De Salvatore ◽  
Vincenzo Candela ◽  
Giuliano Zollo ◽  
Giovanni Calabrese ◽  
...  

Background: The application of virtual and augmented reality technologies to orthopaedic surgery training and practice aims to increase the safety and accuracy of procedures and reducing complications and costs. The purpose of this systematic review is to summarise the present literature on this topic while providing a detailed analysis of current flaws and benefits. Methods: A comprehensive search on the PubMed, Cochrane, CINAHL, and Embase database was conducted from inception to February 2021. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines were used to improve the reporting of the review. The Cochrane Risk of Bias Tool and the Methodological Index for Non-Randomized Studies (MINORS) was used to assess the quality and potential bias of the included randomized and non-randomized control trials, respectively. Results: Virtual reality has been proven revolutionary for both resident training and preoperative planning. Thanks to augmented reality, orthopaedic surgeons could carry out procedures faster and more accurately, improving overall safety. Artificial intelligence (AI) is a promising technology with limitless potential, but, nowadays, its use in orthopaedic surgery is limited to preoperative diagnosis. Conclusions: Extended reality technologies have the potential to reform orthopaedic training and practice, providing an opportunity for unidirectional growth towards a patient-centred approach.


Author(s):  
Sarah Beadle ◽  
Randall Spain ◽  
Benjamin Goldberg ◽  
Mahdi Ebnali ◽  
Shannon Bailey ◽  
...  

Virtual environments and immersive technologies are growing in popularity for human factors purposes. Whether it is training in a low-risk environment or using simulated environments for testing future automated vehicles, virtual environments show promise for the future of our field. The purpose of this session is to have current human factors practitioners and researchers demonstrate their immersive technologies. This is the eighth iteration of the “Me and My VE” interactive session. Presenters in this session will provide a brief introduction of their virtual reality, augmented reality, or virtual environment work before engaging with attendees in an interactive demonstration period. During this period, the presenters will each have a multimedia display of their immersive technology as well as discuss their work and development efforts. The selected demonstrations cover issues of designing immersive interfaces, military and medical training, and using simulation to better understand complex tasks. This includes a mix of government, industry, and academic-based work. Attendees will be virtually immersed in the technologies and research presented allowing for interaction with the work being done in this field.


Information ◽  
2020 ◽  
Vol 12 (1) ◽  
pp. 10
Author(s):  
Stavroula Tzima ◽  
Georgios Styliaras ◽  
Athanasios Bassounas

Escape Rooms are presently considered a very popular social entertainment activity, with increasing popularity in education field, since they are considered capable of stimulating the interest of players/students and enhancing learning. The combined game mechanics have led to blended forms of Escape Rooms, the Serious Escape Games (SEGs) and the hybrid type of Escape Rooms that uses Augmented Reality (AR)/Virtual Reality technology, a type that is expected to be widely used in the future. In the current study, the MillSecret is presented, a multi-player Serious Escape Game about local cultural heritage, where the players must solve a riddle about the cultural asset of watermills. MillSecret uses AR technology and it was designed to be conducted in the real-physical environment and in an informal educational context. The paper describes the game, its implementation, the playing process, and its evaluation, which aimed to study the feasibility of game conduction in outdoor settings and the views and experience of players with the game, the local cultural heritage and local history. Evaluation results reveal, among other findings, a very positive first feedback from players that allows us to further evolve the development of the game.


Sign in / Sign up

Export Citation Format

Share Document