Speed versus damage: using selective feedback to modulate laparoscopic simulator performance

Background Adaptive training is an approach in which training variables change with the needs and traits of individual trainees. It has potential to mitigate the effect of personality traits such as impulsiveness on surgical performance. Selective performance feedback is one way to implement adaptive training. This paper investigates whether selective feedback can direct performance of trainees of either high- or low impulsiveness. Methods A total of 83 inexperienced medical students of known impulsiveness performed a four-session laparoscopic training course on a Virtual Reality Simulator. They performed two identical series of tasks every session. During one series of tasks they received performance feedback on duration and during the other series they received feedback on damage. Performance parameters (duration and damage) were compared between the two series of tasks to assess whether selective performance feedback can be used to steer emphasis in performance. To assess the effectiveness of selective feedback for people of high- or low impulsiveness, the difference in performance between the two series for both duration and damage was also assessed. Results Participants were faster when given performance feedback for speed for all exercises in all sessions (average z-value = − 4.14, all p values < .05). Also, they performed better on damage control when given performance feedback for damage in all tasks and during all sessions except for one (average z-value = − 4.19, all but one p value < .05). Impulsiveness did not impact the effectiveness of selective feedback. Conclusion Selective feedback on either duration or damage can be used to improve performance for the variable that the trainee receives feedback on. Trainee impulsiveness did not modulate this effect. Selective feedback can be used to steer training focus in adaptive training systems and can mitigate the negative effects of impulsiveness on damage control.

Proficiency From Immersion: A Human-Centered Design in Cross-Cultural Surgical Training

Ensuring surgeons are well-trained in various skills is of paramount importance to patient safety. Surgical simulators were introduced to laparoscopy training during the last 2 decades for basic skills training. The main drawback of current simulation-based laparoscopy training is their lack of true representation of the intro-operative experience. To create a complete surgical surrounding, the required amount of resources is demanding. Moreover, organizing immersive training with surgical teams burdens daily clinical routines. High-end virtual reality (VR) headsets bring an opportunity to generate an immersive virtual OR with accessible and affordable expenses. Pilot studies reveal that personalization and localization are key needs of the virtual operating room (VOR). They are therefore key in this study. The focus of this study was to explore the effect of different human factors, such as domain knowledge, culture, and familiarity of VR technologies, on the perception of VOR experience. A human-centered design approach was applied to investigate the presence and usability of a VOR. Sixty-four surgical practitioners joined the study in the Netherlands and India. The surgeons were referred to as “experts” and surgical trainees as “novices.” The VOR system we used is composed of a laparoscopic simulator, a graphic virtual OR surrounding, and an Oculus Rift VR headset. Participants conducted the “complete Lapchol” task with the VOR. Afterward, four questionnaires were used to collect subjective ratings on presence and usability. Participant’s qualitative feedback was collected using a semi-structural interview as the final stage. Results showed the surgical knowledge only affected perceived mental demand when using a VOR. The cultural difference would alter the rating on the majority of items in these questionnaires. VR experience mainly affected the judgment on presence including “quality of interface” and “reversible actions.” The interaction effects between surgical knowledge either with culture difference or with VR experience were obvious. This study demonstrated the influences of cultural differences on the perception of immersion and usability. Integrating immersive technologies such as virtual reality and augmented reality to human-centered design opens a brand new horizon for health care and similar professional training.

P15: EVALUATING THE INTERNATIONAL USABILITY OF A LOW-COST LAPAROSCOPIC TRAINER IN LOW- AND HIGH-INCOME SETTINGS

Introduction Limited access to equipment and trained personnel restrict the adoption of laparoscopic surgery globally. There are a wide range of laparoscopic trainers available; however, most of these are not affordable. We propose an ultra-low-cost laparoscopic trainer (Lap-Pack), designed for portability, ease of assembly and compatibility with smart devices. The study aims to evaluate the usability of Lap-Pack as a training tool in low- and high-income settings. Method An international usability study was conducted in India and the UK in 2019. The participants (n=60), consisting of senior surgeons (n=18), junior trainees (n=20) and medical students (n=22), were asked to complete two tasks using Lap-Pack. Participants then scored Lap-Pack in a 25-point questionnaire, including a pre-established Face-Validity Criteria and four major evaluation categories – Usability, Camera, View, Material. Result Lap-Pack scored highly in Face-Validity with a combined mean score of 4.63 (95%CI: 4.31, 4.95, p &lt;0.05) of a possible 6. In both cohorts, the Usability and Camera categories scored highest, with combined values respectively of 6.10 (95%CI: 6.01, 6.19, p &lt;0.05) and 6.09 (95%CI: 5.88, 6.31, p &lt;0.05) of a possible 7. For both centres, the highest-scoring individual criteria were its light weight and portability. Conclusion Overall, Lap-Pack was received positively by medical students and consultants alike, suggesting it is a suitable device for development of skills as part of a larger laparoscopic training curriculum. Its ease of assembly, portability and versatility show promise of increasing access to training opportunities worldwide. Take-home message Lap-Pack is an ultra-low-cost, portable laparoscopic simulator featuring compatibility with smart devices designed to help increase access to laparoscopic training worldwide. An international usability study found medical students, junior trainees and senior surgeons rated its usability and camera features highly, suggesting its employability as a laparoscopic training tool on a global scale.

Evaluation of Laparoscopy Virtual Reality Training on the Improvement of Trainees’ Surgical Skills

Background and objectives: The primary objective was to evaluate the benefit of training with virtual reality simulation. The secondary objective was to describe the short-term skill acquisition obtained by simulation training and to determine the factors affecting its magnitude. Materials and Methods: We prospectively performed a three-stage evaluation: face, constructive, and predictive to evaluate the training with a laparoscopic simulator with haptic feedback. The participants (n = 63) were divided according to their level of experience into three groups: 16% residents; 46% specialists and 38% were consultants. Results: Face evaluation demonstrates the acceptance of the design and realism of the tasks; it showed a median score of eight (IQR 3) on a Likert scale and 54% of participants (n = 34) gave the tissue feedback a moderate rating. Constructive evaluation demonstrates the improvement of the participants in the training session and the ability of the designed task to distinguish the experienced from the inexperienced surgeon based on the performance score, at task I (transfer of pegs) and II (laparoscopic salpingectomy). There was an improvement in both tasks with a significant increase in score and reduction in time. The study showed that those with a high score at the pre-test recorded a high score post-test, showing a significant pair-wise comparison (Z) and correlation (p) showing a significant statistical significance (p < 0.001). The predictive evaluation demonstrates the beneficiary effect of training four weeks afterward on the practice of surgeons addressed with five questions. It showed an improvement regarding implementation into daily routine, performance of procedure, suturing, shortening of the operative time, and complication management. Conclusions: Virtual reality simulation established high ratings for both realism and training capacity, including clinical relevance, critical relevance, and maintaining training enthusiasm.

Virtual Operating Room Simulation Setup (VORSS) for Procedural Training in Minimally Invasive Surgery – a Pilot Study

Virtual reality (VR) training is widely used in several minimal invasive surgery (MIS) training curricula for procedural training. However, VR training in its current state lack immersive training environments, such as using head-mounted displays that is implemented in military or aviation training and even entertainment. The virtual operating room simulation setup (VORSS) is explored in this study to determine the effectiveness of immersive training in MIS. Twenty-eight surgeons and surgical trainees performed a laparoscopic cholecystectomy on the VORSS comprising of a head-mounted 360-degree realistic OR surrounding on a VR laparoscopic simulator. The VORSS replicated a full setup of instruments and surgical team-members as well as some of the distractions occurring during surgical procedures. Questionnaires were followed by semi-structured interviews to collect the data. Experts and novices found the VORSS to be intuitive and easy to use (p = 0.001). The outcome of the usability test, applying QUESI and NASA-TLX, reflected the usability of the VORSS (p < 0.05), at the cognitive level, which indicates a good sense of immersion and satisfaction, when performing the procedure within VORSS. The need for personalized experience within the setup was strongly noted from most of the participants. The VORSS for procedural training has the potential to become a useful tool to provide immersive training in MIS surgery. Further optimizing of the VORSS realism and introduction of distractors in the OR should result in an improvement of the system.