scholarly journals Validation of NOViSE

2016 ◽  
Vol 24 (1) ◽  
pp. 55-65 ◽  
Author(s):  
Przemyslaw Korzeniowski ◽  
Daniel C. Brown ◽  
Mikael H. Sodergren ◽  
Alastair Barrow ◽  
Fernando Bello
Keyword(s):  
Construct Validity ◽  
Content Validity ◽  
Force Feedback ◽  
Performance Metrics ◽  
Face Validity ◽  
Task Completion ◽  
Training Tool ◽  
Surgical Trainees ◽  
Applied Forces ◽  
Strongly Agree

The goal of this study was to establish face, content, and construct validity of NOViSE—the first force-feedback enabled virtual reality (VR) simulator for natural orifice transluminal endoscopic surgery (NOTES). Fourteen surgeons and surgical trainees performed 3 simulated hybrid transgastric cholecystectomies using a flexible endoscope on NOViSE. Four of them were classified as “NOTES experts” who had independently performed 10 or more simulated or human NOTES procedures. Seven participants were classified as “Novices” and 3 as “Gastroenterologists” with no or minimal NOTES experience. A standardized 5-point Likert-type scale questionnaire was administered to assess the face and content validity. NOViSE showed good overall face and content validity. In 14 out of 15 statements pertaining to face validity (graphical appearance, endoscope and tissue behavior, overall realism), ≥50% of responses were “agree” or “strongly agree.” In terms of content validity, 85.7% of participants agreed or strongly agreed that NOViSE is a useful training tool for NOTES and 71.4% that they would recommend it to others. Construct validity was established by comparing a number of performance metrics such as task completion times, path lengths, applied forces, and so on. NOViSE demonstrated early signs of construct validity. Experts were faster and used a shorter endoscopic path length than novices in all but one task. The results indicate that NOViSE authentically recreates a transgastric hybrid cholecystectomy and sets promising foundations for the further development of a VR training curriculum for NOTES without compromising patient safety or requiring expensive animal facilities.

scholarly journals Hybrid Surgical Simulator: A Temporal Bone Simulator Validation Study of the Stryker Surgical Simulator (S3)

2020 ◽  
Vol 185 (11-12) ◽  
pp. e2026-e2031
Author(s):  
Charles Meyer ◽  
Francine Noda ◽  
Craig R Folsom
Keyword(s):  
Temporal Bone ◽  
Content Validity ◽  
Haptic Feedback ◽  
Surgical Simulation ◽  
Subjective Evaluation ◽  
Face Validity ◽  
Task Completion ◽  
Surgical Simulator ◽  
Surgical Performance ◽  
Training Tool

ABSTRACT Introduction The Stryker Surgical Simulator is a hybrid, temporal bone simulator that uses both tactile and haptic feedback combined with a computer interface. We sought to validate this simulator as an otolaryngology resident training tool for performing tympanomastoidectomy. Materials and Methods 15 residents and staff performed five basic cortical mastoidectomies. Staff surgeons comprised the “expert” cohort and resident surgeons comprised the “trainee” cohort. Subjective evaluation of the face validity and content validity was assessed via pre- and postquestionnaires. Objective evaluation of content validity was assessed through grading of each temporal bone dissection specimen, comparing time to task completion, and calculating the rate of injury to critical structures. Study approved by the Institutional Review Board (2013.0001). Results Post hoc questionnaires showed that both staff and residents subjectively rated the simulator favorably on face validity, content validity, and all global assessment categories, though there were no significant distinctions between groups (P > 0.05). The resident group had a significantly longer drilling time compared with the staff group throughout the series of tympanomastoidectomies (P = 0.008), and both groups showed a decrease in time to task completion with repetitive drilling. However, there were no significant differences in surgical performance as evaluated by a blinded senior neurotologist (P = 0.52). There were also no critical injuries recorded by the simulator in any of the 75 trials, preventing any evaluation on this measure. Conclusions Despite favorable subjective evaluations by both staff and residents, objective discrimination between experienced and novice participants was not achieved. This was likely in part due to inherent design flaws of the simulator. This emphasizes the potential shortcomings of surgical simulation models for highly technical procedures and points to the importance of intensive study and validation prior to incorporation of commercial training models into surgical training programs.

scholarly journals Validation of the da Vinci Surgical Skill Simulator across three surgical disciplines

2013 ◽  
Vol 7 (7-8) ◽  
pp. 520 ◽  
Author(s):  
Tarek Alzahrani ◽  
Richard Haddad ◽  
Abdullah Alkhayal ◽  
Josee Delisle ◽  
Laura Drudi ◽  
...  
Keyword(s):  
Construct Validity ◽  
General Surgery ◽  
Content Validity ◽  
Da Vinci ◽  
Wilcoxon Test ◽  
Face Validity ◽  
Training Tool ◽  
Level 1 ◽  
Board Level ◽  
Level 2

Objective: In this paper, we evaluate face, content and construct validity of the da Vinci Surgical Skills Simulator (dVSSS) across 3 surgical disciplines.Methods: In total, 48 participants from urology, gynecology and general surgery participated in the study as novices (0 robotic cases performed), intermediates (1-74) or experts (≥75). Each participant completed 9 tasks (Peg board level 2, match board level 2, needle targeting, ring and rail level 2, dots and needles level 1, suture sponge level 2, energy dissection level 1, ring walk level 3 and tubes). The Mimic Technologies software scored each task from 0 (worst) to 100 (best) using several predetermined metrics. Face and content validity were evaluated by a questionnaire administered after task completion. Wilcoxon test was used to perform pairwise comparisons.Results: The expert group comprised of 6 attending surgeons. The intermediate group included 4 attending surgeons, 3 fellows and 5 residents. The novices included 1 attending surgeon, 1 fellow, 13 residents, 13 medical students and 2 research assistants. The median number of robotic cases performed by experts and intermediates were 250 and 9, respectively. The median overall realistic score (face validity) was 8/10. Experts rated the usefulness of the simulator as a training tool for residents (content validity) as 8.5/10. For construct validity, experts outperformed novices in all 9 tasks (p < 0.05). Intermediates outperformed novices in 7 of 9 tasks (p < 0.05); there were no significant differences in the energy dissection and ring walk tasks. Finally, experts scored significantly better than intermediates in only 3 of 9 tasks (matchboard, dots and needles and energy dissection) (p < 0.05).Conclusions: This study confirms the face, content and construct validities of the dVSSS across urology, gynecology and general surgery. Larger sample size and more complex tasks are needed to further differentiate intermediates from experts.

scholarly journals Validity and Reliability of the Scale, Role Taking in Caregivers of People with Chronic Disease, ROL

10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro
Keyword(s):  
Factor Analysis ◽  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Three Dimensions ◽  
Face Validity ◽  
Validity And Reliability ◽  
Role Taking ◽  
Phase Study

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.

Development and Validation of a Three-Dimensional Printed Training Model to Teach Ultrasound-Guided Injections of the Cervical Articular Process Joints in Horses

2021 ◽  
pp. e20200137
Author(s):  
Alexandra Beaulieu ◽  
Stephanie Nykamp ◽  
John Phillips ◽  
Luis G. Arroyo ◽  
Judith Koenig ◽  
...  
Keyword(s):  
Construct Validity ◽  
Content Validity ◽  
Three Dimensional ◽  
Joint Space ◽  
Needle Placement ◽  
Ultrasound Guided ◽  
Training Tool ◽  
Articular Process ◽  
The Face ◽  
3D Printed

Intra-articular injections are routinely performed to alleviate pain and inflammation associated with osteoarthritis in horses. Intra-articular injections require accurate needle placement to optimize clinical outcomes and minimize complications. This study’s objectives were to develop and validate a three-dimensional (3D) printed model of an equine cervical articular process joint to teach ultrasound-guided injections. Five identical models of an equine cervical articular process joint were 3D printed and embedded in 10% ballistic gelatin. Experts’ and novices’ ability to successfully insert a needle into the joint space of the model using ultrasound guidance was assessed and graded using an objective structured clinical examination (OSCE). Scores from experts and novices were compared to evaluate the construct validity of the model. Participants also answered a survey assessing the face and content validity of the model. Experts required less time (22.51 seconds) for correct needle placement into the model joint space than novices (35.96 seconds); however, this difference was not significant ( p = .53). Experts’ median total OSCE score (14) was significantly higher ( p = .03) than novices’ (12), supporting the model’s construct validity. Participants agreed on the face and content validity of the model by grading all survey questions greater than 7 on a 10-point Likert-type scale. In summary, we successfully developed a 3D printed model of an equine cervical articular process joint, partially demonstrated the construct validity of the model, and proved the face and content validity of this new training tool.

scholarly journals Development and validation of a nutrition knowledge questionnaire for a Canadian population

2016 ◽  
Vol 20 (7) ◽  
pp. 1184-1192 ◽  
Author(s):  
Maude Bradette-Laplante ◽  
Élise Carbonneau ◽  
Véronique Provencher ◽  
Catherine Bégin ◽  
Julie Robitaille ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Content Validity ◽  
Covariance Structure ◽  
Nutrition Knowledge ◽  
Face Validity ◽  
Covariance Structure Analysis ◽  
Knowledge Questionnaire ◽  
Canadian Population ◽  
Test Retest Reliability

AbstractObjectiveThe present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines.DesignA thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test–retest reliability were evaluated through a validation study.SettingOnline survey.SubjectsSix nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated.ResultsContent validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RDv. non-RD (21·5 (sd2·1)v. 15·7 (sd3·0) out of 24,P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach’sα=0·73). Assessment of test–retest reliability resulted in significant associations for the total knowledge score (r=0·59,P<0·001).ConclusionsThis nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.

scholarly journals A Study on the Status of Error Reporting Cultures among Nurses in Medical Sciences Hospitals of Islamic Azad University

2018 ◽  
Vol 4 (1) ◽  
Author(s):  
Abasat Mirzaei ◽  
Zeinab Abbasi ◽  
Sima Safarzadeh
Keyword(s):  
Construct Validity ◽  
Content Validity ◽  
Work Experience ◽  
Pearson Correlation ◽  
Face Validity ◽  
Error Reporting ◽  
Cronbach’S Alpha ◽  
Cross Sectional ◽  
Cronbach's Alpha ◽  
The Status

Background:One of the goals of nursing is to provide safe patient care and medical errors are one of the most important threats in this field.Therefore, the purpose of this study is to assess the status of error reporting culture and determine its relationship with demographic characteristics.Methods:This descriptive,analytical and cross-sectional study was carried out among 239 nurses of amiralmomenin and bouali hospitals. First,face validity and then content validity were performed by 15 nursing experts and the questionnaire was distributed and collected. The normal distribution of data was confirmed by Kolmogorov-Smirnov test. The reliability and construct validity were performed with Cronbach’s Alpha test and exploratory factor analysis by PCM.The status of reporting culture was determined by computing descriptive statistics and its relation with demographic variables with Pearson correlation test and logistic regression test with SPSS software version 16.Results:The content validity with CVR &CVI of 0.820 and 0.920 were confirmed. The reporting culture was favorable with a mean and standard deviation of 2.674 and 0.475.The reliability with Cronbach's alpha of 0.747 and the construct validity with a KMO of 0.727 and Significance of the Bartlett test were confirmed and 3 subscales were extracted. The relationship between age and work experience with the reporting culture with a correlation of 0.009 and 0.013 with a significant < 0.05 were rejected But with the variable of gender(=female) with a chance of 2.536 and the significant of 0.006 was confirmed.Conclusion:Developing a safety culture in hospitals by implementing various health programs improves the reporting culture,but the mental climate is undesirable and requires major steps to reduce worries and negative outcomes after reporting.The presence of female nurses in comparison with men improves the error reporting culture.Perhaps the main reason is patriarchy in Iranian culture.

scholarly journals A high-fidelity, virtual reality, transurethral resection of bladder tumor simulator: Validation as a tool for training

2021 ◽  
Vol 16 (4) ◽  
Author(s):  
Jonathan Moore ◽  
Stewart Whalen ◽  
Neal Rowe ◽  
Jason Lee ◽  
Michael Ordon ◽  
...  
Keyword(s):  
Construct Validity ◽  
Transurethral Resection ◽  
Content Validity ◽  
Bladder Tumor ◽  
Strong Support ◽  
Face Validity ◽  
Video Recordings ◽  
The Face ◽  
Hands And Feet ◽  
Key Steps

Introduction: Simulation-based training is used to help trainees learn surgical procedures in a safe environment. The objective of our study was to test the face, content, and construct validity of the transurethral resection of bladder tumor (TURBT) module built on the Simbionix TURP Mentor simulator. Methods: Participants performed five standardized cases on the simulator. Domains of the simulator were evaluated on a five-point Likert scale to establish face and content validity. Construct validity was assessed through the simulator's built-in scoring metrics, as well as video recordings of the simulator screen and an anonymized view of participants' hands and feet, which were evaluated using an objective structured assessment of technical skills (OSATS) tool. Results: Ten experienced operators and 15 novices participated. Face validity was somewhat acceptable (mean realism 3.8/5±1.03 standard deviation [SD]; mean appearance 4.1/5±0.57), as was content validity, represented by simulation of key steps (mean 3.9±0.57). The simulator failed to achieve construct validity. There was no difference in mean simulator scores or OSATS scoring between experienced operators and novices. Novices significantly improved their mean simulator scores (305.9 vs. 332.4, p=0.006) and OSATS scoring (15.8 vs. 18.1, p=0.001), while 87% felt their confidence to perform TURBT improved. Overall, 92% of participants agreed that the simulator should be incorporated into residency training. Conclusions: Our study suggests a role for the TURBT module of the Simbionix TURP Mentor simulator as an introduction to TURBT for urology trainees. Strong support was found from both experienced operators and novices for its formal inclusion in resident education.

scholarly journals Validation of martyn to simulate the keyhole supraorbital subfrontal approach

2014 ◽  
Vol 96 (4) ◽  
pp. 120-121 ◽  
Author(s):  
Hani J Marcus ◽  
Archie Hughes-Hallett ◽  
Philip Pratt ◽  
Guang-Zhong Yang ◽  
Ara Darzi ◽  
...  
Keyword(s):  
Construct Validity ◽  
Royal College ◽  
Validation Study ◽  
Content Validity ◽  
Face Validity ◽  
Great Success ◽  
Surgical Experience ◽  
Vascular Tree ◽  
Subfrontal Approach

The Modelled Anatomical Replica for Training Young Neurosurgeons (MARTYN) has been created by the conservation team at The Royal College of Surgeons of England to simulate traumatic pathologies (such as extradural haemorrhage) and has been used with great success at relevant workshops. A modified MARTYN head has recently been developed that incorporates a vascular tree and pathology, allowing for the simulation of the keyhole supraorbital subfrontal approach. 1 Here we present a short validation study assessing its realism (face validity), usefulness (content validity) and ability to differentiate levels of surgical experience (construct validity).

scholarly journals The Development of the Text Evaluation Scale for Child Rights: A Study of Validity and Reliability

2018 ◽  
Vol 8 (5) ◽  
pp. 139
Author(s):  
Yusuf Söylemez
Keyword(s):  
Construct Validity ◽  
Content Validity ◽  
Sample Selection ◽  
Factor Loading ◽  
Face Validity ◽  
Main Study ◽  
Validity And Reliability ◽  
Child Rights ◽  
Cronbach Alpha ◽  
The Face

This study was conducted with the aim of developing The Text Evaluation Scale for Child Rights. There are fourdifferent sample chosen for the face validity, content validity and construct validity (for pilot scheme and main study)of the study. For face validity, a sample group of 3 experts chosen with the method of purposeful sampling includingthe researcher was formed. For content validity, snowball method was determined and studied with 12 experts. Forthe study of construct validity, random sampling method was performed for the sample selection in pilot studyinvolving 120 people and in main study involving 510 people.The theoretical framework of the scale was determined by means of the attempts, conventions, studies regarding thesubject basing upon the United Nations Organization Child Rights Convention and additional protocols to thisconvention. One could get minimum 40 and maximum 200 points from the five-point Likert scale which consists of28 positive and 12 negative (total 40) items. The scale has two sub-dimensions which are content and author. Thefact that Cronbach Alpha reliability coefficient is high regarding the sub-dimensions of the scale (authorsub-dimension= 0,822 content sub-dimension= 0,834) shows that the items in the sub-dimensions are consistent withone another. Cronbach Alpha value for the whole of the scale was determined as 0,90 which means that the scale ishighly reliable. Besides, in the scale, there are items of which factor loading value is higher than 0,45. When validityand reliability results are examined, it can be seen that the scale could be utilized to evaluate the text in terms ofbeing suitable for the child rights.

scholarly journals Development and Validation of Nine Deprescribing Algorithms for Patients on Hemodialysis to Decrease Polypharmacy

2020 ◽  
Vol 7 ◽  
pp. 205435812096867
Author(s):  
Melissa J. Lefebvre ◽  
Patrick C. K. Ng ◽  
Arlene Desjarlais ◽  
Dennis McCann ◽  
Blair Waldvogel ◽  
...  
Keyword(s):  
Nurse Practitioners ◽  
Content Validity ◽  
Clinical Decision Making ◽  
Clinical Decision ◽  
Face Validity ◽  
Specific Patient ◽  
Expert Opinions ◽  
Safety Parameters ◽  
Clinical Tools ◽  
Strongly Agree

Background: Polypharmacy is ubiquitous in patients on hemodialysis (HD), and increases risk of adverse events, medication interactions, nonadherence, and mortality. Appropriately applied deprescribing can potentially minimize polypharmacy risks. Existing guidelines are unsuitable for nephrology clinicians as they lack specific instructions on how to deprescribe and which safety parameters to monitor. Objective: To develop and validate deprescribing algorithms for nine medication classes to decrease polypharmacy in patients on HD. Design: Questionnaires and materials sent electronically. Participants: Nephrology practitioners across Canada (nephrologists, nurse practitioners, renal pharmacists). Methods: A literature search was performed to develop the initial algorithms via Lynn’s method for development of content-valid clinical tools. Content and face validity of the algorithms was evaluated over three interview rounds using Lynn’s method for determining content validity. Canadian nephrology clinicians each evaluated three algorithms (15 clinicians per round, 45 clinicians in total) by rating each algorithm component on a four-point Likert scale for relevance; face validity was rated on a five-point scale. After each round, content validity index of each component was calculated and revisions made based on feedback. If content validity was not achieved after three rounds, additional rounds were completed until content validity was achieved. Results: After three rounds of validation, six algorithms achieved content validity. After an additional round, the remaining three algorithms achieved content validity. The proportion of clinicians rating each face validity statement as “Agree” or “Strongly Agree” ranged from 84% to 95% (average of all five questions, across three rounds). Limitations: Algorithm development was guided by existing deprescribing protocols intended for the general population and the expert opinions of our study team, due to a lack of background literature on HD-specific deprescribing protocols. There is no universally accepted method for the validation of clinical decision-making tools. Conclusions: Nine medication-specific deprescribing algorithms for patients on HD were developed and validated by clinician review. Our algorithms are the first medication-specific, patient-centric deprescribing guidelines developed and validated for patients on HD.

Sign in / Sign up

Export Citation Format

Share Document