scholarly journals A high-fidelity, virtual reality, transurethral resection of bladder tumor simulator: Validation as a tool for training

2021 ◽  
Vol 16 (4) ◽  
Author(s):  
Jonathan Moore ◽  
Stewart Whalen ◽  
Neal Rowe ◽  
Jason Lee ◽  
Michael Ordon ◽  
...  

Introduction: Simulation-based training is used to help trainees learn surgical procedures in a safe environment. The objective of our study was to test the face, content, and construct validity of the transurethral resection of bladder tumor (TURBT) module built on the Simbionix TURP Mentor simulator. Methods: Participants performed five standardized cases on the simulator. Domains of the simulator were evaluated on a five-point Likert scale to establish face and content validity. Construct validity was assessed through the simulator's built-in scoring metrics, as well as video recordings of the simulator screen and an anonymized view of participants' hands and feet, which were evaluated using an objective structured assessment of technical skills (OSATS) tool. Results: Ten experienced operators and 15 novices participated. Face validity was somewhat acceptable (mean realism 3.8/5±1.03 standard deviation [SD]; mean appearance 4.1/5±0.57), as was content validity, represented by simulation of key steps (mean 3.9±0.57). The simulator failed to achieve construct validity. There was no difference in mean simulator scores or OSATS scoring between experienced operators and novices. Novices significantly improved their mean simulator scores (305.9 vs. 332.4, p=0.006) and OSATS scoring (15.8 vs. 18.1, p=0.001), while 87% felt their confidence to perform TURBT improved. Overall, 92% of participants agreed that the simulator should be incorporated into residency training. Conclusions: Our study suggests a role for the TURBT module of the Simbionix TURP Mentor simulator as an introduction to TURBT for urology trainees. Strong support was found from both experienced operators and novices for its formal inclusion in resident education.

2018 ◽  
Vol 8 (5) ◽  
pp. 139
Author(s):  
Yusuf Söylemez

This study was conducted with the aim of developing The Text Evaluation Scale for Child Rights. There are fourdifferent sample chosen for the face validity, content validity and construct validity (for pilot scheme and main study)of the study. For face validity, a sample group of 3 experts chosen with the method of purposeful sampling includingthe researcher was formed. For content validity, snowball method was determined and studied with 12 experts. Forthe study of construct validity, random sampling method was performed for the sample selection in pilot studyinvolving 120 people and in main study involving 510 people.The theoretical framework of the scale was determined by means of the attempts, conventions, studies regarding thesubject basing upon the United Nations Organization Child Rights Convention and additional protocols to thisconvention. One could get minimum 40 and maximum 200 points from the five-point Likert scale which consists of28 positive and 12 negative (total 40) items. The scale has two sub-dimensions which are content and author. Thefact that Cronbach Alpha reliability coefficient is high regarding the sub-dimensions of the scale (authorsub-dimension= 0,822 content sub-dimension= 0,834) shows that the items in the sub-dimensions are consistent withone another. Cronbach Alpha value for the whole of the scale was determined as 0,90 which means that the scale ishighly reliable. Besides, in the scale, there are items of which factor loading value is higher than 0,45. When validityand reliability results are examined, it can be seen that the scale could be utilized to evaluate the text in terms ofbeing suitable for the child rights.


2021 ◽  
pp. 1-6
Author(s):  
Sana Hussain ◽  
Roshan-e Shahid Rana ◽  
M. Hammad Ather

<b><i>Objective:</i></b> To validate the in-house built Styrofoam box bench-top training model for retrograde intrarenal surgery (RIRS). <b><i>Materials and Methods:</i></b> This study was performed in the setting of a half-day RIRS course. During the course, participants performed RIRS on a locally built bench-top model. We recruited 26 participants, comprising 20 trainees and 6 experts. Trainees and experts were asked to fill a self-administered questionnaire assessing various components of RIRS to assess the face and content validity. For construct validity, experts using Objective Structured Assessment of Technical Skills (OSATS) rated trainees and the mean OSATS score of junior versus senior residents was compared. <b><i>Results:</i></b> As per trainees, the model was 86% (4.3/5) realistic, which was backed by experts who found this model to be 87.6% (4.38/5) realistic. The overall face validity of the model was 86.4% (4.32/5). The overall content validity of this model was 83.4% (4.17/5). Majority of the participants thought that this tool is useful for learning technique (4.38 ± 0.49) and safe-conduct (4.31 ± 0.73) of the procedure. The trainees concurred that the skills acquired are transferable to the operating room (4.23 ± 0.76). However, the construct validity by comparing mean OSATS score of junior versus senior residents was 19.5 ± 3.5 and 23 ± 4.5. A <i>p</i> value of 0.11 could not be established. <b><i>Conclusion:</i></b> This study has demonstrated the face, content, and construct validity of the bench-top training model for RIRS. Further evaluation is necessary to compare its effectiveness against other available models to demonstrate concurrent validity.


2021 ◽  
pp. 019459982110328
Author(s):  
Tobias Albrecht ◽  
Christoph Nikendei ◽  
Mark Praetorius

Objective Otologic diseases are common in all age groups and can significantly impair the function of this important sensory organ. To make a correct diagnosis, the correct handling of the otoscope and a correctly performed examination are essential. A virtual reality simulator could make it easier to teach this difficult-to-teach skill. The aim of this study was to assess the face, content, and construct validity of the novel virtual reality otoscopy simulator and the applicability to otologic training. Study Design Face and content validity was assessed with a questionnaire. Construct validity was assessed in a prospectively designed controlled trial. Setting Training for medical students at a tertiary referral center. Method The questionnaire used a 6-point Likert scale. The otoscopy was rated with a modified Objective Structured Assessment of Technical Skills. Time to complete the task and the percentage of the assessed eardrum surface were recorded. Results The realism of the simulator and the applicability to medical training were assessed across several items. The ratings suggested good face and content validity as well as usefulness and functionality of the simulator. The otolaryngologists significantly outperformed the student group in all categories measured (P < .0001), suggesting construct validity of the simulator. Conclusion In this study, we could demonstrate face, content, and construct validity for a novel high-fidelity virtual reality otoscopy simulator. The results encourage the use of the otoscopy simulator as a complementary tool to traditional teaching methods in a curriculum for medical students.


2020 ◽  
Vol 46 (5) ◽  
pp. 373-377
Author(s):  
Ahsan Rafi ◽  
◽  
Wajahat Aziz ◽  
Mohammad H. Ather ◽  
◽  
...  

10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.


2021 ◽  
pp. e20200137
Author(s):  
Alexandra Beaulieu ◽  
Stephanie Nykamp ◽  
John Phillips ◽  
Luis G. Arroyo ◽  
Judith Koenig ◽  
...  

Intra-articular injections are routinely performed to alleviate pain and inflammation associated with osteoarthritis in horses. Intra-articular injections require accurate needle placement to optimize clinical outcomes and minimize complications. This study’s objectives were to develop and validate a three-dimensional (3D) printed model of an equine cervical articular process joint to teach ultrasound-guided injections. Five identical models of an equine cervical articular process joint were 3D printed and embedded in 10% ballistic gelatin. Experts’ and novices’ ability to successfully insert a needle into the joint space of the model using ultrasound guidance was assessed and graded using an objective structured clinical examination (OSCE). Scores from experts and novices were compared to evaluate the construct validity of the model. Participants also answered a survey assessing the face and content validity of the model. Experts required less time (22.51 seconds) for correct needle placement into the model joint space than novices (35.96 seconds); however, this difference was not significant ( p = .53). Experts’ median total OSCE score (14) was significantly higher ( p = .03) than novices’ (12), supporting the model’s construct validity. Participants agreed on the face and content validity of the model by grading all survey questions greater than 7 on a 10-point Likert-type scale. In summary, we successfully developed a 3D printed model of an equine cervical articular process joint, partially demonstrated the construct validity of the model, and proved the face and content validity of this new training tool.


2013 ◽  
Vol 21 (2) ◽  
pp. 610-617 ◽  
Author(s):  
Lillian Dias Castilho Siqueira ◽  
Maria Helena Larcher Caliri ◽  
Beatrice Kalisch ◽  
Rosana Aparecida Spadoti Dantas

OBJECTIVE: The aims of this methodological research were to culturally adapt the MISSCARE Survey instrument to Brazil and analyze the internal consistency of the adapted version. METHOD: The instrument consists of 41 items, presented in two parts. Part A contains 24 items listing elements of missed nursing care. Part B is comprised of 17 items, related to the reasons for not delivering care. The research received ethics committee approval and was undertaken in two phases. The first was the cultural adaptation process, in which a committee of five experts verified the face and content validity, in compliance with the steps recommended in the literature. The second was aimed at analyzing the internal consistency of the instrument, involving 60 nursing team professionals at a public teaching hospital. RESULTS: According to the experts, the instrument demonstrated face and content validity. Cronbach's alpha coefficients for parts A and B surpassed 0.70 and were considered appropriate. CONCLUSION: The adapted version of the MISSCARE Survey demonstrated satisfactory face validity and internal consistency for the study sample.


Blood ◽  
2013 ◽  
Vol 122 (21) ◽  
pp. 2961-2961 ◽  
Author(s):  
Nitya Bakshi ◽  
Jennifer Stinson ◽  
Ines Lukombo ◽  
Diana Ross ◽  
Nonita Mittal ◽  
...  

Abstract Background Pain is the hallmark of sickle cell disease (SCD) but burden of pain is underestimated when measured using health care visits for vaso-occlusive crisis. In the PiSCES study adult patients reported pain on > 50% of diary days but sought care on only 3.5 % of diary days. Accurate assessment of the burden of pain and related morbidity is crucial in clinical care and research studies in SCD. Paper based pain diaries for assessing daily pain are limited by recall bias, errors, inflated retrospective reports and falsely high compliance due to backfilling of entries. Electronic pain diaries facilitate real-time data capture, are convenient, prevent backfilling, maximize compliance and facilitate data management. They have been used in children with arthritis, cancer, abdominal and musculoskeletal pain but no validated instrument is available for use in children with SCD. Objective To develop, establish the face and content validity, and usability of a novel web-based multidimensional electronic pain diary for children and adolescents with SCD. Methods Needs assessment: Pediatric subjects in a pilot SCD pain intensity diary study participated in qualitative interviews to assess their preferences regarding an electronic pain diary. Instrument development: Items for the pain diary were adapted for SCD from “e-Ouch”(c), an electronic pain diary validated for use in children with arthritis. Items assess pain intensity, duration, interference with daily tasks, sleep, fatigue, precipitating factors, pain relieving treatments and response to treatments using the Numerical Rating Scale (0-10). We created a web-based pain diary that can be accessed via a secure website using a smartphone or computer. Face validity: Experts in SCD, pain and psychometrics rated the items on a 5 point Likert scale for content, language, clinical relevance, comprehensiveness of answer choices and likely feasibility and acceptability in children with SCD. Two iterative cycles of expert review were conducted and were used for modification of items. Content validity: Using items with established face validity, two iterative cycles of testing (n=5 each) with paper screenshots of questions using semi-structured cognitive interviewing techniques were done in pediatric patients age 15-22 with SCD. Preliminary usability testing: Participants age 9-21(n=5) pilot tested the web-based electronic pain diary on a computer, smartphone and tablet. They were asked to recall their current pain and pain in the prior 12 hours while answering the diary questions. The usability testing was followed by semi-structured interviews. Results Needs assessment: Patients indicated that electronic monitoring of pain could facilitate coordination of care, communication with providers and early intervention and that twice daily electronic documentation of pain would not pose an unacceptable burden. Face validity: Items were reviewed by 15 experts in the first iterative cycle and 12 experts in the second iterative cycle and were modified for language, content and relevance; 2 items were deleted and 1 item was added. Content Validity: During the first iterative cycle, participants identified items that were difficult to understand, ambiguous or irrelevant. Number of items was reduced from 18 to 13. During the second iterative cycle, one repetitive item was removed and others minimally modified. To minimize user burden items were redistributed so pain intensity, location, quality and precipitating factors were asked twice daily; effect of pain on sleep was asked in the morning and pain interference with daily activities, mood, school and interactions and clinical management items were asked in the evening. Usability testing: Participants were easily able to navigate between questions, use the 0-10 NRS slider, select affected areas on the body image and select checkbox options and provided positive feedback on the question content and, layout of the diary, ease of its use and preference for accessing it from a smartphone. Conclusions This study established the face and content validity and usability of a web-based multidimensional electronic pain diary developed for use in children with SCD. This instrument can be used to assess pain as a patient reported outcome in clinical trials, to enhance communication in clinical care and as a comprehensive measure of pain phenotype in mechanistic studies. Disclosures: No relevant conflicts of interest to declare.


2016 ◽  
Vol 20 (7) ◽  
pp. 1184-1192 ◽  
Author(s):  
Maude Bradette-Laplante ◽  
Élise Carbonneau ◽  
Véronique Provencher ◽  
Catherine Bégin ◽  
Julie Robitaille ◽  
...  

AbstractObjectiveThe present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines.DesignA thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test–retest reliability were evaluated through a validation study.SettingOnline survey.SubjectsSix nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated.ResultsContent validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RDv. non-RD (21·5 (sd2·1)v. 15·7 (sd3·0) out of 24,P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach’sα=0·73). Assessment of test–retest reliability resulted in significant associations for the total knowledge score (r=0·59,P<0·001).ConclusionsThis nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.


Author(s):  
Abasat Mirzaei ◽  
Zeinab Abbasi ◽  
Sima Safarzadeh

Background:One of the goals of nursing is to provide safe patient care and medical errors are one of the most important threats in this field.Therefore, the purpose of this study is to assess the status of error reporting culture and determine its relationship with demographic characteristics.Methods:This descriptive,analytical and cross-sectional study was carried out among 239 nurses of amiralmomenin and bouali hospitals. First,face validity and then content validity were performed by 15 nursing experts and the questionnaire was distributed and collected. The normal distribution of data was confirmed by Kolmogorov-Smirnov test. The reliability and construct validity were performed with Cronbach’s Alpha test and exploratory factor analysis by PCM.The status of reporting culture was determined by computing descriptive statistics and its relation with demographic variables with Pearson correlation test and logistic regression test with SPSS software version 16.Results:The content validity with CVR &CVI of 0.820 and 0.920 were confirmed. The reporting culture was favorable with a mean and standard deviation of 2.674 and 0.475.The reliability with Cronbach's alpha of 0.747 and the construct validity with a KMO of 0.727 and Significance of the Bartlett test were confirmed and 3 subscales were extracted. The relationship between age and work experience with the reporting culture with a correlation of 0.009 and 0.013 with a significant < 0.05 were rejected But with the variable of gender(=female) with a chance of 2.536 and the significant of 0.006 was confirmed.Conclusion:Developing a safety culture in hospitals by implementing various health programs improves the reporting culture,but the mental climate is undesirable and requires major steps to reduce worries and negative outcomes after reporting.The presence of female nurses in comparison with men improves the error reporting culture.Perhaps the main reason is patriarchy in Iranian culture.


Sign in / Sign up

Export Citation Format

Share Document