Preliminary assessment of two novel mechanical colonoscopic polypectomy simulators: Description, evaluation and validation

Abstract Background and study aims Colonoscopic polypectomy is an essential endoscopic skill. The simulators available for training are limited and based on raw porcine colons. Animal intestines are inconvenient and offer limited advantages for polypectomy training. These limitations are avoided by two novel mechanical simulators — the magnetic system based simulator (MSPS) and the simulator for polypectomy with high frequency current (HFPS) — described here. They are equipped to demonstrate self-repair of polyps after making a cut and hybrid polyps. The aim of this study was to describe and establish face, content, and construct validity of the two simulators and to assess their perceived utility as training and assessment tools. Methods Ten novice, seven intermediate, and 10 advanced endoscopists participated in this study. Each one performed two polypectomies in MSPS and then one polypectomy and polyp retrieval in HFPS. The median times were compared among the three groups to preliminarily assess construct validity as a primary outcome. To establish face validity, the novices and intermediates completed a questionnaire about the credibility of each simulator after finishing the tasks. For content validity, the experts completed a questionnaire grading different aspects of the simulators’ realism and their usefulness for training. Results All 27 participants completed the modules. Median times needed to complete the tasks in both simulators differed significantly between the participants with different levels of experience (P < 0.05). Both MSPS and HFPS received favorable scores regarding face and content validity. No technical problems were encountered. Conclusion This study provides preliminary validation for MSPS and HFPS as useful training tools in a preclinical setting as well as during colonoscopy training. Moreover, we demonstrated the construct validity of both simulators, which confirms their use as a skill assessment tool during a colonoscopy training program.

Download Full-text

Urdu Translation and Validation of Activities-Specific Balance Confidence (ABC) Scale

10.53350/pjmhs2115123505 ◽

2021 ◽

Vol 15 (12) ◽

pp. 3505-3508

Author(s):

Noor Ul Ain Fatima ◽

Qurat-Ul- Ain ◽

Fareeha Kausar ◽

Mian Ali Raza ◽

Misbah Waris ◽

...

Keyword(s):

Older Adults ◽

Construct Validity ◽

Correlation Coefficient ◽

Content Validity ◽

Assessment Tool ◽

Test Reliability ◽

Validity And Reliability ◽

A Value ◽

Abc Scale ◽

Translation And Validation

Objective: To translate and validate the ABC-Scale in Urdu language to predict risk of fall in older population. Study design: Cross-cultural Translation and validation Place and Duration: Study was conducted in older adult community of Sialkot from March 2020 to December 2020. Methodology: Translation of ABC in Urdu was conducted by using Beaton et al guidelines. Two bilingual translators translated the original version into Urdu language step wise, correction process was followed. Then two backward translations were done by language expert. After all this process, the translated version was reviewed by the professionals and the final version was applied on 15 individuals. Its reliability and validity was tested on 60 older adults. Results: For test re test reliability, intra class correlation coefficient ICC was measured with a value of 0.984 Which shows good test re-test reliability. The internal consistency and reliability of ABC was calculated by Cronbach’s alpha for total score with a value of 0.985. Content validity was good with values of CVI ranging from 0.767 to 0.955. To test the discriminative validity, independent t test was used to show the difference between the healthy and unhealthy adults. Factor analysis of UABC showed total variance 81.277 and cumulative variance was also 81.277. To calculate construct validity of U-ABC Pearson’s correlation coefficient was used and measured as 0.558. Conclusion: It was concluded that Urdu version of UABC is a valid assessment tool for older adults with fear of fall. It has good content validity, construct validity and reliability. Keywords: activities specific balance scale, validation, Urdu translation, reliability, tool translation

Download Full-text

Validity and Reliability of the Scale, Role Taking in Caregivers of People with Chronic Disease, ROL

International Archives of Medicine ◽

10.3823/2575 ◽

2018 ◽

Vol 11 ◽

Author(s):

Mauricio Arias ◽

Sonia Carreño ◽

Lorena Chaparro

Keyword(s):

Factor Analysis ◽

Chronic Disease ◽

Construct Validity ◽

Internal Consistency ◽

Content Validity ◽

Three Dimensions ◽

Face Validity ◽

Validity And Reliability ◽

Role Taking ◽

Phase Study

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.

Download Full-text

Ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) for trabeculectomy

BMJ Open Ophthalmology ◽

10.1136/bmjophth-2019-000313 ◽

2019 ◽

Vol 4 (1) ◽

pp. e000313 ◽

Cited By ~ 2

Author(s):

William H Dean ◽

John Buchan ◽

Fisseha Admassu ◽

Min J Kim ◽

Karl C Golnik ◽

...

Keyword(s):

Content Validity ◽

Assessment Tool ◽

Interobserver Reliability ◽

Glaucoma Surgery ◽

Face Validity ◽

Competency Assessment ◽

Validity And Reliability ◽

Wilcoxon Rank Sum Test ◽

Better Than ◽

Assessment Rubric

Background/aimsTo develop, test and determine whether a surgical-competency assessment tool for simulated glaucoma surgery is valid.MethodsThe trabeculectomy ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) was assessed for face and content validity with a large international group of expert eye surgeons. Cohorts of novice and competent surgeons were invited to perform anonymised simulation trabeculectomy surgery, which was marked using the Sim-OSSCAR in a masked fashion by a panel of four expert surgeons. Construct validity was assessed using a Wilcoxon rank-sum test. Krippendorff’s alpha was calculated for interobserver reliability.ResultsFor the Sim-OSSCAR for trabeculectomy, 58 of 67 surgeons (86.6%) either agreed or strongly agreed that the Sim-OSSCAR is an appropriate way to assess trainees’ surgical skill. Face validity was rated as 4.04 (out of 5.00). Fifty-seven of 71 surgeons (80.3%) either agreed or strongly agreed that the Sim-OSSCAR contents represented the surgical technique of surgical trabeculectomy. Content validity was rated as 4.00. Wilcoxon rank-sum test showed that competent surgeons perform better than novices (p=0.02). Interobserver reliability was rated >0.60 (Krippendorff’s alpha) in 19 of 20 steps of the Sim-OSSCAR.ConclusionThe Sim-OSSCAR for trabeculectomy, a newly developed and validated assessment tool for simulation glaucoma surgery, has validity and reliability. It has the potential to play a useful role in ophthalmic surgical education.

Download Full-text

Development and validation of a nutrition knowledge questionnaire for a Canadian population

Public Health Nutrition ◽

10.1017/s1368980016003372 ◽

2016 ◽

Vol 20 (7) ◽

pp. 1184-1192 ◽

Cited By ~ 16

Author(s):

Maude Bradette-Laplante ◽

Élise Carbonneau ◽

Véronique Provencher ◽

Catherine Bégin ◽

Julie Robitaille ◽

...

Keyword(s):

Factor Analysis ◽

Construct Validity ◽

Content Validity ◽

Covariance Structure ◽

Nutrition Knowledge ◽

Face Validity ◽

Covariance Structure Analysis ◽

Knowledge Questionnaire ◽

Canadian Population ◽

Test Retest Reliability

AbstractObjectiveThe present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines.DesignA thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test–retest reliability were evaluated through a validation study.SettingOnline survey.SubjectsSix nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated.ResultsContent validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RDv. non-RD (21·5 (sd2·1)v. 15·7 (sd3·0) out of 24,P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach’sα=0·73). Assessment of test–retest reliability resulted in significant associations for the total knowledge score (r=0·59,P<0·001).ConclusionsThis nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.

Download Full-text

A Study on the Status of Error Reporting Cultures among Nurses in Medical Sciences Hospitals of Islamic Azad University

Internal Medicine And Medical Investigation Journal ◽

10.24200/imminv.v2i4.193 ◽

2018 ◽

Vol 4 (1) ◽

Author(s):

Abasat Mirzaei ◽

Zeinab Abbasi ◽

Sima Safarzadeh

Keyword(s):

Construct Validity ◽

Content Validity ◽

Work Experience ◽

Pearson Correlation ◽

Face Validity ◽

Error Reporting ◽

Cronbach’S Alpha ◽

Cross Sectional ◽

Cronbach's Alpha ◽

The Status

Background:One of the goals of nursing is to provide safe patient care and medical errors are one of the most important threats in this field.Therefore, the purpose of this study is to assess the status of error reporting culture and determine its relationship with demographic characteristics.Methods:This descriptive,analytical and cross-sectional study was carried out among 239 nurses of amiralmomenin and bouali hospitals. First,face validity and then content validity were performed by 15 nursing experts and the questionnaire was distributed and collected. The normal distribution of data was confirmed by Kolmogorov-Smirnov test. The reliability and construct validity were performed with Cronbach’s Alpha test and exploratory factor analysis by PCM.The status of reporting culture was determined by computing descriptive statistics and its relation with demographic variables with Pearson correlation test and logistic regression test with SPSS software version 16.Results:The content validity with CVR &CVI of 0.820 and 0.920 were confirmed. The reporting culture was favorable with a mean and standard deviation of 2.674 and 0.475.The reliability with Cronbach's alpha of 0.747 and the construct validity with a KMO of 0.727 and Significance of the Bartlett test were confirmed and 3 subscales were extracted. The relationship between age and work experience with the reporting culture with a correlation of 0.009 and 0.013 with a significant < 0.05 were rejected But with the variable of gender(=female) with a chance of 2.536 and the significant of 0.006 was confirmed.Conclusion:Developing a safety culture in hospitals by implementing various health programs improves the reporting culture,but the mental climate is undesirable and requires major steps to reduce worries and negative outcomes after reporting.The presence of female nurses in comparison with men improves the error reporting culture.Perhaps the main reason is patriarchy in Iranian culture.

Download Full-text

Validity and Reliability Assessment Tool of Nursing Students Professional Behavior

Jurnal NERS ◽

10.20473/jn.v10i22015.208-216 ◽

2015 ◽

Vol 10 (2) ◽

pp. 208

Author(s):

Fatikhu Yatuni Asmara

Keyword(s):

Nursing Students ◽

Construct Validity ◽

Content Validity ◽

Assessment Tool ◽

Reliability Assessment ◽

Reliability Test ◽

Validity And Reliability ◽

Professional Behaviour ◽

Rater Reliability ◽

Validity Test

Introduction: Shieffield Peer Review Assessment (SPRAT) is an instrument to assess medical student’s performance using Multi Source Feedback (MSF) method. The previous study stated that MSF with SPRAT is an effective tool assessing professional behaviour (PB) of nursing students both in clinical setting and community setting. However it needs more items to be added. Based on that explanation, it needs conducting validity and reliability test to make sure that the tool is valid and reliable. Method: There were two types of validity test used, content validity test and construct validity test as well as reliability test, namely inter-rater reliability test and item covariance test. Participants were four clinical instructors and 116 nursing students. Result: Content validity test showed that two items must be added as part of assessment item, namely diciplines and faithness. Furthermore construct validity test showed that five items were not valid since they had pearson correlation score <0.3. However the items were included as consideration of nursing students’s PB. Inter-rater reliability test and item covariance reliability test showed that the tool was reliable with score 0.460 and 0.912 respectively. Discussion: The assessment tool can be applied to assess PB of nursing students since it valid and reliable. It needs to investigate the effectiveness of the tool in difference of PB of nursing students.Keywords: validity, reliability, assessment tool of PB (professional behaviour)

Download Full-text

A high-fidelity, virtual reality, transurethral resection of bladder tumor simulator: Validation as a tool for training

Canadian Urological Association Journal ◽

10.5489/cuaj.7285 ◽

2021 ◽

Vol 16 (4) ◽

Author(s):

Jonathan Moore ◽

Stewart Whalen ◽

Neal Rowe ◽

Jason Lee ◽

Michael Ordon ◽

...

Keyword(s):

Construct Validity ◽

Transurethral Resection ◽

Content Validity ◽

Bladder Tumor ◽

Strong Support ◽

Face Validity ◽

Video Recordings ◽

The Face ◽

Hands And Feet ◽

Key Steps

Introduction: Simulation-based training is used to help trainees learn surgical procedures in a safe environment. The objective of our study was to test the face, content, and construct validity of the transurethral resection of bladder tumor (TURBT) module built on the Simbionix TURP Mentor simulator. Methods: Participants performed five standardized cases on the simulator. Domains of the simulator were evaluated on a five-point Likert scale to establish face and content validity. Construct validity was assessed through the simulator's built-in scoring metrics, as well as video recordings of the simulator screen and an anonymized view of participants' hands and feet, which were evaluated using an objective structured assessment of technical skills (OSATS) tool. Results: Ten experienced operators and 15 novices participated. Face validity was somewhat acceptable (mean realism 3.8/5±1.03 standard deviation [SD]; mean appearance 4.1/5±0.57), as was content validity, represented by simulation of key steps (mean 3.9±0.57). The simulator failed to achieve construct validity. There was no difference in mean simulator scores or OSATS scoring between experienced operators and novices. Novices significantly improved their mean simulator scores (305.9 vs. 332.4, p=0.006) and OSATS scoring (15.8 vs. 18.1, p=0.001), while 87% felt their confidence to perform TURBT improved. Overall, 92% of participants agreed that the simulator should be incorporated into residency training. Conclusions: Our study suggests a role for the TURBT module of the Simbionix TURP Mentor simulator as an introduction to TURBT for urology trainees. Strong support was found from both experienced operators and novices for its formal inclusion in resident education.

Download Full-text

Using smartphone-based virtual patients to assess the quality of primary healthcare in rural China: protocol for a prospective multicentre study

BMJ Open ◽

10.1136/bmjopen-2017-020943 ◽

2018 ◽

Vol 8 (7) ◽

pp. e020943 ◽

Cited By ~ 1

Author(s):

Jing Liao ◽

Yaolong Chen ◽

Yiyuan Cai ◽

Nan Zhan ◽

Sean Sylvia ◽

...

Keyword(s):

Quality Assessment ◽

Low Income ◽

Rural Areas ◽

Assessment Tool ◽

Low Cost ◽

Care Quality ◽

Assessment Tools ◽

Face Validity ◽

Virtual Patients ◽

Health Centres

IntroductionValid and low-cost quality assessment tools examining care quality are not readily available. The unannounced standardised patient (USP), the gold standard for assessing quality, is costly to implement while the validity of clinical vignettes, as a low-cost alternative, has been challenged. Computerised virtual patients (VPs) create high-fidelity and interactive simulations of doctor-patient encounters which can be easily implemented via smartphone at low marginal cost. Our study aims to develop and validate smartphone-based VP as a quality assessment tool for primary care, compared with USP.Methods and analysisThe study will be implemented in primary health centres (PHCs) in rural areas of seven Chinese provinces, and physicians practicing at township health centres and village clinics will be our study population. The development of VPs involves three steps: (1) identifying 10 VP cases that can best represent rural PHCs’ work, (2) designing each case by a case-specific development team and (3) developing corresponding quality scoring criteria. After being externally reviewed for content validity, these VP cases will be implemented on a smartphone-based platform and will be tested for feasibility and face validity. This smartphone-based VP tool will then be validated for its criterion validity against USP and its reliability (ie, internal consistency and stability), with 1260 VP/USP-clinician encounters across the seven study provinces for all 10 VP cases.Ethics and disseminationSun Yat-sen University: No. 2017-007. Study findings will be published and tools developed will be freely available to low-income and middle-income countries for research purposes.

Download Full-text

Validation of martyn to simulate the keyhole supraorbital subfrontal approach

Bulletin of The Royal College of Surgeons of England ◽

10.1308/rcsbull.2014.96.4.120 ◽

2014 ◽

Vol 96 (4) ◽

pp. 120-121 ◽

Cited By ~ 1

Author(s):

Hani J Marcus ◽

Archie Hughes-Hallett ◽

Philip Pratt ◽

Guang-Zhong Yang ◽

Ara Darzi ◽

...

Keyword(s):

Construct Validity ◽

Royal College ◽

Validation Study ◽

Content Validity ◽

Face Validity ◽

Great Success ◽

Surgical Experience ◽

Vascular Tree ◽

Subfrontal Approach

The Modelled Anatomical Replica for Training Young Neurosurgeons (MARTYN) has been created by the conservation team at The Royal College of Surgeons of England to simulate traumatic pathologies (such as extradural haemorrhage) and has been used with great success at relevant workshops. A modified MARTYN head has recently been developed that incorporates a vascular tree and pathology, allowing for the simulation of the keyhole supraorbital subfrontal approach. 1 Here we present a short validation study assessing its realism (face validity), usefulness (content validity) and ability to differentiate levels of surgical experience (construct validity).

Download Full-text

Preparedness of community-based organisations in biohazard: reliability and validity of an assessment tool

Family Medicine and Community Health ◽

10.1136/fmch-2019-000124 ◽

2019 ◽

Vol 7 (3) ◽

pp. e000124

Author(s):

Fatemeh Rezaei ◽

Mohammad R Maracy ◽

Mohammad H Yarmohammadian ◽

Ali Ardalan ◽

Mahmood Keyvanara

Keyword(s):

Factor Analysis ◽

Content Validity ◽

Assessment Tool ◽

Reliability And Validity ◽

Criterion Validity ◽

Face Validity ◽

Community Based ◽

Validity Data ◽

Health Authorities ◽

Control And Prevention

The purpose of this study was to develop a tool for community-based health organisations (CBHOs) to evaluate the preparedness in biohazards concerning epidemics or bioterrorism. We searched concepts on partnerships of CBHOs with health systems in guidelines of the Centers for Disease Control and Prevention and literature. Then, we validated the researcher-made tool by face validity, content validity, exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and criterion validity. Data were collected by sending the tool to 620 CBHOs serving under supervision of Iran’s ministry of health. Opinions of health professionals and stakeholders in CBHOs were used to assess face and content validity. Factor loads in EFA were based on three-factor structure that verified by CFA. We used SPSS V.18 and Mplus7 software for statistical analysis. About 105 health-based CBHOs participated. After conducting face validity and calculating content validity ratio and content validity index, we reached 54 items in the field of planning, training and infrastructure. We conducted construct validity using 105 CBHOs. Three items exchanged between the fields according to factor loads in EFA, and CFA verified the model fit as Comparative Fit Index, Tucker-Lewis index and root mean square error of approximation were 0.921, 0918 and 0.052, respectively. The Cronbach’s of the whole tool was 0.944. Spearman correlation coefficient confirmed criterion validity as coefficient was 0.736. Planning, training and infrastructure fields are the most important aspects of preparedness in health-based CBHOs. Applying the new assessment tool in future studies will show the weaknesses and capabilities of health-based CBHOs in biohazard and clear necessary intervention actions for health authorities.

Download Full-text