scholarly journals Preparedness of community-based organisations in biohazard: reliability and validity of an assessment tool

2019 ◽  
Vol 7 (3) ◽  
pp. e000124
Author(s):  
Fatemeh Rezaei ◽  
Mohammad R Maracy ◽  
Mohammad H Yarmohammadian ◽  
Ali Ardalan ◽  
Mahmood Keyvanara
Keyword(s):  
Factor Analysis ◽  
Content Validity ◽  
Assessment Tool ◽  
Reliability And Validity ◽  
Criterion Validity ◽  
Face Validity ◽  
Community Based ◽  
Validity Data ◽  
Health Authorities ◽  
Control And Prevention

The purpose of this study was to develop a tool for community-based health organisations (CBHOs) to evaluate the preparedness in biohazards concerning epidemics or bioterrorism. We searched concepts on partnerships of CBHOs with health systems in guidelines of the Centers for Disease Control and Prevention and literature. Then, we validated the researcher-made tool by face validity, content validity, exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and criterion validity. Data were collected by sending the tool to 620 CBHOs serving under supervision of Iran’s ministry of health. Opinions of health professionals and stakeholders in CBHOs were used to assess face and content validity. Factor loads in EFA were based on three-factor structure that verified by CFA. We used SPSS V.18 and Mplus7 software for statistical analysis. About 105 health-based CBHOs participated. After conducting face validity and calculating content validity ratio and content validity index, we reached 54 items in the field of planning, training and infrastructure. We conducted construct validity using 105 CBHOs. Three items exchanged between the fields according to factor loads in EFA, and CFA verified the model fit as Comparative Fit Index, Tucker-Lewis index and root mean square error of approximation were 0.921, 0918 and 0.052, respectively. The Cronbach’s of the whole tool was 0.944. Spearman correlation coefficient confirmed criterion validity as coefficient was 0.736. Planning, training and infrastructure fields are the most important aspects of preparedness in health-based CBHOs. Applying the new assessment tool in future studies will show the weaknesses and capabilities of health-based CBHOs in biohazard and clear necessary intervention actions for health authorities.

scholarly journals Reliability and Validity of Household Disaster Preparedness Index (HDPI)

2020 ◽  
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Exploratory Factor Analysis ◽  
Internal Consistency ◽  
Content Validity ◽  
Disaster Preparedness ◽  
Reliability And Validity ◽  
Face Validity ◽  
Acceptable Range ◽  
Household Preparedness

Introduction: The preparedness of families for the disasters can set auspicious grounds for the preparedness of the whole society. In Iran health system, Household Disaster Preparedness Index (HDPI) that is composed of 15 items is applied for assessing the household preparedness in disasters. This study was conducted to investigate the reliability and validity of this index. Methods: In order to investigate the HDPI reliability, we two methods, namely internal consistency and stability determination, are. In order to investigate HDPI validity, we examined the face validity, content validity and construct validity. To do so, besides interviewing with the experts and family heads, 200 families were selected based on multistage cluster sampling method from amongst a study population that included the families in all the counties in Isfahan Province. Use has been made in content validity investigation of both qualitative and quantitative methods; and, in investigating the construct validity, exploratory factor analysis was the method of choice. Results: The amount of HDPI internal consistency was calculated 0.786 which is in an acceptable range. HDPI stability, as well, was computed 0.98 using the test-retest method which is also in an optimal level. Therefore, it can be stated that HDPI enjoys the required reliability. Investigation of HDPI face validity indicated that the families have problems in perceiving some of the items of this index. The experts presented suggestions for improving the HDPI content validity following the qualitative investigation of the content validity. In the investigation of the content validity ratio (CVR), all the items, except the ones numbered 1, 3 and 4 were in an acceptable range; however, the investigation of the content validity index (CVI) indicated that only the validity of the items numbered 12 and 13 was acceptable in terms of all the three scales of relevancy, clarity and simplicity. To determine the construct validity, we used exploratory factor analysis to extract five factors (subscales), namely reduction of vulnerability, planning for disasters, family empowerment, procurement of resources for disasters and specialized programs. The internal consistency of these subscales indicated that only the internal consistencies of the first and the second factors were in an acceptable range. Conclusion: The present study revealed that although HDPI was a reliable measure, it did not enjoy the required validity for assessing the household preparedness in disasters.

scholarly journals Development and psychometric properties of a questionnaire to evaluate sustainable waste separation behavior and environmental health promotion

2021 ◽  
Vol 96 (1) ◽  
Author(s):  
Mahnaz Solhi ◽  
Esmat Heydari ◽  
Leila Janani ◽  
Mahdi Farzadkia
Keyword(s):  
Factor Analysis ◽  
Social Marketing ◽  
Content Validity ◽  
Phase 1 ◽  
Face Validity ◽  
Community Based ◽  
Validity Index ◽  
Content Validity Index ◽  
Marketing Model ◽  
Waste Separation

Abstract Background Assessment of benefits and barriers of waste separation at source is necessary to identify the effective factors in this field. This study aims at designing and validation of a questionnaire assessing the barriers and benefits of waste separation at source from the viewpoint of women based on the community-based social marketing model in Genaveh Township, Bushehr, Iran Methods In phase 1, a literature review and focus group discussion were conducted to identify the barriers and benefits of waste separation at the source and to design the items and questionnaires. In phase 2, a psychometric evaluation was performed, including face validity, content validity, structural validity, and reliability. Data were analyzed by SPSS and R software. Results Out of 56 initial items, seven items with the content validity ratio less than 0.56 were removed, and one with the content validity index less than 0.79 was reviewed. Content validity ratio of the questionnaire was 0.782 and content validity index 0.957. The results of exploratory factor analysis showed that the five and seven-factor models showed good fit. Considering the possible existence of some items in several factors, confirmatory factor analysis was used in the next step. Finally, two items were removed and two others were displaced. The reliability of the instrument was confirmed by internal consistency (α = 0.92) and its stability by the test-retest (ICC = 0.83). Conclusions The valid and reliable 48-item questionnaire is a suitable instrument for assessing the barriers and benefits of waste separation at source from the viewpoint of women based on the community-based social marketing model in Genaveh Township, Bushehr.

scholarly journals Development and Validation of a Food Literacy Assessment Tool for Community-Dwelling Elderly People

2021 ◽  
Vol 18 (9) ◽  
pp. 4979
Author(s):  
Hyeona So ◽  
Dahyun Park ◽  
Mi-Kyung Choi ◽  
Young-Sun Kim ◽  
Min-Jeong Shin ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Elderly People ◽  
Assessment Tool ◽  
Community Dwelling ◽  
Face Validity ◽  
Literacy Assessment ◽  
Food Literacy ◽  
Sphericity Test ◽  
Development And Validation ◽  
Korean Elderly

Food literacy refers to the knowledge, skills, and attitudes required for individuals to choose foods that promote health. As the rate of diet-related diseases increases, food literacy is becoming more important. However, there are no tools available to evaluate food literacy among the Korean elderly. We derived 547 questions from a literature review and, after three rounds of Delphi surveys, selected 33 preliminary questions. We calculated the content validity ratio of the questions and applied a face validity procedure. We then selected 32 questions, assessed their validity, and distributed them as a questionnaire to 205 elderly people. We then conducted exploratory factor analysis (EFA) to determine the validity of the questionnaire and used an internal consistency index (Cronbach’s α coefficient) to determine reliability. Based on the factor analysis, 13 questions were selected, distributed among three factors, and evaluated using the Kaiser–Meyer–Olkin (KMO) and Bartlett sphericity tests. The factor analysis showed that KMO was 0.872, which is a highly acceptable score, and the Bartlett sphericity test was χ2 = 1,374.69 at p = 0.00. The food literacy questionnaire developed in this study will likely be helpful for improving the healthcare of elderly people.

scholarly journals Psychometric evaluation and cultural adaptation of the Spanish version of the “Scale for End-of Life Caregiving Appraisal”

2018 ◽  
Vol 17 (03) ◽  
pp. 314-321
Author(s):  
José Manuel Hernández-Padilla ◽  
Matías Correa-Casado ◽  
José Granero-Molina ◽  
Alda Elena Cortés-Rodríguez ◽  
Tamara María Matarín-Jiménez ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
End Of Life ◽  
Exploratory Factor Analysis ◽  
Content Validity ◽  
Criterion Validity ◽  
Spanish Version ◽  
Validity Index ◽  
Content Validity Index ◽  
The Impact

AbstractObjectiveTo translate, culturally adapt, and psychometrically evaluate the Spanish version of the “Scale for End-of Life Caregiving Appraisal” (SEOLCAS).MethodObservational cross-sectional study. Convenience sample of 201 informal end-of-life caregivers recruited in a southern Spanish hospital. The reliability of the questionnaire was assessed through its internal consistency (Cronbach's α) and temporal stability (Pearson's correlation coefficient [r] between test-retest). The content validity index of the items and the scale was calculated. Criterion validity was explored through performing a linear regression analysis to evaluate the SEOLCAS’ predictive validity. Exploratory factor analysis was used to examine its construct validity.ResultsThe SEOLCAS’ reliability was very high (Cronbach's α = 0.92). Its content validity was excellent (all items’ content validity index = 0.8–1; scale's validity index = 0.88). Evidence of the SEOLCAS’ criterion validity showed that the participants’ scores on the SEOLCAS explained approximately 79.3% of the between-subject variation of their results on the Zarit Burden Interview. Exploratory factor analysis provided evidence of the SEOLCAS’ construct validity. This analysis revealed that two factors (“internal contingencies” and “external contingencies”) explained 53.77% of the total variance found and reflected the stoic Hispanic attitude toward adversity.Significance of resultsThe Spanish version of the SEOLCAS has shown to be an easily applicable, valid, reliable, and culturally appropriate tool to measure the impact of end-of-life care provision on Hispanic informal caregivers. This tool offers healthcare professionals the opportunity to easily explore Hispanic informal end-of-life caregivers’ experiences and discover the type of support they may need (instrumental or emotional) even when there are communicational and organizational constraints.

scholarly journals Validity and Reliability of the Scale, Role Taking in Caregivers of People with Chronic Disease, ROL

10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro
Keyword(s):  
Factor Analysis ◽  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Three Dimensions ◽  
Face Validity ◽  
Validity And Reliability ◽  
Role Taking ◽  
Phase Study

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.

Validity and Reliability of Mathematical Visual Literacy Skills Based on Avgerinou’s Vilual Literacy Index

2021 ◽  
Vol 12 (3) ◽  
pp. 1102-1121
Author(s):  
Raja Lailatul Zuraida Et.al
Keyword(s):  
Content Validity ◽  
Visual Literacy ◽  
Early Stage ◽  
Reliability And Validity ◽  
Principal Component ◽  
Literacy Skills ◽  
Face Validity ◽  
Validity And Reliability ◽  
Principal Component Axis ◽  
Bartlett’S Test

There is much literature on visual literacy across different fields of knowledge. Even so, generally there is a gap of literature that deals with measuring mathematical visual literacy skills. The objective of this paper is to produce empirical data on reliability and validity of mathematical visual literacy skills instrument. The development of items was based on the skills outlined Avgerinou’s VL Index (2007. The early stage in validating the instrument required researchers to seek face validity and content validity from panels of experts. Face validity was based on subjective judgements of the items. Meanwhile, content validity was determined by Content Validity Index (CVI) which is computed using Item-CVI (I-CVI) and Scale-CVI (S-CVI). Each mathematical visual literacy skills had accepted S-CVI values ranging from 0.86 to 1.00 but items with low I-CVI values were deleted. Next, construct validity and reliability was determined by using Exploratory Factor Analysis (EFA) and Cronbach’s alpha respectively. The instrument, consisting of 43 items was assessed on 428 pre-university students. Students’ responses were scored using analytical rubric developed by researchers. Using Principal Component Axis (PCA) and varimax rotation, EFA was carried out where 40 retaining items were extracted to 7 factors, representing each visual literacy skills. Kaiser-Meyer-Olkin (KMO) of 0.721, significant Bartlett’s Test of Sphericity (BTS), communalities anti images ranging between 0.308-0.721 and 0.503-0.835 respectively, 7 extracted factors explaining 53.685% of the total variance, factor loadings of ±0.520 and more, and overall Cronbach’s alphas of instrument recorded at 0.82, explained the complete validity and reliability of the instrument.

scholarly journals Ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) for trabeculectomy

2019 ◽  
Vol 4 (1) ◽  
pp. e000313 ◽  
Author(s):  
William H Dean ◽  
John Buchan ◽  
Fisseha Admassu ◽  
Min J Kim ◽  
Karl C Golnik ◽  
...  
Keyword(s):  
Content Validity ◽  
Assessment Tool ◽  
Interobserver Reliability ◽  
Glaucoma Surgery ◽  
Face Validity ◽  
Competency Assessment ◽  
Validity And Reliability ◽  
Wilcoxon Rank Sum Test ◽  
Better Than ◽  
Assessment Rubric

Background/aimsTo develop, test and determine whether a surgical-competency assessment tool for simulated glaucoma surgery is valid.MethodsThe trabeculectomy ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) was assessed for face and content validity with a large international group of expert eye surgeons. Cohorts of novice and competent surgeons were invited to perform anonymised simulation trabeculectomy surgery, which was marked using the Sim-OSSCAR in a masked fashion by a panel of four expert surgeons. Construct validity was assessed using a Wilcoxon rank-sum test. Krippendorff’s alpha was calculated for interobserver reliability.ResultsFor the Sim-OSSCAR for trabeculectomy, 58 of 67 surgeons (86.6%) either agreed or strongly agreed that the Sim-OSSCAR is an appropriate way to assess trainees’ surgical skill. Face validity was rated as 4.04 (out of 5.00). Fifty-seven of 71 surgeons (80.3%) either agreed or strongly agreed that the Sim-OSSCAR contents represented the surgical technique of surgical trabeculectomy. Content validity was rated as 4.00. Wilcoxon rank-sum test showed that competent surgeons perform better than novices (p=0.02). Interobserver reliability was rated >0.60 (Krippendorff’s alpha) in 19 of 20 steps of the Sim-OSSCAR.ConclusionThe Sim-OSSCAR for trabeculectomy, a newly developed and validated assessment tool for simulation glaucoma surgery, has validity and reliability. It has the potential to play a useful role in ophthalmic surgical education.

TABS: The Development and Testing of a Nicotine and Tobacco Use Research Tool

2020 ◽  
Vol 28 (2) ◽  
pp. 419-433
Author(s):  
Shai Lev ◽  
Strianie Shaina Louis ◽  
Rosemary Collier ◽  
Geraldine R. Britton
Keyword(s):  
Factor Analysis ◽  
Process Evaluation ◽  
Tobacco Use ◽  
Rapid Assessment ◽  
Reliability And Validity ◽  
Face Validity ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Campus Policy ◽  
And Behavior

Background and PurposeTobacco use is declining but the use of electronic nicotine delivery systems (ENDS) has increased in young populations. The Interdisciplinary Tobacco Use Research Program (ITURP) developed a survey assessing tobacco and ENDS use, and a tobacco-free campus policy. This project analyzes the reliability and validity of the Tobacco Attitude and Behavior Survey (TABS).MethodsContent and face validity, factor analysis, Cronbach's Alpha, and a process evaluation were assessed.ResultsFactor analysis revealed four constructs. Cronbach's alpha was .70. Process evaluation revealed that students involvement in TABS allowed rapid assessment of changes in ENDS use, and to modify questions based on student feedback.ConclusionReliability and validity are adequate for a new tool.

scholarly journals Development and validation of a nutrition knowledge questionnaire for a Canadian population

2016 ◽  
Vol 20 (7) ◽  
pp. 1184-1192 ◽  
Author(s):  
Maude Bradette-Laplante ◽  
Élise Carbonneau ◽  
Véronique Provencher ◽  
Catherine Bégin ◽  
Julie Robitaille ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Content Validity ◽  
Covariance Structure ◽  
Nutrition Knowledge ◽  
Face Validity ◽  
Covariance Structure Analysis ◽  
Knowledge Questionnaire ◽  
Canadian Population ◽  
Test Retest Reliability

AbstractObjectiveThe present study aimed to develop and validate a nutrition knowledge questionnaire in a sample of French Canadians from the province of Quebec, taking into account dietary guidelines.DesignA thirty-eight-item questionnaire was developed by the research team and evaluated for content validity by an expert panel, and then administered to respondents. Face validity and construct validity were measured in a pre-test. Exploratory factor analysis and covariance structure analysis were performed to verify the structure of the questionnaire and identify problematic items. Internal consistency and test–retest reliability were evaluated through a validation study.SettingOnline survey.SubjectsSix nutrition and psychology experts, fifteen registered dietitians (RD) and 180 lay people participated.ResultsContent validity evaluation resulted in the removal of two items and reformulation of one item. Following face validity, one item was reformulated. Construct validity was found to be adequate, with higher scores for RDv. non-RD (21·5 (sd2·1)v. 15·7 (sd3·0) out of 24,P<0·001). Exploratory factor analysis revealed that the questionnaire contained only one factor. Covariance structure analysis led to removal of sixteen items. Internal consistency for the overall questionnaire was adequate (Cronbach’sα=0·73). Assessment of test–retest reliability resulted in significant associations for the total knowledge score (r=0·59,P<0·001).ConclusionsThis nutrition knowledge questionnaire was found to be a suitable instrument which can be used to measure levels of nutrition knowledge in a Canadian population. It could also serve as a model for the development of similar instruments in other populations.

Sign in / Sign up

Export Citation Format

Share Document