A Reliability Generalization Meta-Analysis of the Victorian Institute of Sport Assessment Scale for Achilles Tendinopathy (VISA-A)

2018 ◽  
Vol 40 (4) ◽  
pp. 430-438 ◽  
Author(s):  
Antonio Palazón-Bru ◽  
María Isabel Tomás-Rodríguez ◽  
Emma Mares-García ◽  
Vicente Francisco Gil-Guillén
Keyword(s):  
Correlation Coefficient ◽  
Meta Analysis ◽  
Correlation Coefficients ◽  
Achilles Tendinopathy ◽  
Quality Analysis ◽  
Spearman Correlation ◽  
Reliability Generalization ◽  
Health Measurement ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha

Background: A reliability generalization study of a questionnaire is necessary to provide higher-level evidence for its reliability. This has not been performed for the Victorian Institute of Sport Assessment–Achilles tendinopathy (VISA-A) questionnaire. The VISA-A has been a commonly used questionnaire to evaluate the symptoms of Achilles tendon disorders and their impact on physical activity, one of the most common disorders among athletes and sports persons (9%-40%). Furthermore, this questionnaire has been translated to several languages and due to its simplicity is one of the most widely used questionnaires for patients with this type of disorder. Therefore, we performed a reliability generalization study of the VISA-A using MEDLINE (through PubMed) and Scopus as data sources. Methods: We selected studies that analyzed the reliability of the VISA-A by evaluating Cronbach’s alpha, the intraclass correlation coefficient (ICC), and the Spearman correlation coefficients to compare VISA-A with similar scales. The data were analyzed using fixed- and random-effects models. We assessed sensitivity through the leave-one-out method. Quality analysis was performed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Results: Of a total of 263 studies (eliminating duplicates), 7 fulfilled inclusion criteria. The mean reliability was (1) Cronbach’s alpha, 0.75 (95% CI, 0.70-0.79); (2) ICC, 0.91 (95% CI, 0.82-0.96); (3) correlation coefficient with the Curwin and Stanish grading system, –0.82 (95% CI, −0.93 to −0.56); and (4) correlation coefficient with the Percy and Conochie classification, 0.91 (95% CI, 0.87-0.93). We were unable to perform the funnel plot analysis and estimate meta-regression models. The Spearman correlation coefficients for both comparative scales showed influential studies (sensitivity analysis). Conclusion: Internal consistency and reproducibility were found to be good, but the parallel-forms reliability could not be supported. Therefore, more scientific evidence is needed to generalize the reliability of the VISA-A. Level of Evidence: Level I, meta-analysis of literature.

scholarly journals Structured Reporting of Lung Cancer Staging: A Consensus Proposal

Diagnostics ◽  
2021 ◽  
Vol 11 (9) ◽  
pp. 1569
Author(s):  
Vincenza Granata ◽  
Roberto Grassi ◽  
Vittorio Miele ◽  
Anna Rita Larici ◽  
Nicola Sverzellati ◽  
...  
Keyword(s):  
Lung Cancer ◽  
Correlation Coefficient ◽  
Clinical Data ◽  
Mean Value ◽  
Structured Reporting ◽  
Quality Analysis ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Structured Report

Background: Structured reporting (SR) in radiology is becoming necessary and has recently been recognized by major scientific societies. This study aimed to build CT-based structured reports for lung cancer during the staging phase, in order to improve communication between radiologists, members of the multidisciplinary team and patients. Materials and Methods: A panel of expert radiologists, members of the Italian Society of Medical and Interventional Radiology, was established. A modified Delphi exercise was used to build the structural report and to assess the level of agreement for all the report sections. The Cronbach’s alpha (Cα) correlation coefficient was used to assess internal consistency for each section and to perform a quality analysis according to the average inter-item correlation. Results: The final SR version was built by including 16 items in the “Patient Clinical Data” section, 4 items in the “Clinical Evaluation” section, 8 items in the “Exam Technique” section, 22 items in the “Report” section, and 5 items in the “Conclusion” section. Overall, 55 items were included in the final version of the SR. The overall mean of the scores of the experts and the sum of scores for the structured report were 4.5 (range 1–5) and 631 (mean value 67.54, STD 7.53), respectively, in the first round. The items of the structured report with higher accordance in the first round were primary lesion features, lymph nodes, metastasis and conclusions. The overall mean of the scores of the experts and the sum of scores for staging in the structured report were 4.7 (range 4–5) and 807 (mean value 70.11, STD 4.81), respectively, in the second round. The Cronbach’s alpha (Cα) correlation coefficient was 0.89 in the first round and 0.92 in the second round for staging in the structured report. Conclusions: The wide implementation of SR is critical for providing referring physicians and patients with the best quality of service, and for providing researchers with the best quality of data in the context of the big data exploitation of the available clinical data. Implementation is complex, requiring mature technology to successfully address pending user-friendliness, organizational and interoperability challenges.

A Reliability Generalization of the Overexcitability Questionnaire–Two

2011 ◽  
Vol 22 (5) ◽  
pp. 671-692 ◽  
Author(s):  
Russell T. Warne
Keyword(s):  
United States ◽  
Sample Size ◽  
Meta Analysis ◽  
Gender Composition ◽  
Reliability Generalization ◽  
Cronbach’S Alpha ◽  
Sample Number ◽  
Cronbach's Alpha ◽  
Reported Data ◽  
Reliability Coefficients

Reliability generalization (RG) is a meta-analysis that combines and synthesizes reliability coefficients from different studies to ascertain the average observed reliability across studies. An RG study was conducted on previously reported data from 16 samples of the Overexcitability Questionnaire–Two (OEQII) with a combined N of 5,275. Cronbach’s alpha was found to be consistently higher on all OEQII subscales when scale variance was high and the sample consisted of adults. Sample size, gender composition of the sample, number of items from the subscale used, and location of sample (United States or a different county) had varying effects on observed alpha levels for each subscale. Suggestions are proposed for substantive research using the OEQII and for future psychometric research on the instrument.

scholarly journals Patient-Reported Dysphagia in Adults with Eosinophilic Esophagitis: Translation and Validation of the Swedish Eosinophilic Esophagitis Activity Index

Dysphagia ◽  
2021 ◽  
Author(s):  
Sofie Albinsson ◽  
Lisa Tuomi ◽  
Christine Wennerås ◽  
Helen Larsson
Keyword(s):  
Eosinophilic Esophagitis ◽  
Activity Index ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Control Group ◽  
Cronbach’S Alpha ◽  
Intraclass Correlation Coefficients ◽  
Cronbach's Alpha ◽  
Patient Reported ◽  
Eortc Qlq

AbstractThe lack of a Swedish patient-reported outcome instrument for eosinophilic esophagitis (EoE) has limited the assessment of the disease. The aims of the study were to translate and validate the Eosinophilic Esophagitis Activity Index (EEsAI) to Swedish and to assess the symptom severity of patients with EoE compared to a nondysphagia control group. The EEsAI was translated and adapted to a Swedish cultural context (S-EEsAI) based on international guidelines. The S-EEsAI was validated using adult Swedish patients with EoE (n = 97) and an age- and sex-matched nondysphagia control group (n = 97). All participants completed the S-EEsAI, the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Oesophageal Module 18 (EORTC QLQ-OES18), and supplementary questions regarding feasibility and demographics. Reliability and validity of the S-EEsAI were evaluated by Cronbach’s alpha and Spearman correlation coefficients between the domains of the S-EEsAI and the EORTC QLQ-OES18. A test–retest analysis of 29 patients was evaluated through intraclass correlation coefficients. The S-EEsAI had sufficient reliability with Cronbach’s alpha values of 0.83 and 0.85 for the “visual dysphagia question” and the “avoidance, modification and slow eating score” domains, respectively. The test–retest reliability was sufficient, with good to excellent intraclass correlation coefficients (0.60–0.89). The S-EEsAI domains showed moderate correlation to 6/10 EORTC QLQ-OES18 domains, indicating adequate validity. The patient S-EEsAI results differed significantly from those of the nondysphagia controls (p < 0.001). The S-EEsAI appears to be a valid and reliable instrument for monitoring adult patients with EoE in Sweden.

Italian version of the cornell musculoskeletal discomfort questionnaire (CMDQ-I): Translation, cultural adaptation and validation

Work ◽  
2021 ◽  
pp. 1-7
Author(s):  
F. Magnifica ◽  
F. Colagrossi ◽  
A. Aloisi ◽  
S. Politi ◽  
A. Peretti ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Cultural Adaptation ◽  
Italian Version ◽  
Cronbach’S Alpha ◽  
Musculoskeletal Discomfort ◽  
Pearson’S Correlation ◽  
Pearson’S Correlation Coefficient ◽  
Cronbach's Alpha ◽  
Pearson's Correlation ◽  
Pearson's Correlation Coefficient

BACKGROUND: Almost 25%of workers in the European Union suffer from back pain, and 23%complain of muscle pain. Sixty-two percent of workers carry out repetitive operations with their hands or arms, 46%work in painful or tired positions and 35%carry or handle loads. OBJECTIVE: This study aimed to translate, culturally adapt and validate the Italian version of the Cornell Musculoskeletal Discomfort Questionnaire (CMDQ-I). METHODS: Translation and cultural adaptation procedures followed international guidelines. Participants were recruited from among the personnel components of the Italian Air Force, who were between 18 and 65 years old. Cronbach’s alpha and the intraclass correlation coefficient (ICC) were calculated to assess internal consistency and stability, respectively. The CDMQ-I was administered together with the Visual Analogic Scale (VAS), and the validity was evaluated using Pearson’s correlation coefficient. RESULTS: All CDMQ-I items were either identical or similar in meaning to the original version’s items. The scale was administered twice with a retest after seven to 10 days to 66 participants. Cronbach’s alpha was higher than 0.761, and the ICC ranged between 0.737 and 0.952. Pearson’s correlation coefficient showed positive and significant correlations (p >  0.01). CONCLUSIONS: The study produced an Italian version of the CMDQ with good reliability and validity. This scale is a useful tool to investigate the frequency and intensity of musculoskeletal disorders in various categories of workers.

scholarly journals Assessment of psychometric properties of the questionnaire on supervisor-doctoral student interaction (QSDI) in Iran

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Hooman Daryoushi ◽  
Amir Jalali ◽  
Ehsan Karimi ◽  
Nader Salari ◽  
Parvin Abbasi
Keyword(s):  
Factor Analysis ◽  
Psychometric Properties ◽  
Correlation Coefficient ◽  
Quantitative Methods ◽  
Doctoral Student ◽  
Student Interaction ◽  
Medical Sciences ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Farsi Version

Abstract Background One of the main elements that help students in research projects and composing dissertations is the student-supervisor relationship. A valid and reliable tool to measure this seems essential and it is the objective of the present study to validate and assess the psychometric properties of a questionnaire on supervisor-doctoral student interaction (QSDI) in Iran. Methods Before starting the study, a permission from the developer of the tool was secured. Then the tool was forward-backward translated. After preparing the Farsi version of the tool, content validity was confirmed through qualitative and quantitative methods. To examine construct validity, exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were conducted with participation of 218 and 410 MD, MSc, and PhD students of medical sciences, respectively. To check reliability of the tool, correlation coefficient was used. To examine internal consistency of the tool, Cronbach’s alpha was used. Data analyses were done in SPSS (v.25) and LISREL (v.8). Results The EFA and CFA results revealed eight factors and 39 items. The value of R-square for the model was equal to 0.99, which means 99% of changes in the dependent variable (supervisor-student interaction) is attributed to the independent variable (41 items). That is, 99% of the dependent variable changes is due to the independent variables. The main indices of the model based on factor analyses were supported (0.9<), which indicated goodness of fit of the model (χ2/df = 1.76, CFI, NFI, TLI = 0.98 GFI = 0.91, RMSEA = 0.043, R-square = 0.99). The significance level for correlation coefficient was below 0.05. Reliability of the tool was supported based on internal correlation (Cronbach’s alpha) equal to 0.943 for the whole tool and in 0.89–0.97 range for the subscales. Conclusion In general, the results showed that the Farsi version of QSDI (eight factors and 39 items) had acceptable and applicable indices and it can be used as a valid tool in different fields for higher education students of medical sciences.

scholarly journals Validity and Reliability Study of the Scale for Determining the Civic-mindedness Levels of Teaching Staff

2017 ◽  
Vol 5 (4) ◽  
pp. 44
Author(s):  
Rüştü Yeşil
Keyword(s):  
Factor Analysis ◽  
Correlation Coefficients ◽  
Teaching Staff ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Bartlett Test ◽  
Development Participation ◽  
The Stability ◽  
Civic Mindedness

use after also being checked by linguists. The validity analysis of the scale for the data collected was performed with exploratory factor analysis and item-total correlation tests, while the property of reliability was determined using the Cronbach’s alpha internal consistency coefficient and the stability test was carried out by determining the relationship between two applications conducted at an interval of the five weeks. The scale, which is called the “Scale for Determining the Civic-Mindedness Levels of Individuals” is a five-step Likert-type scale and consists of 27 items that can be collected under three factors. The factor names are “Openness to Criticism/Development”, “Participation/Activeness” and “Lack of Prejudice/Flexibility”. The KMO value of the scale was 0.956; and the Bartlett Test values were x2=11001.719; sd=351; p<0.000. Items in the scale accounted for 56.619% of the total variance. As a result of the confirmatory factor analysis, the χ2 value was 808.07 and the degree of freedom was 321. Χ2/df is 2.51. The fit indices of the scale were determined as RMSEA=0.067; S-RMR=0.049; NFI=0.97. The item-total corrected correlation coefficients of the items in the scale varied between 0.40 and 0.703 (p<.01). The reliability coefficient of the scale was Cronbach’s alpha at 0.954 and the stability coefficients of the items were between 0.496 and 0.674 (p<,01).

scholarly journals Translation and Cross-Cultural Adaptation of the Persian Version of Minnesota Living With Heart Failure Questionnaire (MLHFQ)

2020 ◽  
Author(s):  
Behrouz Attarbashi Moghadam ◽  
Hasan Tamartash ◽  
Sara Fereydunnia ◽  
Mahdieh Ravand
Keyword(s):  
Heart Failure ◽  
Correlation Coefficient ◽  
Short Form ◽  
Intraclass Correlation ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Persian Version ◽  
Sf 36 ◽  
Heart Failure Questionnaire

The Minnesota Living with Heart Failure Questionnaire (MLHFQ) has been developed to measure health-related quality of life (HRQoL) status of Heart Failure (HF) patients. The aim of this study was to translate MLHFQ into the Persian version and assess the validity and reliability of the translated version. We used a forward-backward procedure for translation. In a cross-sectional study, 105 HF patients and 50 healthy subjects were selected to assess the reliability and construct validity of the instrument. The face and content validity were used to assess the questionnaire validity. Validity was examined on the HF patients group, using the Persian version of the Short form-36 health survey (SF-36) Questionnaire. In order to assess the questionnaire’s reliability, the Intraclass correlation coefficient (ICC) and Cronbach’s alpha were calculated. Test-retest reliability was examined by re-administering the MLHFQ after 2 weeks. Test-retest results demonstrated that the Persian version has excellent reliability (ICC for all 2 domains were higher than 0.91, P≤0.000). Internal consistency for Physical domain (PD), emotional domain (ED) and total scores using Cronbach’s alpha were 0.90, 0.84 and 0.92, respectively. ICC for PD, ED and total scores were 0.95, 0.94, and 0.97, respectively. Good and very good Pearson's Correlation Coefficient was seen between MLHFQ and SF-36 (r= -0.47 to -0.775, P≤0.000 for PD; r= -0.47 to -0.65, P≤0.000 for ED). The Persian version of the MLHFQ had satisfactory reliability and validity for assessing HRQoL status of Iranian HF patients. © 2019 Tehran University of Medical Sciences. All rights reserved. Acta Med Iran 2019;57(7):435-441.

scholarly journals The Harris Hip Score

2020 ◽  
Author(s):  
ALIAA Khaja ◽  
Owayed AL-Mutairi ◽  
abdulaziz Alkhudair ◽  
Awdhah Abdulkarim
Keyword(s):  
Physical Function ◽  
Correlation Coefficient ◽  
Convergent Validity ◽  
Reliability And Validity ◽  
Test Reliability ◽  
Harris Hip Score ◽  
Cronbach’S Alpha ◽  
Good Reliability ◽  
Cronbach's Alpha ◽  
Pain Subscale

Abstract Background The Harris Hip Score (HHS) is a widely used Patient-Related Outcomes score. It measures pain and function levels in patients with hip pathologies. Objectives The main objective of this study is to translate and culturally adapt the HHS into Arabic, and to further assess the reliability and validity of translated version Material & Methods 110 patients participated in this survey. The internal consistency tests were performed using Cronbach’s alpha. Test-retest reliability (intra-correlation coefficient), convergent construct validity, convergent validity, floor & ceiling effects and responsiveness was also calculated. In order to measure the level of agreement, Bland-Altman Plot, forest Plots are performed. Results Test reliability for the first testing situation - calculated using Cronbach's alpha - was 0.98 for the pain subscale, 0.98 for the stiffness, and 0.99 for the physical function subscale. For the second testing, reliability was 0.99, 0.97, and 0.99 (pain, stiffness, and physical function, respectively). This only proves that WOMAC is an instrument with good reliability. Same calculation of Cronbach’s alpha was essential to testing the reliability of the Harris Hip Score. For each of the three testing occasions the reliability was very good or excellent – α 1 = 0.92, α 2 = 0.91, and α 3 = 0.90. Intra-class correlation coefficient was good with the score of 0.76 (95% CI 0.44-0.88). Conclusion Overall, Arabic version of HOOS could be used as diagnostic tool for patients with hip problems, when it comes to information about the overall condition of the patient, especially about the improvement or deterioration, however, it is important to be cautious using HHS when the change magnitude of patient’s condition is investigated, since there is a potential probability that the level of improvement of the patient’s condition will be overestimated by HHS.

scholarly journals Development and validation of the Occupational Back Pain Prevention Behaviors Questionnaire in nursing personnel

2019 ◽  
Author(s):  
Seyedeh Somayeh Kazemi ◽  
Sedigheh-Sadat Tavafian ◽  
Alireza Hidarnia ◽  
Ali Montazeri
Keyword(s):  
Factor Analysis ◽  
Back Pain ◽  
Correlation Coefficient ◽  
Exploratory Factor Analysis ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Face Validity ◽  
Cronbach’S Alpha ◽  
Cross Sectional ◽  
Cronbach's Alpha

Abstract Background: Occupational back pain is the most prevalent health problem among nurses and needs to be assessed by a valid and multi-factorial questionnaire. The purpose of the present study was to design and develop an instrument based on the PRECEDE-PROCEED model for assessing job-related behaviors that cause low back pain. Methods: First an item pool of 49 items was generated. Then, content and face validity was carried out. Consequently, a cross-sectional study was conducted in Mazandaran, Iran. The questionnaire was distributed among a sample of nurses working in hospitals affiliated to Mazandaran University of Medical Sciences. Exploratory factor analysis was used to determine the factor structure of the questionnaire. The Cronbach’s alpha was estimated to assess the reliability and the intraclass correlation coefficient was calculated to examine stability. Results: In all 155 nurses participated in the study. The mean age of respondents was 34.1 (SD = 7.66) years, and 83.2% were female. Six factors with 30 items emerged from the exploratory factor analysis: knowledge, attitude, self-efficacy, reinforcing factors, enabling factors and behavior that jointly accounted for %66.5 of behavior change variance observed. The Cronbach’s alpha coefficient showed excellent internal consistency (alpha=0.92). The intraclass correlation coefficient with 2-weeks interval also indicated that the questionnaire has satisfactory stability (ICC = 0.97). Conclusions: The findings showed that the Occupational Back Pain Prevention Behavior Questionnaire is a reliable and valid instrument for measuring occupational back pain and prevention behaviors among nurses. Keywords: Occupational Back Pain, Prevention behaviors, Psychometric evaluation, PRECEDE-PROCEED model, Nurse

scholarly journals Psychometrics of Assessment Tools to Examine the Challenges of Physicians' Participation in Accreditation Programs

2021 ◽  
Author(s):  
Hosein Ebrahimipour ◽  
Elahe Hooshmand ◽  
Mehdi Varmaghani ◽  
Seyyed Morteza Mojtabaeian
Keyword(s):  
Health Care ◽  
Correlation Coefficient ◽  
Content Validity ◽  
Health Care Quality ◽  
Care Quality ◽  
Assessment Tools ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Improvement Programs

Background: Many organizations believe that physician involvement is important in quality and safety of health services, but they did not properly define, measure, and improve it, so because of the importance of the quality of health care and increasing the involvement of physician this study was conducted to evaluate the validity and reliability of a questionnaire on the challenges of physicians' participation in quality improvement programs. Methods: In this cross-sectional study conducted in the hospitals of Mashhad University of Medical Sciences, a researcher-made questionnaire about challenges of physicians' participation in accreditation activities used for data gathering. The content validity ratio index and content validity index were also calculated. To measure the internal consistency of the instrument, the questionnaire was distributed among 14 physicians, Cronbach's alpha coefficient was determined. For stability or reproducibility of the instrument, test - retest and correlation coefficient were calculated. By distributing questionnaires among 14 people those meeting inclusion criteria, the correlation coefficient was measured twice and at intervals of 2 weeks. SPSS 21 software was used for data analysis Results: The initial questionnaire was consisted of 61 items, which were reduced to 38 items after face and content psychometrics. The questionnaire has 12 sub-concepts. Cronbach's alpha coefficient of the questionnaire was 0.83 and the intragroup correlation coefficient in 2 measurements 2 weeks apart was 0.94. Conclusion: This questionnaire is the first and only valid and reliable dedicated tool in the field of challenges of physicians' participation in accreditation activities in Iran, which can measure and prioritize the challenges in each health center and it can be used to improve health care quality services that are performed by doctors.

Sign in / Sign up

Export Citation Format

Share Document