Evaluation of the content validity index of the Australian/Canadian osteoarthritis hand index, the patient-rated wrist/hand evaluation and the thumb disability exam in people with hand arthritis

Abstract Background The Australian/Canadian Osteoarthritis Hand Index (AUSCAN), the Patient-Rated Wrist/Hand Evaluation (PRWHE) and the Thumb Disability Exam (TDX) are patient-reported outcome measures (PROM) designed to assess pain and hand function in patients with hand arthritis, hand pain and disability, or thumb pathology respectively. This study evaluated the content validity of AUSCAN, PRWHE and TDX in people with hand arthritis. Methods This study enrolled participants with hand arthritis to rate the items of all 3 PROM in terms of relevance and clarity. The Content Validity Index (CVI) was computed for each item in each scale (I-CVI) as well as for the overall scale (S-CVI). Kappa was used to determine the inter-rater agreement among the raters. Results Overall, 64 individuals with hand arthritis (27% with OA, 67% with rheumatoid arthritis and 6% with psoriatic arthritis) participated in the study. The I-CVI for all items and all scales were very high (I-CVI > 0.76) and the modified Kappa agreement among the raters demonstrated excellent agreement (k > 0.76). The S-CVI for all PROMs was very high for relevance (AUSCAN = 0.92, 95% CI 0.90 to 0.94; PRWHE = 0.85, 95% CI 0.82 to 0.88 and TDX = 0.87, 95% CI 0.85 to 0.89) and for clarity (AUSCAN = 0.99, 95% CI 0.98 to 1.00; PRWHE = 0.95, 95% CI 0.93 to 0.97 and TDX = 0.91, 95% CI 0.89 to 0.94), respectively. Conclusions This study demonstrated very high content validity indices for the AUSCAN, PRWHE and TDX; with strong consensus across raters. This augments prior studies demonstrating appropriate statistical measurement properties, to provide confidence that all three measures assess important patient concepts of pain and disability.

Download Full-text

Evaluation of the Content Validity Index of the Australian Canadian hand OA Index, the Patient-Rated Wrist/Hand Evaluation and the Thumb Disability Exam in people with hand arthritis

10.21203/rs.3.rs-32151/v1 ◽

2020 ◽

Author(s):

Pavlos Bobos ◽

Joy C MacDermid ◽

Eleni C. Boutsikari ◽

Emily A. Lalone ◽

Louis Ferreira ◽

...

Keyword(s):

Content Validity ◽

Hand Function ◽

Measurement Properties ◽

Validity Index ◽

Content Validity Index ◽

Validity Indices ◽

Patient Reported ◽

Hand Evaluation ◽

Kappa Agreement ◽

Very High

Abstract BackgroundThe Australian Canadian hand OA Index (AUSCAN), the Patient-Rated Wrist/Hand Evaluation (PRWHE) and the Thumb Disability Exam (TDX) are patient-reported outcome measures (PROM) used to assess pain and hand function in patients with hand arthritis. This study evaluated the content validity of PRWHE, AUSCAN and TDX. MethodsThis study enrolled participants with hand arthritis to rate the items of all 3 PROM in terms of relevance and clarity. The Content Validity Index (CVI) was computed for each item in each scale (I-CVI) as well as for the overall scale (S-CVI). Kappa was used to determine the inter-rater agreement among the experts. ResultsOverall, 64 individuals with hand arthritis (27% with OA, 67% with rheumatoid arthritis and 6% with psoriatic arthritis) participated in the study. The I-CVI for all items and all scales was very high (I-CVI > 0.76) and the modified Kappa agreement among the raters demonstrated excellent agreement (k>0.76).The S-CVI for all PROMs was found very high for relevance (PRWHE = 0.85, 95% CI 0.82 to 0.88; TDX = 0.87, 95% CI 0.85 to 0.89 and AUSCAN = 0.92, 95% CI 0.90 to 0.94) and for clarity (PRWHE = 0.95, 95% CI 0.93 to 0.97; TDX = 0.91, 95% CI 0.89 to 0.94 and AUSCAN = 0.99, 95% CI 0.98 to 1.00) respectively. ConclusionsThis study demonstrated very high content validity indices for the PRWHE, AUSCAN, and TDX; with strong consensus across reviewers. This augments prior statistical evidence supporting statistical measurement properties, to provide support for the content validity.

Download Full-text

Evaluation of the Content Validity Index of the Australian/Canadian Osteoarthritis Hand Index, the Patient-Rated Wrist/Hand Evaluation and the Thumb Disability Exam in People with Hand Arthritis

10.21203/rs.3.rs-32151/v3 ◽

2020 ◽

Author(s):

Pavlos Bobos ◽

Joy C MacDermid ◽

Eleni C. Boutsikari ◽

Emily A. Lalone ◽

Louis Ferreira ◽

...

Keyword(s):

Content Validity ◽

Hand Function ◽

Measurement Properties ◽

Validity Index ◽

Content Validity Index ◽

Validity Indices ◽

Patient Reported ◽

Hand Evaluation ◽

Kappa Agreement ◽

Very High

Abstract Background The Australian/Canadian Osteoarthritis Hand Index (AUSCAN), the Patient-Rated Wrist/Hand Evaluation (PRWHE) and the Thumb Disability Exam (TDX) are patient-reported outcome measures (PROM) designed to assess pain and hand function in patients with hand arthritis, hand pain and disability, or thumb pathology respectively. This study evaluated the content validity of AUSCAN, PRWHE and TDX in people with hand arthritis. Methods This study enrolled participants with hand arthritis to rate the items of all 3 PROM in terms of relevance and clarity. The Content Validity Index (CVI) was computed for each item in each scale (I-CVI) as well as for the overall scale (S-CVI). Kappa was used to determine the inter-rater agreement among the raters. Results Overall, 64 individuals with hand arthritis (27% with OA, 67% with rheumatoid arthritis and 6% with psoriatic arthritis) participated in the study. The I-CVI for all items and all scales were very high (I-CVI > 0.76) and the modified Kappa agreement among the raters demonstrated excellent agreement (k>0.76).The S-CVI for all PROMs was very high for relevance (AUSCAN = 0.92, 95% CI 0.90 to 0.94; PRWHE = 0.85, 95% CI 0.82 to 0.88 and TDX = 0.87, 95% CI 0.85 to 0.89) and for clarity (AUSCAN = 0.99, 95% CI 0.98 to 1.00; PRWHE = 0.95, 95% CI 0.93 to 0.97 and TDX = 0.91, 95% CI 0.89 to 0.94), respectively. Conclusions This study demonstrated very high content validity indices for the AUSCAN, PRWHE and TDX; with strong consensus across raters. This augments prior studies demonstrating appropriate statistical measurement properties, to provide confidence that all three measures assess important patient concepts of pain and disability.

Download Full-text

Evaluation of the Content Validity Index of the Australian/Canadian Osteoarthritis Hand Index, the Patient-Rated Wrist/Hand Evaluation and the Thumb Disability Exam in People with Hand Arthritis

10.21203/rs.3.rs-32151/v2 ◽

2020 ◽

Author(s):

Pavlos Bobos ◽

Joy C MacDermid ◽

Eleni C. Boutsikari ◽

Emily A. Lalone ◽

Louis Ferreira ◽

...

Keyword(s):

Content Validity ◽

Hand Function ◽

Measurement Properties ◽

Validity Index ◽

Content Validity Index ◽

Validity Indices ◽

Patient Reported ◽

Hand Evaluation ◽

Kappa Agreement ◽

Very High

Abstract BackgroundThe Australian/Canadian Osteoarthritis Hand Index (AUSCAN), the Patient-Rated Wrist/Hand Evaluation (PRWHE) and the Thumb Disability Exam (TDX) are patient-reported outcome measures (PROM) used to assess pain and hand function in patients with hand arthritis. This study evaluated the content validity of PRWHE, AUSCAN and TDX. MethodsThis study enrolled participants with hand arthritis to rate the items of all 3 PROM in terms of relevance and clarity. The Content Validity Index (CVI) was computed for each item in each scale (I-CVI) as well as for the overall scale (S-CVI). Kappa was used to determine the inter-rater agreement among the raters. ResultsOverall, 64 individuals with hand arthritis (27% with OA, 67% with rheumatoid arthritis and 6% with psoriatic arthritis) participated in the study. The I-CVI for all items and all scales was very high (I-CVI > 0.76) and the modified Kappa agreement among the raters demonstrated excellent agreement (k>0.76).The S-CVI for all PROMs was found very high for relevance (PRWHE = 0.85, 95% CI 0.82 to 0.88; TDX = 0.87, 95% CI 0.85 to 0.89 and AUSCAN = 0.92, 95% CI 0.90 to 0.94) and for clarity (PRWHE = 0.95, 95% CI 0.93 to 0.97; TDX = 0.91, 95% CI 0.89 to 0.94 and AUSCAN = 0.99, 95% CI 0.98 to 1.00) respectively. ConclusionsThis study demonstrated very high content validity indices for the PRWHE, AUSCAN, and TDX; with strong consensus across raters. This augments prior statistical evidence supporting statistical measurement properties, to provide support for the content validity.

Download Full-text

Validity and Reliability of Self-Assessment Tool for Risk Prioritization Following Exposure to Tuberculosis in a Hospital Setting

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph18083981 ◽

2021 ◽

Vol 18 (8) ◽

pp. 3981

Author(s):

Piyapong Sirinapakul ◽

Naesinee Chaiear ◽

Phanumas Krisorn

Keyword(s):

Content Validity ◽

Assessment Tool ◽

Health Workers ◽

Hospital Setting ◽

Communication Tool ◽

Validity And Reliability ◽

Self Assessment ◽

Validity Index ◽

Content Validity Index ◽

Kappa Agreement

The Modified Self-Assessment (MSA) and Present Self-Assessment (PSA) forms are questionnaires used to prioritize the risk of infection of health workers exposed to tuberculosis (TB) in Srinagarind Hospital in Thailand. As MSA was developed from PSA, the validity and reliability of MSA need to be assessed. The research aim is to examine the content validity of MSA and to assess the respective reliability of MSA and PSA vis-à-vis expert opinion. Seven experts determined the content validity index (CVI) of MSA. MSA and PSA were used to prioritize the TB contact of 108 subjects, and we compared the result with the risk assessed by the experts. The respective Kappa agreements between MSA and PSA and the experts were used to assess reliability. The result of the content validity index revealed that MSA had I-CVI > 0.83 for all questions and an S-CVI/Ave above 0.90 for all factors. The Kappa agreement of contact priority between MSA and the experts was 0.80; it was 0.58 between PSA and the experts. MSA can, thus, be used to prioritize contact with tuberculosis in Srinagarind Hospital. MSA is a valid risk communication tool for aerosol-generating procedures. Further study should be conducted in other hospitals, and the number of participants should be increased in order to come to a concrete result.

Download Full-text

Validation of the Papo Reto game as a pedagogical device of adolescent in the context of sexuality

Revista Brasileira de Enfermagem ◽

10.1590/0034-7167-2019-0052 ◽

2020 ◽

Vol 73 (suppl 4) ◽

Author(s):

Vania de Souza ◽

Keyla Carla Ramos ◽

Fernanda Penido Matozinhos ◽

Rosa Maria Godoy Serpa da Fonseca

Keyword(s):

Quantitative Study ◽

Content Validity ◽

High Reliability ◽

Online Game ◽

Assessment Data ◽

Validity Index ◽

Content Validity Index ◽

Data Treatment ◽

Potential Methods ◽

Very High

ABSTRACT Objectives: to validate the online game Papo Reto to approach sexuality in adolescence, according to the categories: Technical and esthetic aspects; Dynamics; Playfulness; Content; Pedagogical potential. Methods: a descriptive quantitative study with online collection instrument, composed of the 5 categories with 85 variables. Twelve judges participated in the assessment. Data treatment used Stata 14.0, and analysis used Content Validity Index (CVI) and Cronbach’s Alpha (α). Results: the α coefficient showed very high reliability (α=0.95) for the Playfulness category, and high reliability (α≥ 0.75) for the others. Of the 85 variables, 84 were validated by at least one of the judges, with CVI=1. Although the game has been validated in 5 categories, variations in the Alpha (α) and CVI coefficients proved to be fundamental for new productions. Conclusions: the diversity of the methods adopted contributed to the reliability of the result. The analyzed variables expressed the adequacy of the game.

Download Full-text

Cultural adaptation and content validation of the Single-Question for screening alcohol abuse

Revista da Escola de Enfermagem da USP ◽

10.1590/s1980-220x2016048703292 ◽

2018 ◽

Vol 51 (0) ◽

Author(s):

Marjorie Ester Dias Maciel ◽

Divane de Vargas

Keyword(s):

Cultural Adaptation ◽

Content Validity ◽

Content Validation ◽

Kappa Index ◽

Validity Index ◽

Content Validity Index ◽

Original Meaning ◽

Kappa Agreement ◽

Single Question ◽

Technical Terms

ABSTRACT Objective Describing the stages of translation, cultural adaptation and content validation of the Single-Question into Brazilian Portuguese, which will be named Questão Chave. Method This study is a cultural adaptation. The instrument was translated into Portuguese as two independent versions which led to a synthesis of translations (S1), and later to the synthesis S2, which was then submitted to evaluation by a Committee of Expert Judges in the area of alcohol use and instrument validation. The Content Validity Index and Kappa agreement coefficient were calculated from this evaluation. Results The judges evaluated the Questão Chave regarding the clarity of the sentence and aspects related to the quality of the translation (cultural adaptation, preservation of original meaning and correct use of technical terms). The Content Validity Index was 1 for clarity of sentence and correct use of technical terms, and 0.8 for adaptation and preservation of the original meaning. The Kappa index for concordance among the judges was 0.83. After an adjustment proposed by the judges, the S3 version was originated. Conclusion The Questão Chave had its content validity confirmed, which supports future studies that aim for its application in the target population to verify their psychometric properties.

Download Full-text

Validation of an instrument for systematizing nursing care in pediatrics

Revista Brasileira de Enfermagem ◽

10.1590/0034-7167-2020-0222 ◽

2021 ◽

Vol 74 (suppl 4) ◽

Author(s):

Thalys Maynnard Costa Ferreira ◽

Josefa Danielma Lopes Ferreira ◽

Carla Lidiane Jácome dos Santos ◽

Kenya de Lima Silva ◽

Jacira dos Santos Oliveira ◽

...

Keyword(s):

Data Collection ◽

Content Validity ◽

Pediatric Care ◽

Hospitalized Children ◽

Methodological Study ◽

Validity Index ◽

Cross Sectional ◽

Content Validity Index ◽

Pediatric Clinic ◽

Kappa Agreement

ABSTRACT Objective: to verify the validity of indicators’ content referring to the instrument for data collection in children aged 0 to 5 years hospitalized in a pediatric clinic. Method: a cross-sectional methodological study was carried out with 11 experts between January and May 2018. For data collection, the steps for validating the instrument’s content were respected. For data analysis, Content Validity Index and Kappa agreement analysis were used. Results: after content analysis, a Content Validity Index of 0.94 and Kappa 0.71 was issued according to the experts’ suggestions 81.9%. Therefore, the instrument was suitable for applicability. Conclusion: the instrument proved to be valid in terms of content for pediatric care, contributing significantly to improving care for hospitalized children aged 0 to 5 years.

Download Full-text

Turkish Adaptation of Diabetic Foot Ulcer Scale–Short Form

The International Journal of Lower Extremity Wounds ◽

10.1177/1534734620921036 ◽

2020 ◽

Vol 19 (3) ◽

pp. 269-274 ◽

Cited By ~ 2

Author(s):

İsmail Toygar ◽

Sadık Hançerlioğlu ◽

Selden Gül ◽

Tülün Utku ◽

Ilgın Yıldırım Şimşir ◽

...

Keyword(s):

Factor Analysis ◽

Diabetic Foot ◽

Content Validity ◽

Short Form ◽

University Hospital ◽

Validity And Reliability ◽

Turkish Version ◽

Patient Identification ◽

Validity Index ◽

Content Validity Index

The purpose of this study was to evaluate the validity and reliability of the Turkish version of the Diabetic Foot Scale–Short Form (DFS-SF). The study was cross-sectional and conducted between January and October 2019 in a diabetic foot council of a university hospital. A total of 194 diabetic foot patients participated in the study. A Patient Identification Form and DFS-SF were used for data collection. Forward and backward translations were used in language validity. Expert opinions were obtained to determine the Content Validity Index. To determine construct validity, exploratory factor analysis and confirmatory factor analysis were used. Cronbach’s α internal consistency coefficient, item-scale correlation, and test-retest reliability were used to evaluate reliability. It was found that Content Validity Index was 0.97 (0.86-1.00), the factor loading of scale varied from 0.378 to 0.982, Cronbach’s α value varied from 0.81 to 0.94, and item-total correlations were between 0.30 and 0.75. The Turkish version of the DFS-SF was found valid and reliable to measure the quality of life of diabetic foot patients.

Download Full-text

Chinesisation, adaptation and validation of the Chelsea Critical Care Physical Assessment Tool in critically ill patients: a cross-sectional observational study

BMJ Open ◽

10.1136/bmjopen-2020-045550 ◽

2021 ◽

Vol 11 (4) ◽

pp. e045550

Author(s):

Zhigang Zhang ◽

Guoqiang Wang ◽

Yuchen Wu ◽

Jin Guo ◽

Nannan Ding ◽

...

Keyword(s):

Critical Care ◽

Observational Study ◽

Critically Ill ◽

Content Validity ◽

Assessment Tool ◽

Western China ◽

Validity Index ◽

Cross Sectional ◽

Physical Assessment ◽

Content Validity Index

PurposeTo translate and adapt the Chelsea Critical Care Physical Assessment Tool (CPAx) into Chinese version (‘CPAx-Chi’), test the reliability and validity of CPAx-Chi, and verify the cut-off point for the diagnosis of intensive care unit-acquired weakness (ICU-AW).Study designCross-sectional observational study.MethodsForward and back translation, cross-cultural adaptation and pretesting of CPAx into CPAx-Chi were based on the Brislin model. Participants were recruited from the general ICU of five third-grade class-A hospitals in western China. Two hundred critically ill adult patients (median age: 53 years; 64% men) with duration of ICU stay ≥48 hours and Glasgow Coma Scale ≥11 were included in this study. Two researchers simultaneously and independently assessed eligible patients using the Medical Research Council Muscle Score (MRC-Score) and CPAx-Chi.ResultsThe content validity index of items was 0.889. The content validity index of scale was 0.955. Taking the MRC-Score scale as standard, the criterion validity of CPAx-Chi was r=0.758 (p<0.001) for researcher A, and r=0.65 (p<0.001) for researcher B. Cronbach’s α was 0.939. The inter-rater reliability was 0.902 (p<0.001). The area under the receiver operating characteristic curves of CPAx-Chi for diagnosing ICU-AW based on MRC-Score ≤48 were 0.899 (95% CI 0.862 to 1.025) and 0.874 (95% CI 0.824 to 0.925) for researcher B. The best cut-off point for CPAx-Chi for the diagnosis of ICU-AW was 31.5. The sensitivity was 87% and specificity was 77% for researcher A, whereas it was 0.621, 31.5, 75% and 87% for researcher B, respectively. The consistency was high when taking CPAx-Chi ≤31 and MRC-Score ≤48 as the cut-off points for the diagnosis of ICU-AW. Cohen’s kappa=0.845 (p=0.02) in researcher A and 0.839 (p=0.04) for researcher B.ConclusionsCPAx-Chi demonstrated content validity, criterion-related validity and reliability. CPAx-Chi showed the best accuracy in assessment of patients at risk of ICU-AW with good sensitivity and specificity at a recommended cut-off of 31.

Download Full-text

The German RECAP questionnaire: linguistic validation and cognitive debriefing in German adults with self-reported atopic eczema and parents of affected children

Journal of Patient-Reported Outcomes ◽

10.1186/s41687-021-00285-2 ◽

2021 ◽

Vol 5 (1) ◽

Author(s):

Michaela Gabes ◽

Christina Tischer ◽

Anne Herrmann ◽

Laura Howells ◽

Christian Apfelbacher

Keyword(s):

Atopic Eczema ◽

Content Validity ◽

Qualitative Content Analysis ◽

Recall Period ◽

Measurement Properties ◽

German Population ◽

German Version ◽

Health Measurement ◽

Response Options ◽

Patient Reported

Abstract Background Recap of atopic eczema (RECAP) is a patient-reported outcome measure (PROM) assessing eczema control. Long-term control of eczema is one of the four core outcome domains for atopic eczema trials. This instrument has been recently developed in the UK. Objective This study aimed to translate the English RECAP into German and test its content validity in a German population with self-reported atopic eczema. Methods A six-step procedure including two forward and one backward translations, two consensus decisions and an expert review was performed to obtain a German version of RECAP. We conducted semi-standardized cognitive interviews with adults with atopic eczema (n = 7) and parents having children affected by this disease (n = 5). A “think-aloud” method was used and aspects of comprehensibility, comprehensiveness and relevance according to the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria were examined. Interviews were coded using qualitative content analysis. Results No particular linguistic problems were encountered during forward-backward translation. Minor wording changes were made as required. The title was adjusted to a more familiar German term of the disease (which is ‘Neurodermitis’). The recall period was rephrased from ‘over the last week’ to ‘over the last seven days’ since there was a different cultural understanding of the time frame. Regarding content validity, the items of the German RECAP were considered to be comprehensible, comprehensive and relevant for the participants and parents of affected children. The participants understood the instruction and considered the one-week recall period and the response options as appropriate. Conclusions A German version of RECAP that is linguistically equivalent to the original version is now available but further assessment of its measurement properties is needed.

Download Full-text