scholarly journals The ICECAP-A instrument for capabilities: assessment of construct validity and test–retest reliability in a general Dutch population

2021 ◽  
Author(s):  
Pieter J. Rohrbach ◽  
Alexandra E. Dingemans ◽  
Brigitte A. Essers ◽  
Eric F. Van Furth ◽  
Philip Spinhoven ◽  
...  
Keyword(s):  
Construct Validity ◽  
Self Efficacy ◽  
Intraclass Correlation ◽  
Well Being ◽  
Added Value ◽  
Dutch Population ◽  
Retest Reliability ◽  
General Dutch Population ◽  
Adequate Test ◽  
Test Retest Reliability

Abstract Purpose The ICEpop CAPability measure for Adults (ICECAP-A) assesses five capabilities that are important to one’s well-being. The instrument might be an important addition to generic health questionnaires when evaluating quality of life extending beyond health. This study aimed to conduct a psychometric assessment of the Dutch translation of the ICECAP-A. Methods Construct validity of the instrument was assessed in two ways. First, by measuring correlations with the EQ-5D-5L questionnaire and a measure of self-efficacy and, second, by investigating the ability to distinguish between groups known to differ on the construct the ICECAP-A means to capture. Additionally, test–retest reliability was evaluated. Results In total, 1002 participants representative of the general Dutch population completed an online survey. For test–retest reliability, 252 participants completed the same questionnaire 2 weeks later. The ICECAP-A indicated moderate to strong correlations with the EQ-5D-5L and a strong correlation with self-efficacy. Furthermore, it was capable of differentiating known groups. Moreover, results indicated adequate test–retest reliability with an intraclass correlation coefficient of 0.79. Conclusion In summary, results suggest adequate test–retest reliability and construct validity and indicate that the ICECAP-A might be of added value, especially when considering areas outside of the traditional health intervention model.

Psychometric Analysis of an Ecological Vocal Effort Scale in Individuals With and Without Vocal Hyperfunction During Activities of Daily Living

2021 ◽  
pp. 1-16
Author(s):  
Katherine L. Marks ◽  
Alessandra Verdi ◽  
Laura E. Toles ◽  
Kaila L. Stipancic ◽  
Andrew J. Ortiz ◽  
...  
Keyword(s):  
Construct Validity ◽  
Intraclass Correlation ◽  
Muscle Tension ◽  
Voice Rehabilitation ◽  
Minimal Detectable Change ◽  
Retest Reliability ◽  
Vocal Hyperfunction ◽  
Before And After ◽  
Vocal Effort ◽  
Test Retest Reliability

Objective The purpose of this study was to examine the psychometric properties of an ecological vocal effort scale linked to a voicing task. Method Thirty-eight patients with nodules, 18 patients with muscle tension dysphonia, and 45 vocally healthy control individuals participated in a week of ambulatory voice monitoring. A global vocal status question was asked hourly throughout the day. Participants produced a vowel–consonant–vowel syllable string and rated the vocal effort needed to produce the task on a visual analog scale. Test–retest reliability was calculated for a subset using the intraclass correlation coefficient, ICC(A, 1). Construct validity was assessed by (a) comparing the weeklong vocal effort ratings between the patient and control groups and (b) comparing weeklong vocal effort ratings before and after voice rehabilitation in a subset of 25 patients. Cohen's d, the standard error of measurement ( SEM ), and the minimal detectable change (MDC) assessed sensitivity. The minimal clinically important difference (MCID) assessed responsiveness. Results Test–retest reliability was excellent, ICC(A, 1) = .96. Weeklong mean effort was statistically higher in the patients than in controls ( d = 1.62) and lower after voice rehabilitation ( d = 1.75), supporting construct validity and sensitivity. SEM was 4.14, MDC was 11.47, and MCID was 9.74. Since the MCID was within the error of the measure, we must rely upon the MDC to detect real changes in ecological vocal effort. Conclusion The ecological vocal effort scale offers a reliable, valid, and sensitive method of monitoring vocal effort changes during the daily life of individuals with and without vocal hyperfunction.

scholarly journals Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study (Preprint)

2020 ◽  
Author(s):  
Pim van Oirschot ◽  
Marco Heerings ◽  
Karine Wendrich ◽  
Bram den Teuling ◽  
Marijn B Martens ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Construct Validity ◽  
Validation Study ◽  
Intraclass Correlation ◽  
Study Participant ◽  
Smartphone App ◽  
Retest Reliability ◽  
Matched Group ◽  
Test Retest Reliability ◽  
Study Participants

BACKGROUND The decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS. OBJECTIVE The aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT). METHODS We performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the “HC matched” group) and 58 subjects had a less intense assessment schedule to determine reference values (the “HC normative” group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT. RESULTS The SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS. CONCLUSIONS The high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

Reliability and Validity of Turkish Myasthenia Gravis-Activities of Daily Living Scale

2020 ◽  
pp. 153944922096107
Author(s):  
Ecem Karanfil ◽  
Yeliz Salcı ◽  
Ayla Fil-Balkan ◽  
Can Ebru Bekircan-Kurt ◽  
Sevim Erdem Özdamar ◽  
...  
Keyword(s):  
Construct Validity ◽  
Myasthenia Gravis ◽  
Activities Of Daily Living ◽  
Daily Living ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Life Questionnaire ◽  
Good Test ◽  
Retest Reliability ◽  
Test Retest Reliability

Linguistic, reliable, and valid secondary efficacy measures are important in clinical settings and studies. The aim of the study is to report test–retest reliability and construct validity of Turkish version of Myasthenia Gravis-Activities of Daily Living Scale (MG-ADL-T) in Myasthenia Gravis (MG) patients. Fifty-two ocular and generalized individuals with MG, applying to rehabilitation center, were included in the study. MG-ADL-T, MG quality-of-life questionnaire (MG-QoL), MG composite (MGC), quantitative MG score (QMGS), and pulmonary function test were administered. Reliability was assessed with intraclass correlation coefficient (ICC) and Cronbach’s alpha. Spearman correlation test and receiver operating characteristic (ROC) analysis were performed for construct validity. MG-ADL-T had fair internal consistency (Cronbach’s α = .67), excellent test–retest reliability (ICC = 0.96) and moderate construct validity (MG-QoL, r = 0.59; QMGS, r = .58; MGC, r = .68). MG-ADL, a unique scale that evaluates activities of daily living (ADL), has good test–retest reliability and construct validity in Turkish MG patients.

scholarly journals Psychometric of the Curiosity and Exploration Inventory-II in Indonesia

2020 ◽  
Vol 9 (3) ◽  
Author(s):  
Anggi Setyowati ◽  
Min-Huey Chung ◽  
Ah. Yusuf ◽  
Setya Haksama
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Internal Consistency ◽  
Structural Model ◽  
Intraclass Correlation ◽  
Cronbach’S Alpha ◽  
Retest Reliability ◽  
Cronbach's Alpha ◽  
Test Retest Reliability ◽  
Exploration Inventory

Background: Curiosity is a personality characteristic, which fits with wellbeing and positive functioning. The objective of this study was to assess the construct validity of the Curiosity and Exploration Inventory II (CEI-II) in Indonesia.Design and Methods: The study included 256 undergraduate students who lived in Indonesia, mean age 19.8 years old. The CEI-II measures stretching and embracing using 11 items. The English version of CEI-II was translated into Bahasa. The Cronbach’s alpha coefficient and intraclass correlation coefficient (ICC) were addressed to examine internal consistency reliability and the test-retest reliability. To evaluate construct validity, exploratory factor analysis (EFA) was used to assess factor structure and confirmatory factor analysis (CFA) was used to evaluate the structural model fit of the CEI-II Indonesia version.Results: The study showed Cronbach’s alpha for the internal consistency of the overall CEI-II Indonesia version was 0.77. The ICC for the test-retest reliability ranged between 0.753-0.829. EFA showed adequate with the Kaiser-Meyer-Olkin value of 0.86 and the Bartlett’s test of sphericity was statistically significant. CFA tested the second-order model with two-order factors and showed a model fit.Conclusions: The CEI-II Indonesia version indicated acceptable construct validity to evaluate curiosity in Indonesia.

The most troublesome aspects of quality of life for people with advanced cancer in a supportive care trial

2006 ◽  
Vol 24 (18_suppl) ◽  
pp. 18527-18527
Author(s):  
A. K. Nowak
Keyword(s):  
Quality Of Life ◽  
Advanced Cancer ◽  
Intraclass Correlation ◽  
Well Being ◽  
Dry Mouth ◽  
Single Item ◽  
Retest Reliability ◽  
Data Form ◽  
Test Retest Reliability

18527 Background: ZEST is a placebo-controlled trial of sertraline for people with advanced cancer who feel depressed, anxious or tired but do not have a clear indication for antidepressants. We describe here the aspects of quality of life (QL) rated most troublesome at baseline by the first 150 subjects. Methods: Subjects completed a battery of QL questionnaires including the CES-D, HADS, FACT-G, FACT-Fatigue, and the Patient Disease and Treatment Assessment Form (Pt DATA Form). The Pt DATA Form assesses pertinent symptoms and concerns using 40 single items with a uniform response scale from 0 (no trouble at all) to 10 (worst I can imagine). Test-retest reliability was assessed with the intraclass correlation coefficient (ICC). Convergent validity was assessed by testing correlations between single items from the PT DATA Form and the corresponding, validated, multi-item scales. Results: The median age was 66 (IQR 59 to 73); median Karnofsky Perfomance Status was 80 (IQR 70 to 90); 63% were male; commonest primaries were colorectal (17%), lung (16%), prostate, (14%), breast (13%), and gynaecologic (10%). The aspects rated worst (mean score, proportion scoring >3) were: Fatigue (5.5, 90%), Problems with sex (4.1, 51%), Trouble sleeping (3.6, 49%), Drowsiness (3.5, 54%), Not feeling myself (3.5, 51%), Pain (3.4, 45%), Shortness of breath (3.4, 47%), Problems doing what I wanted (3.1, 45%), Anxiety (3.0, 40%), Depression (2.7, 36%), Dry mouth (2.7, 38%), Trouble concentrating (2.7, 30%), Irritability (2.6, 32%), Altered sense of taste (2.5, 34%), Difficulty walking (2.4, 32%), and Constipation (2.1, 24%). Mean scores were higher in men than women for Problems with sex (5.0 v 2.4, p < 0.001); and, in subjects aged 65 or younger for Hair loss (2.4 v 1.1, p = .01). There were no other significant differences by gender or age. Correlations supported the validity of the single item scales for depression, anxiety, fatigue; and for physical, emotional and overall well-being. The test-retest reliability of the Pt DATA Form was good (ICC >0.5 for 34 of 40 items). Conclusions: Pertinent aspects of QL were validly measured with single item scales. Insomnia, dry mouth, altered sense of taste and irritability were more troublesome than many other, better studied symptoms. No significant financial relationships to disclose.

Adaptation, Test-Retest Reliability, and Construct Validity of the Physical Activity Neighborhood Environment Scale in Nigeria (PANES-N)

2013 ◽  
Vol 10 (8) ◽  
pp. 1079-1090 ◽  
Author(s):  
Adewale L. Oyeyemi ◽  
James F. Sallis ◽  
Adetoyeje Y. Oyeyemi ◽  
Mariam M. Amin ◽  
Ilse De Bourdeaudhuij ◽  
...  
Keyword(s):  
Physical Activity ◽  
Construct Validity ◽  
Intraclass Correlation ◽  
Cognitive Testing ◽  
Neighborhood Environment ◽  
Analysis Of Covariance ◽  
Environmental Perceptions ◽  
Retest Reliability ◽  
Environment Scale ◽  
Test Retest Reliability

Background:This study adapted the Physical Activity Neighborhood Environment Scale (PANES) to the Nigerian context and assessed the test-retest reliability and construct validity of the Nigerian version (PANES-N).Methods:A multidisciplinary panel of experts adapted the original PANES to reflect the built and social environment of Nigeria. The adapted PANES was subjected to cognitive testing and test retest reliability in a diverse sample of Nigerian adults (N = 132) from different neighborhood types. Intraclass Correlation Coefficients (ICC) was used to assess test-retest reliability, and construct validity was investigated with Analysis of Covariance for differences in environmental attributes between neighborhoods.Results:Four of the 17 items on the original PANES were significantly modified, 3 were removed and 2 new items were incorporated into the final version of adapted PANES-N. Test-retest reliability was substantial to almost perfect (ICC = 0.62–1.00) for all items on the PANES-N, and residents of neighborhoods in the inner city reported higher residential density, land use mix and safety, but lower pedestrian facilities and aesthetics than did residents of government reserved area/new layout neighborhoods.Conclusion:The PANES-N appears promising for assessing environmental perceptions related to physical activity in Nigeria, but further testing is required to assess its applicability across Africa.

scholarly journals Construct Validity and Test–Retest Reliability of the Automated Vehicle User Perception Survey

2021 ◽  
Vol 12 ◽  
Author(s):  
Justin Mason ◽  
Sherrilene Classen ◽  
James Wersal ◽  
Virginia Sisiopiku
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Well Being ◽  
The United States ◽  
User Perception ◽  
Retest Reliability ◽  
Automated Vehicle ◽  
Excellent Internal Consistency ◽  
Test Retest Reliability ◽  
Perception Survey

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, internal consistency was assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a) Intention to use; (b) perceived barriers; and (c) well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale = 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (range Hscale = 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N = 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N = 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs.

The Validity, Reliability, and Responsiveness of the International Hip Outcome Tool–33 (iHOT-33) in Patients With Hip and Groin Pain Treated Without Surgery

2021 ◽  
pp. 036354652110271
Author(s):  
Mark J. Scholes ◽  
Matthew G. King ◽  
Kay M. Crossley ◽  
Denise M. Jones ◽  
Adam I. Semciw ◽  
...  
Keyword(s):  
Construct Validity ◽  
Content Validity ◽  
Groin Pain ◽  
Intraclass Correlation ◽  
Minimal Detectable Change ◽  
Global Rating ◽  
Group Level ◽  
Retest Reliability ◽  
Outcome Tool ◽  
Test Retest Reliability

Background: The International Hip Outcome Tool–33 (iHOT-33) was developed to evaluate patients seeking surgery for hip and/or groin (hip/groin) pain and may not be appropriate for those seeking nonsurgical treatment. Purpose: To evaluate the psychometric properties of the iHOT-33 total (iHOT-Total) score and all subscale scores in adults with hip/groin pain who were not seeking surgery. Study Design: Cohort study (diagnosis); Level of evidence, 3. Methods: Patients with hip/groin pain who were not seeking surgery were recruited from 2 ongoing studies in Australia. Semistructured one-on-one interviews assessed content validity. Construct validity was assessed by testing hypothesized correlations between iHOT-33 and Copenhagen Hip and Groin Outcome Score (HAGOS) subscale scores. Test-retest reliability was assessed in patients not undertaking treatment and who reported “no change” in their Global Rating of Change (GROC) score at 6-month follow-up. Scores were reliable at group and individual levels if intraclass correlation coefficients (ICCs) were ≥0.80 and ≥0.90, respectively. Scores were responsive if Spearman rank correlations (ρ) between the change in the iHOT-33 score and the GROC score were ≥0.40. Results: In total, 278 patients with hip/groin pain (93 women; mean age, 31 years) and 55 pain-free control participants (14 women; mean age, 29 years) were recruited. The iHOT-33 demonstrated acceptable content validity. Construct validity was acceptable, with all hypothesized strong positive correlations between iHOT-33 and HAGOS subscale scores confirmed ( r range, 0.60-0.76; P < .001), except for one correlation between the iHOT-Sport and HAGOS-Sport ( r = .058; P < .001). All scores were reliable at the group level, except for the iHOT-33 job subscale (iHOT-Job) (ICC range, 0.78-0.88 [95% CI, 0.60-0.93]). None of the subscales met the criteria for adequate reliability for use at the individual level (all ICCs <0.90). Minimal detectable change values (group level) ranged from 2.3 to 3.7 (95% CI, 1.7-5.0). All iHOT-33 subscale scores were responsive (ρ range, 0.40-0.58; P≤ .001), except for the iHOT-Job in patients not undertaking treatment (ρ = 0.27; P = .001). Conclusion: All iHOT-33 subscale scores were valid for use in patients with hip/groin pain who were not seeking surgery. Acceptable test-retest reliability was found for all subscale scores at the group level, except the iHOT-Job. All subscale scores, excluding the iHOT-Job, were responsive, regardless of undertaking physical therapist–led treatment or no treatment.

scholarly journals Acceptability, internal consistency and test–retest reliability of scales to assess parental and nursery staff’s self-efficacy, motivation and knowledge in relation to pre-school children’s nutrition, oral health and physical activity

2019 ◽  
Vol 22 (06) ◽  
pp. 967-975 ◽  
Author(s):  
Kaiseree Dias ◽  
James White ◽  
Chris Metcalfe ◽  
Ruth Kipping ◽  
Angeliki Papadaki ◽  
...  
Keyword(s):  
Physical Activity ◽  
Oral Health ◽  
Internal Consistency ◽  
Self Efficacy ◽  
Intraclass Correlation ◽  
Online Questionnaire ◽  
Retest Reliability ◽  
Parent Questionnaire ◽  
Children's Nutrition ◽  
Test Retest Reliability

AbstractObjectiveTo determine the acceptability, internal consistency and test–retest reliability of self-efficacy, motivation and knowledge scales relating to pre-school children’s nutrition, oral health and physical activity.DesignAn online questionnaire was completed twice with an interval of 7–11d.SettingOnline questionnaires were sent to participants via email from nursery managers. The parent questionnaire was also available on the parenting website www.netmums.com.ParticipantsEighty-two parents and sixty-nine nursery staff from Bristol, UK who had and worked with 2–4-year-olds, respectively.ResultsResponse rates were 86·3 and 86·0 % and missing data 15·9 and 14·5 % for the second administration of the parent and nursery staff questionnaires, respectively. Weighted κ coefficients for individual items mostly fell under the ‘moderate’ agreement category for the parental (75·0 %) and nursery staff (55·8 %) items. All self-efficacy and motivation scales had acceptable levels of internal consistency (Cronbach’s α coefficients&gt;0·7). The intraclass correlation coefficients for the self-efficacy, motivation and knowledge scales ranged between 0·48 and 0·82. Paired t tests found an increase between test and retest knowledge scores for the Nutrition Motivation (t=−2·91, df=81, P=0·00) and Knowledge (t=−3·22, df=81, P=0·00) scales in the parent questionnaire.ConclusionsOur findings demonstrate that the items and scales show good acceptability, internal consistency and test–retest reliability.

Sign in / Sign up

Export Citation Format

Share Document