Validation of a Computerized Use of Time Recall for Activity Measurement in Advanced-Age Adults

2014 ◽  
Vol 22 (2) ◽  
pp. 245-254 ◽  
Author(s):  
Casey Jordan Mace ◽  
Ralph Maddison ◽  
Timothy Olds ◽  
Ngaire Kerse
Keyword(s):  
Physical Activity ◽  
Convergent Validity ◽  
Vigorous Physical Activity ◽  
Activity Level ◽  
Self Report ◽  
Advanced Age ◽  
Activity Measurement ◽  
Retest Reliability ◽  
Use Of Time ◽  
Test Retest Reliability

Background:The Multimedia Activity Recall for Children and Adults (MARCA) is a computerized recall instrument that records use of time during 24 hr the previous day and has been developed to address limitations of current self-report physical activity measures for those in advanced age.Methods:Test–retest reliability and convergent validity of the adult MARCA were assessed in a sample of 45 advanced-age adults (age 84.9SD ±1.62 yr) as a subsample of the Life and Living in Advanced-Age Cohort Study New Zealand (LiLACS NZ). Test–retest methods required participants to recall the previous day’s activity using the MARCA twice within the same day. Convergent validity was assessed against accelerometry.Results:Test–retest reliability was high, with ICCs greater than .99 for moderate to vigorous physical activity (MVPA) and physical activity level (PAL). Compared with accelerometry, the MARCA demonstrated validity comparable to other self-report instruments with Spearman’s coefficients of .34 and .59 for time spent in nonsedentary physical activity and PAL.Conclusion:The MARCA is a valid and reliable self-report tool for physical activity behaviors in advanced-age adults.

scholarly journals Convergent Validity and Test–Retest Reliability of the Oxford Physical Activity Questionnaire for Secondary School Students

2008 ◽  
Vol 25 (1) ◽  
pp. 23-34 ◽  
Author(s):  
David R. Lubans ◽  
Kathy Sylva ◽  
Zane Osborn
Keyword(s):  
Physical Activity ◽  
Convergent Validity ◽  
Rank Order ◽  
Vigorous Physical Activity ◽  
Intraclass Correlation ◽  
School Students ◽  
Retest Reliability ◽  
Physical Activity Questionnaire ◽  
Test Retest Reliability ◽  
Activity Questionnaire

AbstractThe purpose of this study was to examine the convergent validity and test–retest reliability of the Oxford Physical Activity Questionnaire (OPAQ), a self-administered questionnaire designed to assess the activity patterns of adolescents. The test–retest reliability of the OPAQ was assessed by administering the questionnaire on two occasions separated by 1 week (N = 87, mean age = 13.1 ± .9). Intraclass correlation (ICC) was used to examine the test–retest reliability of the OPAQ. The convergent validity of the OPAQ was evaluated using Caltrac accelerometers worn consecutively for 4 days (N = 51, mean age = 12.6 ± .5). Spearman's rank-order correlation was used to examine the convergent validity of the questionnaire. ICCs ranged from .76 to .91 and reliability was higher for males (r = .89) than females (r = .78). Correlations between self-reported physical activity and Caltrac accelerometer counts were related to vigorous physical activity (r = .33, p = .01) and moderate to vigorous activity (r = .32, p = .02). The OPAQ has excellent test–retest reliability and acceptable validity in comparison to other measures of youth physical activity.

Validation of the NARCOMS Registry: pain assessment

2005 ◽  
Vol 11 (3) ◽  
pp. 338-342 ◽  
Author(s):  
Ruth Ann Marrie ◽  
Gary Cutter ◽  
Tuula Tyry ◽  
Olympia Hadjimichael ◽  
Timothy Vollmer
Keyword(s):  
Multiple Sclerosis ◽  
Convergent Validity ◽  
Disease Duration ◽  
Self Report ◽  
Research Committee ◽  
Retest Reliability ◽  
The North ◽  
Disability Status ◽  
Pain Question ◽  
Test Retest Reliability

The North American Research Committee on Multiple Sclerosis (NARCOMS) Registry is a multiple sclerosis (MS) self-report registry with more than 24 000 participants. Participants report disability status upon enrolment, and semi-annually using Performance Scales (PS), Patient Determined Disease Steps (PDDS) and a pain question. In November 2000 and 2001, we also collected the Pain Effects Scale (PES). Our aim was to validate the NARCOMS pain question using the PES as our criterion measure. We measured correlations between the pain question and age, disease duration, various PS subscales and PDDS to assess construct validity. We correlated pain question responses in participants who reported no change in PDSS or the PS subscales between questionnaires to determine test—retest reliability. We measured responsiveness in participants who reported a substantial change in the sensory, spasticity PS subscales. The correlation between the pain question and PES was r=0.61 in November 2000, and r=0.64 in November 2001 (both P<0.0001). Correlations between the pain question and age, and disease duration were low, indicating divergent validity. Correlations between the pain question and spasticity, sensory PS subscales and PDSS were moderate, indicating convergent validity. Test—retest reliability was r=0.84 (P<0.0001). Responsiveness was 70.7%. The pain question is a valid self-report measure of pain in MS.

scholarly journals Reliability and Validity of the Commitment to Physical Activity Scale for Adolescents

2016 ◽  
Vol 31 (4) ◽  
pp. 343-352 ◽  
Author(s):  
Lorraine B. Robbins ◽  
Jiying Ling ◽  
Stacey M. Wesolek ◽  
Anamaria S. Kazanis ◽  
Kelly A. Bourne ◽  
...  
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Prospective Study ◽  
Vigorous Physical Activity ◽  
Reliability And Validity ◽  
Retest Reliability ◽  
Activity Scale ◽  
Test Retest Reliability ◽  
Physical Activity Scale ◽  
Item Scale

Purpose. To examine psychometric properties of a Commitment to Physical Activity Scale for Adolescents (CPASA). Design. Two test-retest studies and a prospective study, approved by a university institutional review board, were conducted in midwestern U.S. urban areas. Setting. The first test-retest study occurred in four community centers, the second test-retest study took place in a community school, and the prospective study occurred in eight middle schools. Subjects. To measure commitment at baseline and 1 week later, 51 girls in the first test-retest study completed an original 26-item scale, and 91 in the second test-retest study completed a revised 11-item scale. In the prospective study, 503 girls completed the 11-item scale. Measures. Commitment was measured via the CPASA. After completing the CPASA, girls in the prospective study wore ActiGraph GT3X-plus accelerometers that measured light, moderate, and vigorous physical activity (LMVPA) and moderate to vigorous physical activity (MVPA). Analysis. Internal consistency and test-retest reliability were estimated. Both exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were conducted to cross-validate the factor structure. Results. For the 11-item CPASA, Cronbach α ranged from .81 to .82, and test-retest reliability was .88. Both EFA and CFA indicated a single factor. The scale was significantly correlated with LMVPA (r = .10) and MVPA (r = .11). Conclusion. The 11-item CPASA demonstrated acceptable reliability and validity with girls.

Utility of Computer-Assisted Approaches for Population Surveillance of Physical Activity

2014 ◽  
Vol 11 (6) ◽  
pp. 1111-1119 ◽  
Author(s):  
MeLisa Creamer ◽  
Heather R. Bowles ◽  
Belinda von Hofe ◽  
Kelley Pettee Gabriel ◽  
Harold W. Kohl ◽  
...  
Keyword(s):  
Physical Activity ◽  
Convergent Validity ◽  
Telephone Interview ◽  
Video Data ◽  
The Internet ◽  
Computer Assisted ◽  
Self Administration ◽  
Retest Reliability ◽  
Internet Video ◽  
Test Retest Reliability

Background:Computer-assisted techniques may be a useful way to enhance physical activity surveillance and increase accuracy of reported behaviors.Purpose:Evaluate the reliability and validity of a physical activity (PA) self-report instrument administered by telephone and internet.Methods:The telephone-administered Active Australia Survey was adapted into 2 forms for internet self-administration: survey questions only (internet-text) and with videos demonstrating intensity (internet-video). Data were collected from 158 adults (20–69 years, 61% female) assigned to telephone (telephone-interview) (n = 56), internet-text (n = 51), or internet-video (n = 51). Participants wore an accelerometer and completed a logbook for 7 days. Test-retest reliability was assessed using intraclass correlation coefficients (ICC). Convergent validity was assessed using Spearman correlations.Results:Strong test-retest reliability was observed for PA variables in the internet-text (ICC = 0.69 to 0.88), internet-video (ICC = 0.66 to 0.79), and telephone-interview (ICC = 0.69 to 0.92) groups (P-values < 0.001). For total PA, correlations (ρ) between the survey and Actigraph+logbook were ρ = 0.47 for the internet-text group, ρ = 0.57 for the internet-video group, and ρ = 0.65 for the telephone-interview group. For vigorous-intensity activity, the correlations between the survey and Actigraph+logbook were 0.52 for internet-text, 0.57 for internet-video, and 0.65 for telephone-interview (P < .05).Conclusions:Internet-video of the survey had similar test-retest reliability and convergent validity when compared with the telephone-interview, and should continue to be developed.

Psychometric Properties of a Structured Diagnostic Interview for DSM-5 Anxiety, Mood, and Obsessive-Compulsive and Related Disorders

Assessment ◽  
2016 ◽  
Vol 25 (1) ◽  
pp. 3-13 ◽  
Author(s):  
David F. Tolin ◽  
Christina Gilliam ◽  
Bethany M. Wootton ◽  
William Bowe ◽  
Laura B. Bragdon ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Interrater Reliability ◽  
Diagnostic Interview ◽  
Self Report ◽  
Obsessive Compulsive ◽  
Reliability Data ◽  
Retest Reliability ◽  
Dsm 5 ◽  
Structured Diagnostic Interview ◽  
Test Retest Reliability

Three hundred sixty-two adult patients were administered the Diagnostic Interview for Anxiety, Mood, and OCD and Related Neuropsychiatric Disorders (DIAMOND). Of these, 121 provided interrater reliability data, and 115 provided test–retest reliability data. Participants also completed a battery of self-report measures that assess symptoms of anxiety, mood, and obsessive-compulsive and related disorders. Interrater reliability of DIAMOND anxiety, mood, and obsessive-compulsive and related diagnoses ranged from very good to excellent. Test–retest reliability of DIAMOND diagnoses ranged from good to excellent. Convergent validity was established by significant between-group comparisons on applicable self-report measures for nearly all diagnoses. The results of the present study indicate that the DIAMOND is a promising semistructured diagnostic interview for DSM-5 disorders.

scholarly journals Psychometric Properties of Persian Version of the Amphetamine Withdrawal Questionnaire Version 2 (AWQV2) in Patients with Methamphetamine-Type Substance Use Disorder

2020 ◽  
Vol 14 (4) ◽  
Author(s):  
Vahid Farnia ◽  
Mehdi Moradinazar ◽  
Nasrin Abdoli ◽  
Mostafa Alikhani ◽  
Mansour Rezaei ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Convergent Validity ◽  
Self Report ◽  
Cronbach’S Alpha ◽  
Retest Reliability ◽  
Cronbach's Alpha ◽  
Persian Version ◽  
Amphetamine Withdrawal ◽  
Questionnaire Version ◽  
Test Retest Reliability

Background: No standard self-report instrument for withdrawal symptoms is available in Iran. Objectives: This study aimed to evaluate the psychometric properties of the Persian version of the 10-item Amphetamine Withdrawal questionnaire version 2 (AWQV2). Methods: A sample of 388 methamphetamine addicts (215 females and 173 males) referred to addiction recovery centers and psychiatric ward of Farabi Hospital in Kermanshah. A two-stage random sampling method was used. The reliability and internal consistency of the AWQV2 items were examined using Cronbach’s alpha and test-retest reliability, respectively, and the instrument validity of the AWQV2 was measured using construct validity and convergent validity. Results: The AWQV2 had a Cronbach’s alpha of 0.72. Factor analysis using the main component analysis with a varimax rotation introduced three factors of hyperarousal, anxiety, and reversed vegetative symptoms. These factors explained 0.58 of the total variance. The coefficient of test-retest reliability at a 2-week interval was equal to 0.77. The convergent validity of the AWQV2 was examined by simultaneously administering the Advanced Warning of Relapse (AWARE) questionnaire to 40 subjects, with a correlation coefficient of 0.81. Conclusions: Based on the results, the AWQV2 has very good psychometric properties and may be used in research and therapeutic interventions.

scholarly journals Test-retest reliability of physical activity questionnaires in Parkinson’s disease

BMC Neurology ◽  
2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Samuel Ånfors ◽  
Ann-Sofi Kammerlind ◽  
Maria H. Nilsson
Keyword(s):  
Physical Activity ◽  
Parkinson’S Disease ◽  
Parkinson's Disease ◽  
Cognitive Impairment ◽  
Weighted Kappa ◽  
Activity Level ◽  
Single Item ◽  
Retest Reliability ◽  
Activity Questionnaires ◽  
Test Retest Reliability

Abstract Background People with Parkinson’s disease are less physically active than controls. It is important to promote physical activity, which can be assessed using different methods. Subjective measures include physical activity questionnaires, which are easy and cheap to administer in clinical practice. Knowledge of the psychometric properties of physical activity questionnaires for people with Parkinson’s disease is limited. The aim of this study was to evaluate the test-retest reliability of physical activity questionnaires in individuals with Parkinson’s disease without cognitive impairment. Methods Forty-nine individuals with Parkinson’s disease without cognitive impairment participated in a test-retest reliability study. At two outpatient visits 8 days apart, the participants completed comprehensive questionnaires and single-item questions: International Physical Activity Questionnaire-Short Form (IPAQ-SF), Physical Activity Scale for the Elderly (PASE), Saltin-Grimby Physical Activity Level Scale (SGPALS) and Health on Equal Terms (HOET). Test-retest reliability was evaluated using the intraclass correlation coefficient (ICC), standard error of measurement (SEM), limits of agreement, weighted kappa or the Svensson method. Results Several of the physical activity questionnaires had relatively low test-retest reliability, including the comprehensive questionnaires (IPAQ-SF and PASE). Total physical activity according to IPAQ-SF had an ICC value of 0.46 (95% confidence interval [CI], 0.21–0.66) and SEM was 2891 MET-min/week. The PASE total score had an ICC value of 0.66 (95% CI, 0.46–0.79), whereas the SEM was 30 points. The single-item scales of SGPALS-past six months (SGPALS-6 m) and HOET question 1 (HOET-q1) with longer time frames (6 or 12 months, respectively) showed better results. Weighted kappa values were 0.64 (95% CI, 0.45–0.83) for SGPALS-6 m and 0.60 (95% CI, 0.39–0.80) for HOET-q1, whereas the single-item questions with a shorter recall period had kappa values < 0.40. Conclusions Single-item questions with a longer time frame (6 or 12 months) for physical activity were shown to be more reliable than multi-item questionnaires such as the IPAQ-SF and PASE in individuals with Parkinson’s disease without cognitive impairments. There is a need to develop a core outcome set to measure physical activity in people with Parkinson’s disease, and there might be a need to develop new physical activity questionnaires.

scholarly journals Reliability and Validity of 2 Self-Report Measures to Assess Sedentary Behavior in Older Adults

2015 ◽  
Vol 12 (5) ◽  
pp. 727-732 ◽  
Author(s):  
Keith P. Gennuso ◽  
Charles E. Matthews ◽  
Lisa H. Colbert
Keyword(s):  
Physical Activity ◽  
Older Adults ◽  
Sedentary Behavior ◽  
Linear Trend ◽  
Pearson Correlation ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Self Report ◽  
Retest Reliability ◽  
Test Retest Reliability

Background:The purpose of this study was to examine the reliability and validity of 2 currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults.Methods:Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin’s concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity.Results:Both surveys had moderate test-retest reliability (ICC: YPAS = 0.59 (P < .001), CHAMPS = 0.64 (P < .001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ = −0.0003); however, there was a linear increase (P < .01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin’s r = .005; 95% CI, −0.010 to 0.020), and no linear trend across CHAMPS quartiles (P = .53).Conclusions:Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research.

scholarly journals The development and evaluation of a novel Internet-based computer program to assess previous-day dietary and physical activity behaviours in adults: the Synchronised Nutrition and Activity Program for Adults (SNAPA™)

2011 ◽  
Vol 107 (8) ◽  
pp. 1221-1231 ◽  
Author(s):  
Frances C. Hillier ◽  
Alan M. Batterham ◽  
Sean Crooks ◽  
Helen J. Moore ◽  
Carolyn D. Summerbell
Keyword(s):  
Physical Activity ◽  
Heart Rate ◽  
Vigorous Physical Activity ◽  
Retest Reliability ◽  
Mean Values ◽  
Promising Tool ◽  
Activity Program ◽  
Match Rate ◽  
Mean Differences ◽  
Test Retest Reliability

The Synchronised Nutrition and Activity Program for Adults (SNAPA™) was developed to address the need for accurate, reliable, feasible, inexpensive and low-burden methods for assessing specific dietary and physical activity behaviours in adults. Short-term test–retest reliability of SNAPA™ was assessed in forty-four adults (age 41·4 (sd 17·3) years) who completed SNAPA™ twice in 1 day. Concurrent validity against direct dietary observation and combined heart rate and accelerometry was assessed in seventy-seven adults (age 34·4 (sd11·1) years). Test–retest reliability revealed no substantial systematic shifts in mean values of the outcome variables: percentage of food energy from fat (% fat), number of portions of fruit and vegetables (FV) and minutes of moderate-to-vigorous physical activity (MVPA). For lunchtime dietary intake, the mean match rate between food items reported using SNAPA™ and those observed was 81·7 %, with a phantom rate of 5·6 %. Pearson's correlations between SNAPA™ and the reference methods ranged from 0·27 to 0·56 for % fat, FV portions and minutes of MVPA. For % fat and FV intake, there was no fixed or proportional bias, and mean differences between the methods (SNAPA™ − reference) were 5·1 % and 0 portions, respectively. For minutes of MVPA, a fixed bias of − 28 min was revealed when compared with all minutes of MVPA measured by combined heart rate and accelerometry, whereas a proportional bias (slope 1·47) was revealed when compared with minutes carried out in bouts ≥ 10 min. SNAPA™ is a promising tool for measuring specific energy balance behaviours, though further work is required to improve accuracy for physical activity behaviours.

scholarly journals Development and Validation of a Computerized Adaptive Assessment Tool for Discrimination and Measurement of Psychotic Symptoms

2020 ◽  
Author(s):  
Daniel Guinart ◽  
Renato de Filippis ◽  
Stella Rosson ◽  
Bhagyashree Patil ◽  
Lara Prizgint ◽  
...  
Keyword(s):  
Convergent Validity ◽  
Computerized Adaptive Testing ◽  
Rating Scale ◽  
Item Bank ◽  
Self Report ◽  
Psychotic Symptoms ◽  
Healthy Controls ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Measurement Efficiency

Abstract Objective Time constraints limit the use of measurement-based approaches in research and routine clinical management of psychosis. Computerized adaptive testing (CAT) can reduce administration time, thus increasing measurement efficiency. This study aimed to develop and test the capacity of the CAT-Psychosis battery, both self-administered and rater-administered, to measure the severity of psychotic symptoms and discriminate psychosis from healthy controls. Methods An item bank was developed and calibrated. Two raters administered CAT-Psychosis for inter-rater reliability (IRR). Subjects rated themselves and were retested within 7 days for test-retest reliability. The Brief Psychiatric Rating Scale (BPRS) was administered for convergent validity and chart diagnosis, and the Structured Clinical Interview (SCID) was used to test psychosis discriminant validity. Results Development and calibration study included 649 psychotic patients. Simulations revealed a correlation of r = .92 with the total 73-item bank score, using an average of 12 items. Validation study included 160 additional patients and 40 healthy controls. CAT-Psychosis showed convergent validity (clinician: r = 0.690; 95% confidence interval [95% CI]: 0.610–0.757; self-report: r = .690; 95% CI: 0.609–0.756), IRR (intraclass correlation coefficient [ICC] = 0.733; 95% CI: 0.611–0.828), and test-retest reliability (clinician ICC = 0.862; 95% CI: 0.767–0.922; self-report ICC = 0.815; 95%CI: 0.741–0.871). CAT-Psychosis could discriminate psychosis from healthy controls (clinician: area under the receiver operating characteristic curve [AUC] = 0.965, 95% CI: 0.945–0.984; self-report AUC = 0.850, 95% CI: 0.807–0.894). The median length of the clinician-administered assessment was 5 minutes (interquartile range [IQR]: 3:23–8:29 min) and 1 minute, 20 seconds (IQR: 0:57–2:09 min) for the self-report. Conclusion CAT-Psychosis can quickly and reliably assess the severity of psychosis and discriminate psychotic patients from healthy controls, creating an opportunity for frequent remote assessment and patient/population-level follow-up.

Sign in / Sign up

Export Citation Format

Share Document