Test–Retest Reliability and Temporal Agreement of Direct and Indirect Sexual Interest Measures

The Explicit and Implicit Sexual Interest Profile (EISIP) is a multimethod measure of sexual interest in children and adults. It combines indirect latency-based measures such as the Implicit Association Test (IAT), Viewing Time (VT), and explicit self-report measures. This study examined test–retest reliability and absolute temporal agreement of the EISIP over a 2-week interval in persons who were convicted of sexual offenses against children ( n = 33) and nonoffending controls ( n = 48). Test–retest reliability of the aggregated EISIP measures was high across the whole sample ( rtt = .90, intraclass correlation coefficient [ICC] = .90) with the IAT yielding the lowest retest correlations ( rtt = .66, ICC = .66). However, these indicators of relative reliability only quantify the temporal stability of individual differences within the group, not the detectability of individual change. Absolute temporal agreement as assessed via Bland–Altman plots ranged from one fourth to three thirds of a standardized unit in the sexual preference scores. This implies that individual change has to exceed medium to large standardized effect sizes to be distinguishable from spontaneous temporal variation in the EISIP measures. Overall, scores of combined measures were largely superior to single measures in terms of both absolute and relative reliability.

Download Full-text

Psychometric properties of a self-report version of the Sexual Interest and Desire Inventory for Women (SIDI-F-SR)

10.31219/osf.io/8ghda ◽

2020 ◽

Cited By ~ 1

Author(s):

Julia Velten ◽

Gerrit Hirschfeld ◽

Milena Meyers ◽

Jürgen Margraf

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Sexual Interest ◽

Intraclass Correlation ◽

Self Report ◽

Clinical Psychologist ◽

Retest Reliability ◽

Absolute Agreement ◽

Test Retest Reliability ◽

Restriction Of Range

Background: The Sexual Interest and Desire Inventory Female (SIDI-F) is a clinician-administered scale that allows for a comprehensive assessment of symptoms related to Hypoactive Sexual Desire Dysfunction (HSDD). As self-report questionnaires may facilitate less socially desirable responding and as time and resources are scarce in many clinical and research settings, a self-report version was developed (SIDI-F-SR). Aim: To investigate the agreement between the SIDI-F and a self-report version (SIDI-F-SR) and assess psychometric properties of the SIDI-F-SR. Methods: A total of 170 women (Mage=36.61, SD=10.61, range=20-69) with HSDD provided data on the SIDI-F, administered by a clinical psychologist via telephone, and the SIDI-F-SR, delivered as an Internet-based questionnaire. A subset of 19 women answered the SIDI-F-SR twice over a period of 14 weeks. Outcomes: Intraclass correlation as well as predictors of absolute agreement between SIDI-F and SIDI-F-SR, as well as internal consistency, test-retest reliability, and criterion-related validity of the SIDI-F-SR were examined. Results: There was high agreement between SIDI-F and SIDI-F-SR (ICC=.86). On average, women scored about one point higher in the self-report vs. the clinician-administered scale. Agreement was higher in young women and those with severe symptoms. Internal consistency of the SIDI-F-SR was acceptable (α=.76) and comparable to the SIDI-F (α=.74). When corrections for the restriction of range were applied, internal consistency of the SIDI-F-SR increased to .91. Test-retest-reliability was good (r=.74). Criterion-related validity was low but comparable between SIDI-F and SIDI-F-SR.

Download Full-text

A new visual feedback-based system for the assessment of pinch force, endurance, accuracy and precision. A test-retest reliability study

Hand Therapy ◽

10.1177/17589983211002550 ◽

2021 ◽

pp. 175899832110025

Author(s):

Alberto Dottor ◽

Eleonora Camerone ◽

Mirko Job ◽

Diletta Barbiani ◽

Elisa Frisaldi ◽

...

Keyword(s):

Visual Feedback ◽

Intraclass Correlation ◽

Precision Grip ◽

Voluntary Contraction ◽

Good Reliability ◽

Retest Reliability ◽

Relative Reliability ◽

Time Accuracy ◽

In The Beginning ◽

Test Retest Reliability

Introduction Given that pinch is a precision grip involved in sustained submaximal activities, a Sustained Contraction (SC) task could be associated to Maximal Voluntary Contraction (MVC). To better evaluate the thumb-index system, the test-retest reliability of pinch MVC and SC, measured by a visual feedback-based pinch gauge was assessed. Methods 26 healthy participants performed MVC and SC in two separate sessions. SC required to maintain 40%MVC as long as possible and it was evaluated in terms of time, accuracy (Mean Distance between force trace and target force, MD), precision (Coefficient of Variability of force trace, CV). MD and CV analyses were conducted dividing the SC task into three equivalent time stages (beginning, middle, exhaustion). Relative Reliability (RR) was measured by Intraclass Correlation Coefficient, and Absolute Reliability (AR) was measured by Standard Error of Measurement and by Bland-Altman plot. Results MVC and Time showed high RR and AR in both hands. RR of MD and CV in right hand was excellent in the beginning and middle stages, and fair in the exhaustion one, showing decreasing reliability as fatigue increases. In the left hand RR of MD and CV was generally lower. MD showed excellent reliability in the beginning stage and good reliability in the other stages. CV showed fair relative reliability at both beginning and middle stages, excellent in the last one. Conversely, it was observed high AR of MD and CV in all stages in both hands. Conclusions All indices are reliable to assess motor control of thumb-index pinch in both hands.

Download Full-text

The Modified Gait Efficacy Scale: Establishing the Psychometric Properties in Older Adults

Physical Therapy ◽

10.2522/ptj.20110053 ◽

2012 ◽

Vol 92 (2) ◽

pp. 318-328 ◽

Cited By ~ 41

Author(s):

Alaina M. Newell ◽

Jessie M. VanSwearingen ◽

Elizabeth Hile ◽

Jennifer S. Brach

Keyword(s):

Older Adults ◽

Correlation Coefficient ◽

Internal Consistency ◽

Intraclass Correlation ◽

Community Dwelling ◽

Self Report ◽

Retest Reliability ◽

And Performance ◽

Test Retest Reliability ◽

Community Dwelling Older Adults

BackgroundPerceived ability or confidence plays an important role in determining function and behavior. The modified Gait Efficacy Scale (mGES) is a 10-item self-report measure used to assess walking confidence under challenging everyday circumstances.ObjectiveThe purpose of this study was to determine the reliability, internal consistency, and validity of the mGES as a measure of gait in older adults.DesignThis was a cross-sectional study.MethodsParticipants were 102 community-dwelling older adults (mean [±SD] age=78.6±6.1 years) who were independent in ambulation with or without an assistive device. Participants were assessed using the mGES and measures of confidence and fear, measures of function and disability, and performance-based measures of mobility. In a subsample (n=26), the mGES was administered twice within a 1-month period to establish test-retest reliability through the intraclass correlation coefficient (ICC [2,1]). The standard error of measure (SEM) was determined from the ICC and standard deviation. The Cronbach α value was calculated to determine internal consistency. To establish the validity of the mGES, the Spearman rank order correlation coefficient was used to examine the association with measures of confidence, fear, gait, and physical function and disability.ResultsThe mGES demonstrated test-retest reliability within the 1-month period (ICC=.93, 95% confidence interval=.85, .97). The SEM of the mGES was 5.23. The mGES was internally consistent across the 10 items (Cronbach α=.94). The mGES was related to measures of confidence and fear (r=.54–.88), function and disability (Late-Life Function and Disability Instrument, r=.32–.88), and performance-based mobility (r=.38–.64).LimitationsThis study examined only community-dwelling older adults. The results, therefore, should not be generalized to other patient populations.ConclusionThe mGES is a reliable and valid measure of confidence in walking among community-dwelling older adults.

Download Full-text

Reliability and Validity of 2 Self-Report Measures to Assess Sedentary Behavior in Older Adults

Journal of Physical Activity and Health ◽

10.1123/jpah.2013-0546 ◽

2015 ◽

Vol 12 (5) ◽

pp. 727-732 ◽

Cited By ~ 22

Author(s):

Keith P. Gennuso ◽

Charles E. Matthews ◽

Lisa H. Colbert

Keyword(s):

Physical Activity ◽

Older Adults ◽

Sedentary Behavior ◽

Linear Trend ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Self Report ◽

Retest Reliability ◽

Test Retest Reliability

Background:The purpose of this study was to examine the reliability and validity of 2 currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults.Methods:Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin’s concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity.Results:Both surveys had moderate test-retest reliability (ICC: YPAS = 0.59 (P < .001), CHAMPS = 0.64 (P < .001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ = −0.0003); however, there was a linear increase (P < .01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin’s r = .005; 95% CI, −0.010 to 0.020), and no linear trend across CHAMPS quartiles (P = .53).Conclusions:Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research.

Download Full-text

Two-Week Test-Retest Reliability of the Duke Religion Index

Psychological Reports ◽

10.2466/pr0.94.3.993-994 ◽

2004 ◽

Vol 94 (3) ◽

pp. 993-994 ◽

Cited By ~ 36

Author(s):

Eric A. Storch ◽

Melissa S. Strawser ◽

Jason B. Storch

Keyword(s):

College Students ◽

Correlation Coefficient ◽

Intraclass Correlation Coefficient ◽

Intraclass Correlation ◽

Self Report ◽

Intrinsic Religiosity ◽

Retest Reliability ◽

Undergraduate College Students ◽

Test Retest Reliability

The present study investigated 2-wk. test-retest reliability of the Duke Religion Index, a 5-item self-report questionnaire that assesses organizational, nonorganizational, and intrinsic religiosity. The sample consisted of 20 undergraduate college students (11 women) whose mean age was 24.7 yr. ( SD = 5.0 yr.). Findings supported the 2-wk. test-retest reliability of the Duke Religion Index with an intraclass correlation coefficient of .91.

Download Full-text

Assessing the Psychometric Properties of an Activity Pacing Questionnaire for Chronic Pain and Fatigue

Physical Therapy ◽

10.2522/ptj.20140405 ◽

2015 ◽

Vol 95 (9) ◽

pp. 1274-1286 ◽

Cited By ~ 10

Author(s):

Deborah Antcliff ◽

Malcolm Campbell ◽

Steve Woby ◽

Philip Keeley

Keyword(s):

Chronic Pain ◽

Factor Analysis ◽

Psychometric Properties ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Self Report ◽

Long Term Conditions ◽

Retest Reliability ◽

Activity Planning ◽

Test Retest Reliability

Background Therapists frequently advise the use of activity pacing as a coping strategy to manage long-term conditions (eg, chronic low back pain, chronic widespread pain, chronic fatigue syndrome/myalgic encephalomyelitis). However, activity pacing has not been clearly operationalized, and there is a paucity of empirical evidence regarding pacing. This paucity of evidence may be partly due to the absence of a widely used pacing scale. To address the limitations of existing pacing scales, the 38-item Activity Pacing Questionnaire (APQ-38) was previously developed using the Delphi technique. Objective The aims of this study were: (1) to explore the psychometric properties of the APQ-38, (2) to identify underlying pacing themes, and (3) to assess the reliability and validity of the scale. Design This was a cross-sectional questionnaire study. Methods Three hundred eleven adult patients with chronic pain or fatigue participated, of whom 69 completed the test-retest analysis. Data obtained for the APQ-38 were analyzed using exploratory factor analysis, internal and test-retest reliability, and validity against 2 existing pacing subscales and validated measures of pain, fatigue, anxiety, depression, avoidance, and mental and physical function. Results Following factor analysis, 12 items were removed from the APQ-38, and 5 themes of pacing were identified in the resulting 26-item Activity Pacing Questionnaire (APQ-26): activity adjustment, activity consistency, activity progression, activity planning, and activity acceptance. These themes demonstrated satisfactory internal consistency (Cronbach α=.72–.92), test-retest reliability (intraclass correlation coefficient=.50–.78, P≤.001), and construct validity. Activity adjustment, activity progression, and activity acceptance correlated with worsened symptoms; activity consistency correlated with improved symptoms; and activity planning correlated with both improved and worsened symptoms. Limitations Data were collected from self-report questionnaires only. Conclusions Developed to be widely used across a heterogeneous group of patients with chronic pain or fatigue, the APQ-26 is multifaceted and demonstrates reliability and validity. Further study will explore the effects of pacing on patients' symptoms to guide therapists toward advising pacing themes with empirical benefits.

Download Full-text

Intra-Rater Test-Retest Reliability of a Modified Child Functioning Module, Self-Report Version

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph17196958 ◽

2020 ◽

Vol 17 (19) ◽

pp. 6958

Author(s):

Kwok Ng ◽

Piritta Asunta ◽

Niko Leppä ◽

Pauli Rintala

Keyword(s):

Intraclass Correlation ◽

Self Care ◽

Self Report ◽

Kappa Statistics ◽

Young Adolescents ◽

Special Educational Needs ◽

Child Functioning ◽

Retest Reliability ◽

Functional Difficulties ◽

Test Retest Reliability

Determining disability prevalence is a growing area for population statistics, especially among young adolescents. The Washington Group on Disability Statistics is one source of reporting disabilities through functional difficulties. Yet, young adolescents self-reporting through this measure is in its infancy. The purpose of this study was to carry out an intra-rater test-retest reliability study on a modified set of items for self-reporting functional difficulties. Young adolescents (N = 74; boys = 64%; age M = 13.7, SD = 1.8) with special educational needs in Finland completed a self-reported version of the Child Functioning Module in a supervised classroom. The second administration took place two weeks later. Intraclass correlation coefficient (ICC) and Kappa (k) statistics were used to test the reliability of the items, and interpretation took place through Landis and Koch, and Cohen, respectively. The majority of items had substantial or moderate agreement, although there was only fair agreement for self-care (ICC = 0.59), concentration (ICC = 0.50), and routine changes (ICC = 0.54). Kappa statistics of behavior control were interpreted to be large (k = 0.65), and seeing (k = 0.49), walking (k = 0.49), and speaking (k = 0.49) difficulties were moderate. The majority of the items in the self-reported version of the Child Functioning Module can be used in a scale format, although some caution may be required on items of self-care and concentration when used as a dichotomous variable.

Download Full-text

Test–Retest Reliability of Common Measures of Eating Disorder Symptoms in Men Versus Women

Assessment ◽

10.1177/1073191117700267 ◽

2017 ◽

Vol 26 (3) ◽

pp. 419-431 ◽

Cited By ~ 10

Author(s):

Kelsie T. Forbush ◽

Lindsay A. Hilderbrand ◽

Brittany K. Bohrer ◽

Danielle A. N. Chapa

Keyword(s):

Binge Eating ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Self Report ◽

Good Reliability ◽

Retest Reliability ◽

Intraclass Correlation Coefficients ◽

Eating Disorder Symptoms ◽

Disinhibited Eating ◽

Test Retest Reliability

Approximately 10% to 30% of individuals with eating disorders (EDs) are male, yet because measures often have not been tested among male participants, it is unclear whether the psychometric properties of ED measures are equivalent between sexes. The purpose of this study was to compare the test–retest reliability of common ED measures in men versus women. Participants ( N = 227; 58.1% female) completed self-report measures of body dissatisfaction, restrained eating, disinhibited eating, bulimic symptoms, and desire-for-muscularity at baseline and 2-to-4 weeks later. Intraclass correlations were used to compute retest correlations. Spearman’s rho was used to compute retest correlations for skewed and kurtotic variables. We compared 95% confidence intervals for intraclass correlation coefficients to determine whether measures differed in reliability between sexes. Most ED measures had at least acceptable test–retest reliabilities. However, few measures of disinhibited and binge eating demonstrated good reliability in men. Results highlight the utility of several ED measures for assessing symptom change over time, and the need for additional research to identify and correct for sources of gender unreliability among ED self-report measures in men—particularly for assessing constructs that include binge-eating behavior.

Download Full-text

The development and psychometric properties of a self-report Catastrophizing Questionnaire

Royal Society Open Science ◽

10.1098/rsos.201362 ◽

2021 ◽

Vol 8 (1) ◽

pp. 201362

Author(s):

Alexandra C. Pike ◽

Jade R. Serfaty ◽

Oliver J. Robinson

Keyword(s):

Discriminant Validity ◽

Intraclass Correlation ◽

Self Report ◽

Underlying Structure ◽

Short Version ◽

Good Test ◽

Retest Reliability ◽

Convergent And Discriminant Validity ◽

Exploratory Factor Analyses ◽

Test Retest Reliability

Catastrophizing is a cognitive process that can be defined as predicting the worst possible outcome. It has been shown to be related to psychiatric diagnoses such as depression and anxiety, yet there are no self-report questionnaires specifically measuring it outside the context of pain research. Here, we therefore develop a novel, comprehensive self-report measure of general catastrophizing. We performed five online studies (total n = 734), in which we created and refined a Catastrophizing Questionnaire, and used a factor analytic approach to understand its underlying structure. We also assessed convergent and discriminant validity, and analysed test–retest reliability. Furthermore, we tested the ability of Catastrophizing Questionnaire scores to predict relevant clinical variables over and above other questionnaires. Finally, we also developed a four-item short version of this questionnaire. We found that our questionnaire is best fit by a single underlying factor, and shows convergent and discriminant validity. Exploratory factor analyses indicated that catastrophizing is independent from other related constructs, including anxiety and worry. Moreover, we demonstrate incremental validity for this questionnaire in predicting diagnostic and medication status. Finally, we demonstrate that our Catastrophizing Questionnaire has good test–retest reliability (intraclass correlation coefficient = 0.77, p < 0.001). Critically, we can now, for the first time, obtain detailed self-report data on catastrophizing.

Download Full-text

The test–retest reliability of the Military Physical Loading Questionnaire (MPLQ)

BMJ Military Health ◽

10.1136/bmjmilitary-2020-001404 ◽

2020 ◽

pp. bmjmilitary-2020-001404 ◽

Cited By ~ 1

Author(s):

Russell J Coppack ◽

J L Bilzon ◽

A K Wills ◽

T Papadopoulou ◽

R P Cassidy ◽

...

Keyword(s):

Military Personnel ◽

Military Service ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Self Report ◽

Perfect Agreement ◽

Retest Reliability ◽

Physical Loading ◽

Test Retest Reliability ◽

The Military

IntroductionDespite the high prevalence of musculoskeletal injuries, there is a shortage of data quantifying the risk factors attributable to cumulative occupational demands among UK Military personnel. We developed a new comprehensive questionnaire that examines occupational and operational physical loading during military service. The aim of this study was to examine the test–retest reliability of the Military Physical Loading Questionnaire (MPLQ).MethodsIntraclass correlation coefficients (ICC) were used to evaluate the test–retest reliability (4-week interval) of the MPLQ on 18 occupational and 18 operational items in 50 male (mean age: 36 years; SD ±7.9) UK military personnel. A stratified analysis based on duration of Service (0–10 years, 11–20 years and ≥21 years) was conducted to assess whether stability of task items was dependent on participant length of recall. Internal consistency was assessed by Cronbach’s alpha (α) coefficients.ResultsReliability of individual operational items ranged from fair to almost perfect agreement (ICC range: 0.37–0.89; α range: 0.53–0.94) with most items demonstrating moderate to substantial reliability. Overall scores related to occupational items showed substantial to almost perfect agreement between administrations (ICC range: 0.73–0.94; α range: 0.84–0.96). Stratifying by duration of Service showed similar within group reliability to the entire sample and no pattern of decreasing or increasing reliability with length of recall period was observed.ConclusionsIt is essential that data used in planning UK military policy and health services are as accurate as possible. This study provides preliminary support for the MPLQ as a reliable self-report instrument for assessing the cumulative lifelong effects of occupational loading in UK military personnel. Further validation studies using larger and more demographically diverse military populations will support its interpretation in future epidemiological research.

Download Full-text