When Alcohol Adverts Catch the Eye: A Psychometrically Reliable Dual-Probe Measure of Attentional Bias

Existing tasks assessing substance-related attentional biases are characterized by low internal consistency and test–retest reliability. This study aimed to assess the psychometric properties of a novel dual-probe task to measure alcohol-related attentional bias. Undergraduate students were recruited in June 2019 (N = 63; final N = 57; mean age = 20.88, SD = 2.63, 67% females). In the dual-probe task, participants were presented with simultaneous visual streams of adverts promoting either alcoholic or non-alcoholic drinks, and probes were presented in both streams. The dual-probe task measured the percentage of accurately identified probes that appeared on alcohol adverts in relation to total accuracy. The dual-probe task displayed excellent split-half reliability (M = 0.90, SD = 0.11; α = 0.90; 95% CI [0.84, 0.93]), and the derived attentional bias measure was significantly positively associated with beer drinking in a taste-test (r (57) = 0.33, p = 0.013; 95% CI [0.07, 0.54]), with habitual drinking (r (57) = 0.27, p = 0.045; 95% CI [0.01, 0.49]), and with increased craving (r (57) = 0.29, p = 0.031; 95% CI [0.03, 0.51]). Thus, the dual-probe task assessed attentional bias with excellent internal consistency and was associated with laboratory and habitual drinking measures, demonstrating initial support for the task’s utility in addiction research.

Download Full-text

Measuring Food-Related Attentional Bias

Frontiers in Psychology ◽

10.3389/fpsyg.2021.629115 ◽

2021 ◽

Vol 12 ◽

Author(s):

Stefania Franja ◽

Anna E. McCrae ◽

Tina Jahnel ◽

Ashley N. Gearhardt ◽

Stuart G. Ferguson

Keyword(s):

Reaction Time ◽

Attentional Bias ◽

Reaction Times ◽

Test Reliability ◽

Future Research ◽

Retest Reliability ◽

Probe Task ◽

Visual Probe ◽

The Stability ◽

Test Retest Reliability

Objective: Food-related attentional bias has been defined as the tendency to give preferential attention to food-related stimuli. Attentional bias is of interest as studies have found that increased attentional bias is associated with obesity; others, however, have not. A possible reason for mixed results may be that there is no agreed upon measure of attentional bias: studies differ in both measurement and scoring of attentional bias. Additionally, little is known about the stability of attentional bias over time. The present study aims to compare attentional bias measures generated from commonly used attentional bias tasks and scoring protocols, and to test re-test reliability.Methods: As part of a larger study, 69 participants (67% female) completed two food-related visual probe tasks at baseline: lexical (words as stimuli), and pictorial (pictures as stimuli). Reaction time bias scores (attentional bias scores) for each task were calculated in three different ways: by subtracting the reaction times for the trials where probes replaced (1) neutral stimuli from the trials where the probes replaced all food stimuli, (2) neutral stimuli from the trials where probes replaced high caloric food stimuli, and (3) neutral stimuli from low caloric food stimuli. This resulted in three separate attentional bias scores for each task. These reaction time results were then correlated. The pictorial visual probe task was administered a second time 14-days later to assess test-retest reliability.Results: Regardless of the scoring use, lexical attentional bias scores were minimal, suggesting minimal attentional bias. Pictorial task attentional bias scores were larger, suggesting greater attentional bias. The correlation between the various scores was relatively small (r = 0.13–0.20). Similarly, test-retest reliability for the pictorial task was poor regardless of how the test was scored (r = 0.20–0.41).Conclusion: These results suggest that at least some of the variation in findings across attentional bias studies could be due to differences in the way that attentional bias is measured. Future research may benefit from either combining eye-tracking measurements in addition to reaction times.

Download Full-text

Construct Validity and Test–Retest Reliability of the Automated Vehicle User Perception Survey

Frontiers in Psychology ◽

10.3389/fpsyg.2021.626791 ◽

2021 ◽

Vol 12 ◽

Author(s):

Justin Mason ◽

Sherrilene Classen ◽

James Wersal ◽

Virginia Sisiopiku

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Well Being ◽

The United States ◽

User Perception ◽

Retest Reliability ◽

Automated Vehicle ◽

Excellent Internal Consistency ◽

Test Retest Reliability ◽

Perception Survey

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, internal consistency was assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a) Intention to use; (b) perceived barriers; and (c) well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale = 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (range Hscale = 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N = 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N = 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs.

Download Full-text

Psychometric Properties of the Chinese Version of the Personality Inventory for DSM-5 Brief Form in Undergraduate Students and Clinical Patients

10.21203/rs.3.rs-45917/v1 ◽

2020 ◽

Author(s):

Panwen Zhang ◽

Zirong Ouyang ◽

Shulin Fang ◽

Jiayue He ◽

Lejia Fan ◽

...

Keyword(s):

Factor Analysis ◽

Psychometric Properties ◽

Personality Disorders ◽

Measurement Invariance ◽

Undergraduate Students ◽

Internal Consistency ◽

Clinical Sample ◽

Chinese Version ◽

Dsm 5 ◽

Test Retest Reliability

Abstract Background: The Personality Inventory for DSM-5 Brief Form (PID-5-BF) is a 25-item measuring tool evaluating maladaptive personality traits for diagnosis of personality disorders(PDs). As a promising scale, its impressive psychometric properties has been verified in some countries, however, there has no studies about the utility of PID-5-BF in Chinese settings. The current study aimed to examine cultural applicability of the Chinese version of PID-5-BF among undergraduate students and clinical patients.Methods: 7155 undergraduate students and 302 clinical patients completed the Chinese version of PID-5-BF. 228 students were chosen randomly for test-retest reliability at a 4-week interval. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were conducted to discover the most suitable construct in Chinese, measurement invariance(MI), internal consistency and external validity were also calculated. Results: An exploratory six-factor model was supported more suitable in both samples(Undergraduate sample: CFI = 0.905, TLI = 0.888, RMSEA = 0.044, SRMR = 0.039; Clinical sample: CFI = 0.904, TLI = 0.886, RMSEA = 0.044, SRMR = 0.063), adding a new factor“Interpersonal Relationships”. Measurement invariance across non-clinical and clinical sample was established(configural, weak, strong MI, and partial strict MI). Aside from acceptable internal consistency(Undergraduate sample: alpha=0.84, MIC=0.21; Clinical sample: alpha=0.82, MIC=0.16) and test-retest reliability(0.73), the association with 220-item PID-5 was significant(r = 0.93, p < 0.01), and six PDs measured by Personality diagnostic questionnaire-4+ (PDQ-4+) was correlated with expected domains of PID-5-BF. Conclusions: The Chinese version of the PID-5-BF showed satisfactory psychometric properties, which is a convenient and useful screening tool for personality disorders.

Download Full-text

Addicted to Exercise

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000084 ◽

2012 ◽

Vol 28 (1) ◽

pp. 3-10 ◽

Cited By ~ 9

Author(s):

Irini S. Parastatidou ◽

Georgios Doganis ◽

Yannis Theodorakis ◽

Symeon P. Vlachopoulos

Keyword(s):

Internal Consistency ◽

Concurrent Validity ◽

Discriminant Validity ◽

Factor Model ◽

Validity And Reliability ◽

Retest Reliability ◽

Confirmatory Factor ◽

Initial Support ◽

Dependence Scale ◽

Test Retest Reliability

The study examines the factor structure, internal consistency, concurrent and discriminant validity, and test-retest reliability of the Exercise Dependence Scale-Revised scores (EDS-R: Symons-Downs, Hausenblas, & Niggs, 2004 ) in a sample of Greek exercise participants. The Greek translation of the EDS-R was completed by 581 exercise participants along with measures of exercise addiction. Confirmatory factor analysis provided support for the hypothesized EDS-R correlated 7-factor model along with evidence for strong item loadings and factor discriminant validity. Further evidence emerged in favor of the internal consistency, concurrent validity, and test-retest reliability of the translated EDS-R scores. The results provide initial support for various aspects of the validity and reliability of the translated-into-Greek EDS-R scores.

Download Full-text

Validation of the research capacity and culture (RCC) tool: measuring RCC at individual, team and organisation levels

Australian Journal of Primary Health ◽

10.1071/py10081 ◽

2012 ◽

Vol 18 (1) ◽

pp. 62 ◽

Cited By ~ 41

Author(s):

Libby Holden ◽

Susan Pager ◽

Xanthe Golenko ◽

Robert S. Ware

Keyword(s):

Internal Consistency ◽

Health Workers ◽

Research Capacity ◽

Research Culture ◽

Retest Reliability ◽

Item Level ◽

Excellent Internal Consistency ◽

Domain Organisation ◽

Test Retest Reliability ◽

Level Analysis

Research capacity building (RCB) in Australia has recently focussed on strategies that take a whole of system approach to developing research culture at individual, team and organisation levels. Although a theoretical framework exists, no tool has been published that quantitatively measures the effectiveness of RCB interventions aimed at these three levels. A sample of 134 allied health workers was used to validate the research capacity and culture (RCC) tool. Item level analysis was undertaken using Cronbach’s α and exploratory factor analysis, and test–retest reliability was examined using intra-class correlations (ICC). The tool had one factor emerge for each domain, with excellent internal consistency for organisation, team and individual domains (α = 0.95, 0.96 and 0.96 respectively; and factor loadings ranges of 0.58–0.89, 0.65–0.89 and 0.59–0.93 respectively). The overall mean score (total) for each domain was: 5.4 (inter-quartile range 3.9–7.7), 4.4 (IQR 2.6–6.1) and 3.9 (IQR 2.9–6) for the organisation, team and individual domains respectively. Test–retest reliability was strong for each domain: organisation ICC = 0.77, team ICC = 0.83 and individual ICC = 0.82. The RCC tool has three domains measuring research capacity and culture at organisation, team and individual levels. It demonstrates excellent internal consistency and strong test–retest reliability.

Download Full-text

A 2-Study Psychometric Evaluation of the Modified Dementia Worry Scale

American Journal of Alzheimer s Disease & Other Dementias® ◽

10.1177/1533317521995322 ◽

2021 ◽

Vol 36 ◽

pp. 153331752199532

Author(s):

Jennifer R. Roberts ◽

Molly Maxfield

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Convergent Validity ◽

Longitudinal Research ◽

Single Factor ◽

Good Test ◽

Retest Reliability ◽

Dementia Worry ◽

Excellent Internal Consistency ◽

Test Retest Reliability

A modified version of the Dementia Worry Scale (DWS) used the terminology “Alzheimer’s disease and related dementias” (versus the DWS’ use of “dementia”). Two studies investigated psychometric properties of the modified DWS (MDWS). Study 1 compared the psychometric properties of the DWS and MDWS; both versions had single factor structures and exhibited excellent internal consistency (αs ≥ .95). The MDWS exhibited greater test-retest reliability after a 4-week interval (DWS r = .68; MDWS r = .90). In Study 2, the MDWS again displayed a single factor structure, excellent internal consistency (α = .95), and good test-retest reliability after an 8-week interval (r = .78). Additionally, results support convergent validity between the MDWS and fear of dementia, subjective memory, general anxiety, health anxiety, and neuroticism. The MDWS is psychometrically consistent with the DWS, maintains strong test-retest reliability, and is appropriate for use in cross-sectional and longitudinal research.

Download Full-text

Psychometric properties of the Chinese version of the Personality Inventory for DSM-5 Brief Form in undergraduate students and clinical patients

10.21203/rs.3.rs-45917/v2 ◽

2020 ◽

Author(s):

Panwen Zhang ◽

Zirong Ouyang ◽

Shulin Fang ◽

Jiayue He ◽

Lejia Fan ◽

...

Keyword(s):

Factor Analysis ◽

Psychometric Properties ◽

Personality Disorders ◽

Measurement Invariance ◽

Undergraduate Students ◽

Internal Consistency ◽

Clinical Sample ◽

Chinese Version ◽

Dsm 5 ◽

Test Retest Reliability

Abstract Background: The Personality Inventory for DSM-5 Brief Form (PID-5-BF) is a 25-item measuring tool evaluating maladaptive personality traits for diagnosis of personality disorders(PDs). As a promising scale, its impressive psychometric properties has been verified in some countries, however, there has no studies about the utility of PID-5-BF in Chinese settings. The current study aimed to examine cultural applicability of the Chinese version of PID-5-BF among undergraduate students and clinical patients.Methods: 7155 undergraduate students and 451 clinical patients completed the Chinese version of PID-5-BF. 228 students were chosen randomly for test-retest reliability at a 4-week interval. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were conducted to discover the most suitable construct in Chinese, measurement invariance(MI), internal consistency and external validity were also calculated. Results: An exploratory six-factor model was supported more suitable in both samples(Undergraduate sample: CFI = 0.905, TLI = 0.888, RMSEA = 0.044, SRMR = 0.039; Clinical sample: CFI = 0.904, TLI = 0.886, RMSEA = 0.047, SRMR = 0.060), adding a new factor“Interpersonal Relationships”. Measurement invariance across non-clinical and clinical sample was established(configural, weak, strong MI, and partial strict MI). Aside from acceptable internal consistency(Undergraduate sample: alpha=0.84, MIC=0.21; Clinical sample: alpha=0.86, MIC=0.19) and test-retest reliability(0.73), the association with 220-item PID-5 was significant(r = 0.93, p < 0.01), and six PDs measured by Personality diagnostic questionnaire-4+ (PDQ-4+) was correlated with expected domains of PID-5-BF. Conclusions: The Chinese version of the PID-5-BF showed satisfactory psychometric properties, which is a convenient and useful screening tool for personality disorders.

Download Full-text

The Upper Extremity Functional Index: Reliability and Validity in Patients with Chronic Obstructive Pulmonary Disease

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph182010608 ◽

2021 ◽

Vol 18 (20) ◽

pp. 10608

Author(s):

Ali H. Alnahdi ◽

Ali Albarrati

Keyword(s):

Chronic Obstructive Pulmonary Disease ◽

Measurement Error ◽

Upper Extremity ◽

Internal Consistency ◽

Chronic Obstructive ◽

Functional Index ◽

Obstructive Pulmonary Disease ◽

Retest Reliability ◽

Excellent Internal Consistency ◽

Test Retest Reliability

The aim of the current study was to examine the psychometric properties of the upper extremity functional index (UEFI) in patients with chronic obstructive pulmonary disease (COPD). Seventy patients with stable COPD completed the UEFI and St. George Respiratory Questionnaire (SGRQ) and performed lung function tests in the first testing session. They completed the UEFI and the Global Rating of Change Scale in the second session, which was within ten days of the first session. The UEFI floor and ceiling effects, internal consistency, test–retest reliability, measurement error, and construct validity were examined. The UEFI was found to have no floor and ceiling effects. The UEFI was also found to have an excellent internal consistency (Cronbach’s alpha = 0.955) and an excellent test–retest reliability (ICC2,1 = 0.91). Totals of 4.85 points and 11.32 points represent the scale’s standard error of measurement, and a minimal detectable change at 90% confidence was used. The UEFI scores showed a significant correlation with the SGRQ activity domain (r = −0.66, p < 0.001) and differed significantly between participants with severe disease and those with mild disease (p = 0.03). The UEFI had no floor or ceiling issues, an excellent internal consistency, a good test–retest reliability, and an acceptable measurement error. The UEFI also demonstrated evidence supporting its construct validity as a measure of upper extremity-related activity limitations in patients with COPD.

Download Full-text

Reliability and Validity of Malayalam Version of 5-Item International Index of Erectile Function

JOURNAL FOR CLINICAL AND DIAGNOSTIC RESEARCH ◽

10.7860/jcdr/2021/50571.15391 ◽

2021 ◽

Author(s):

Aravind Karunakaran

Keyword(s):

Internal Consistency ◽

Erectile Function ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Good Test ◽

Medical College ◽

Group I ◽

Highly Sensitive ◽

Excellent Internal Consistency ◽

Test Retest Reliability

Introduction: Erectile Dysfunction (ED) is a common problem affecting men and it also negatively impacts mental health. A self administered questionnaire which is validated in local language will help in better detection of ED. Aim: To assess the reliability and validity of Malayalam version of 5 item International Index of Erectile Function (IIEF-5) in the Malayali population of India. Materials and Methods: This prospective observational study was done in Government Medical College, Thiruvananthapuram, India. A total of 136 subjects were recruited into the study after taking written informed consent. Subjects were divided into two groups. Group I included 68 subjects who had complaints of ED and group II included 68 subjects who had no complaints of ED. The subjects were administered Malayalam translated IIEF-5 at baseline and after four weeks. Results: Internal consistency of the Malayalam IIEF-5 was assessed using Cronbach’s alpha and the whole scale had an excellent internal consistency of 0.90. The 5 items had an overall Intraclass Correlation Coefficient (ICC) of 0.91 showing a good test retest reliability. The Malayalam version was also highly sensitive and specific to the change in ED after four weeks. Conclusion: This study shows that the Malayalam version of IIEF-5 is a reliable and valid tool for assessment of ED, making it useful as an initial screening tool in a clinical setting. The ease of administering and favourable diagnostic properties of Malayalam IIEF-5 can help in the reducing the number of undiagnosed cases of ED.

Download Full-text

Psychometric Properties of the Big Five Questionnaire for Children in a Sample of Kuwaiti University Undergraduates

Journal of Educational and Psychological Studies [JEPS] ◽

10.24200/jeps.vol12iss2pp379-400 ◽

2018 ◽

Vol 12 (2) ◽

pp. 379

Author(s):

Bader M. Al Ansari ◽

Talal B. Al Ali

Keyword(s):

Undergraduate Students ◽

Internal Consistency ◽

Big Five ◽

Criterion Validity ◽

Principle Components Analysis ◽

High Internal Consistency ◽

Components Analysis ◽

Test Retest Reliability ◽

University Undergraduates ◽

University Undergraduate Students

This study aimed to examine: (1) the internal consistency and the test-retest reliability of the Big Five Questionnaire for Children (BFQ-C) developed by Barbaranelli et al., (2003); (2) its five factor structure and (3) the criterion validity of the BFQ-C. The sample consisted of 745 Kuwaiti university undergraduate students (333 males, 412 females). Their age average was (M= 19.58 (SD = 1.12)). The results showed that Cronbach alpha's indicated high internal consistency. Principle components analysis showed that most of the items loaded convincingly on to their factors. The criterion validity of the BFQ-C was acceptable to high. It was concluded that the Arabic version of the BFQ-C could be used successfully with Kuwaiti university undergraduate students.

Download Full-text