Concurrent and Predictive Criterion Validity of a Puppy Behaviour Questionnaire for Predicting Training Outcome in Juvenile Guide Dogs

Working dog organisations regularly assess the behaviour of puppies to monitor progression. Here, we tested the predictive validity (for predicting success in guide dog training) of a shortened version of a previously developed juvenile dog behaviour questionnaire (the refined puppy walker questionnaire, r-PWQ) and compared it with the Canine Behavioral Assessment and Research Questionnaire (C-BARQ). The r-PWQ is used by Guide Dogs UK, whereas the C-BARQ was designed for pet dogs and is used by some other guide dog schools internationally. A cohort of dogs aged eight months (n = 359) were scored concurrently on the r-PWQ and C-BARQ. Analogous traits between the questionnaires were evaluated for internal consistency and association with training outcome and compared for concurrent validity. The r-PWQ was associated with training outcome for five scales (r-Excitability, Trainability, Animal Chase, r-Attachment and attention seeking and Distractibility) and the C-BARQ for two scales (Excitability and Separation-related behaviour). There were significant correlations between analogous C-BARQ and r-PWQ trait scores (p < 0.001) except for Separation-related behaviour and questionnaire scales had similar internal consistencies. The r-PWQ may be more suitable to use with guide dog schools. However, due to the correlation between analogous scales (except for “Distractibility”) some scales could be substituted for one another when reviewing the behaviour of dogs between guide dog schools using different questionnaires.

Download Full-text

Psychometric Characteristics of the WISC-R Performance Scale with Deaf Children

Journal of Speech and Hearing Disorders ◽

10.1044/jshd.4401.73 ◽

1979 ◽

Vol 44 (1) ◽

pp. 73-79 ◽

Cited By ~ 11

Author(s):

Alfred Hirshoren ◽

Oliver L. Hurley ◽

Kenneth Kavale

Keyword(s):

Predictive Validity ◽

Internal Consistency ◽

Concurrent Validity ◽

Internal Consistency Reliability ◽

Achievement Test ◽

Deaf Children ◽

Test Results ◽

Psychometric Characteristics ◽

Standardization Sample ◽

Performance Scale

The WISC-R Performance Scale was administered to 59 prelingually deaf children; The internal consistency reliability of four of the subtests and the Performance IQ were assessed and found to be similar to the reliability reported by Wechsler (1974) with the standardization sample. Two aspects of criterion-related validity were computed. Concurrent validity as demonstrated by the correlation with the Hiskey-Nebraska Test of Learning Aptitude was found to be adequate. Predictive validity as defined by the correlation with achievement test results was also computed. Statistically significant correlations were found for six of the eight achievement areas. Implications for use are discussed.

Download Full-text

Psychometric Testing of the Support and Control in Birth Scale

10.21203/rs.2.16976/v2 ◽

2020 ◽

Author(s):

shuyu Liu ◽

Yu-Ying Lu ◽

Meei-ling Gau ◽

Chieh-Yu Liu

Keyword(s):

Predictive Validity ◽

Internal Consistency ◽

Content Validity ◽

Concurrent Validity ◽

Reliability And Validity ◽

Chinese Version ◽

Good Reliability ◽

Retest Reliability ◽

Test Retest Reliability ◽

And Control

Abstract Background: The Support and Control in Birth (SCIB) scale primarily measures the perceived support and control of expectant mothers during childbirth, thereby obtaining an understanding of their birth experiences. The advantages of this scale are its good reliability and validity and that it consolidates birth support and control. However, a Chinese version of the scale has yet to be developed. Therefore, this study sought to evaluate the validity and reliability of a Chinese version of the Support and Control in Birth Scale (C-SCIB). Methods: A total of 228 postpartum women participated in this study. The C-SCIB scale was developed through a translation and back translation, followed by an evaluation of its content validity by a group of experts. Cronbach's α internal consistency and test-retest reliability were used to test the reliability of the scale. In addition, criterion-related validity (predictive validity and concurrent validity) and construct validity were used to test the validity of the scale.Results: The C-SCIB scale showed good results in terms of the item-level and scale-level content validity indices. The Cronbach's α internal consistency was 0.81, and its test-retest reliability was 0.96. The confirmatory factor analysis results showed the overall goodness-of-fit was parsimony fit indices. The predictive validity analysis showed a significant positive correlation between the C-SCIB scale and the Questionnaire Measuring Attitudes About Labor and Delivery (r =0.31, p<0.01). Furthermore, the concurrent validity analysis showed a significant and moderate correlation between the C-SCIB and the Bryanton Adaptation of the Nursing Support in Labor Questionnaire (r =0.49, p< 0.01) as well as the Labor Agentry Scale (r =0.51, p< 0.01).Conclusion: The C-SCIB scale was proven to have good reliability and validity, and thus can be used to measure the degree of support and the locus of control perceived by expectant women during labor.

Download Full-text

Examining the Validity of Adaptive Comparative Judgment for Peer Evaluation in a Design Thinking Course

Frontiers in Education ◽

10.3389/feduc.2021.772832 ◽

2021 ◽

Vol 6 ◽

Author(s):

Nathan Mentzer ◽

Wonki Lee ◽

Scott Ronald Bartholomew

Keyword(s):

Construct Validity ◽

Predictive Validity ◽

Concurrent Validity ◽

Design Thinking ◽

Criterion Validity ◽

Comparative Judgment ◽

Peer Evaluation ◽

Adaptive Comparative Judgment ◽

Parameter Values

Adaptive comparative judgment (ACJ) is a holistic judgment approach used to evaluate the quality of something (e.g., student work) in which individuals are presented with pairs of work and select the better item from each pair. This approach has demonstrated high levels of reliability with less bias than other approaches, hence providing accurate values in summative and formative assessment in educational settings. Though ACJ itself has demonstrated significantly high reliability levels, relatively few studies have investigated the validity of peer-evaluated ACJ in the context of design thinking. This study explored peer-evaluation, facilitated through ACJ, in terms of construct validity and criterion validity (concurrent validity and predictive validity) in the context of a design thinking course. Using ACJ, undergraduate students (n = 597) who took a design thinking course during Spring 2019 were invited to evaluate design point-of-view (POV) statements written by their peers. As a result of this ACJ exercise, each POV statement attained a specific parameter value, which reflects the quality of POV statements. In order to examine the construct validity, researchers conducted a content analysis, comparing the contents of the 10 POV statements with highest scores (parameter values) and the 10 POV statements with the lowest scores (parameter values)—as derived from the ACJ session. For the criterion validity, we studied the relationship between peer-evaluated ACJ and grader’s rubric-based grading. To study the concurrent validity, we investigated the correlation between peer-evaluated ACJ parameter values and grades assigned by course instructors for the same POV writing task. Then, predictive validity was studied by exploring if peer-evaluated ACJ of POV statements were predictive of students’ grades on the final project. Results showed that the contents of the statements with the highest parameter values were of better quality compared to the statements with the lowest parameter values. Therefore, peer-evaluated ACJ showed construct validity. Also, though peer-evaluated ACJ did not show concurrent validity, it did show moderate predictive validity.

Download Full-text

The Stigma of Suicide Scale

Crisis ◽

10.1027/0227-5910/a000156 ◽

2013 ◽

Vol 34 (1) ◽

pp. 13-21 ◽

Cited By ~ 82

Author(s):

Philip J. Batterham ◽

Alison L. Calear ◽

Helen Christensen

Keyword(s):

Construct Validity ◽

Psychometric Properties ◽

Factor Structure ◽

Internal Consistency ◽

Concurrent Validity ◽

Online Survey ◽

National University ◽

Stigmatizing Attitudes ◽

High Internal Consistency ◽

At Home

Background: There are presently no validated scales to adequately measure the stigma of suicide in the community. The Stigma of Suicide Scale (SOSS) is a new scale containing 58 descriptors of a “typical” person who completes suicide. Aims: To validate the SOSS as a tool for assessing stigma toward suicide, to examine the scale’s factor structure, and to assess correlates of stigmatizing attitudes. Method: In March 2010, 676 staff and students at the Australian National University completed the scale in an online survey. The construct validity of the SOSS was assessed by comparing its factors with factors extracted from the Suicide Opinion Questionnaire (SOQ). Results: Three factors were identified: stigma, isolation/depression, and glorification/normalization. Each factor had high internal consistency and strong concurrent validity with the Suicide Opinion Questionnaire. More than 25% of respondents agreed that people who suicided were “weak,” “reckless,” or “selfish.” Respondents who were female, who had a psychology degree, or who spoke only English at home were less stigmatizing. A 16-item version of the scale also demonstrated robust psychometric properties. Conclusions: The SOSS is the first attitudes scale designed to directly measure the stigma of suicide in the community. Results suggest that psychoeducation may successfully reduce stigma.

Download Full-text

Validation of perinatal post-traumatic stress disorder questionnaire for Spanish women during the postpartum period

Scientific Reports ◽

10.1038/s41598-021-85144-2 ◽

2021 ◽

Vol 11 (1) ◽

Author(s):

Antonio Hernández-Martínez ◽

Sergio Martínez-Vázquez ◽

Julian Rodríguez-Almagro ◽

Khalid Saeed Khan ◽

Miguel Delgado-Rodríguez ◽

...

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Post Traumatic Stress Disorder ◽

Traumatic Stress ◽

Postnatal Depression ◽

Stress Disorder ◽

Criterion Validity ◽

Post Traumatic Stress ◽

Spanish Women ◽

Post Traumatic

AbstractTo determine the psychometric properties of the Perinatal Post-Traumatic Stress Disorder (PTSD) Questionnaire (PPQ) in Spanish. A cross-sectional study of 432 Spanish puerperal women was conducted, following ethical approval. The PPQ was administered online through midwives' associations across Spain. The Edinburgh Postnatal Depression Scale was used to diagnose postnatal depression for examining criterion validity. Data were collected on sociodemographic, obstetric, and neonatal variables. An exploratory factorial analysis (EFA) was performed with convergence and criterion validation. Internal consistency was evaluated using Cronbach's α. The EFA identified three components that explained 63.3% of variance. The PPQ's convergence validation associated the risk of PTSD with variables including birth plan, type of birth, hospital length of stay, hospital readmission, admission of the newborn to care unit, skin-to-skin contact, maternal feeding at discharge, maternal perception of partner support, and respect shown by healthcare professionals during childbirth and puerperium. The area under the ROC curve for the risk of postnatal depression (criterion validity) was 0.86 (95% CI 0.82–0.91). Internal consistency with Cronbach's α value was 0.896. The PPQ used when screening for PTSD in postpartum Spanish women showed adequate psychometric properties.

Download Full-text

Reliability and validity of the functioning assessment short test for older adults with bipolar disorder (FAST-O)

International Journal of Bipolar Disorders ◽

10.1186/s40345-020-00193-2 ◽

2020 ◽

Vol 8 (1) ◽

Author(s):

Melis Orhan ◽

Nicole Korten ◽

Ralph Kupka ◽

Patricia van Oppen ◽

Max Stek ◽

...

Keyword(s):

Older Adults ◽

Bipolar Disorder ◽

Internal Structure ◽

Internal Consistency ◽

Concurrent Validity ◽

Cronbach’S Alpha ◽

Occupational Functioning ◽

Cronbach's Alpha ◽

Short Test ◽

Functioning Assessment

Abstract Background Many frequently used instruments fail to assess psychosocial functioning in patients with bipolar disorder. The Functioning Assessment Short Test (FAST) was developed in order to tackle this problem and to assess the main functioning problems experienced by patients with bipolar disorder. However, the original FAST is not fully applicable in older adults due to the domain of occupational functioning. The aim of our study was to validate an adapted version for Older adults (FAST-O) in a group of older adults with bipolar disorder (OABD). Methods 88 patients aged 50 years and over diagnosed with bipolar disorder were included. We adapted the items in the area of “work-related functioning” of the FAST into items assessing “societal functioning”. Several measurements were conducted in order to analyse the psychometric qualities of the FAST-O (confirmatory factor analysis for internal structure, Cronbach’s alpha for internal consistency, Spearman’s rho for concurrent validity, Mann–Whitney U test for discriminant validity). Results Mean age in the study sample was 65.3 (SD = 7.5) and 57.3% was female. The internal structure was most similar to the internal structure of the original FAST. The internal consistency was excellent (Cronbach’s alpha = .93). The concurrent validity when correlated with the Social and Occupational Functioning Assessment Scale was low, but significant. The FAST-O was also able to distinguish between euthymic and symptomatic OABD patients. Conclusions The FAST-O has strong psychometric qualities. Based on our results, we can conclude that the FAST-O is a short, efficient solution in order to replace global rating scales or extensive test batteries in order to assess daily functioning of older psychiatric patients in a valid and reliable manner.

Download Full-text

Psychometric properties of instruments to measure parenting practices and children’s movement behaviors in low-income families from Brazil

BMC Medical Research Methodology ◽

10.1186/s12874-021-01320-y ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Widjane Sheila Ferreira Goncalves ◽

Rebecca Byrne ◽

Pedro Israel Cabral de Lira ◽

Marcelo Tavares Viana ◽

Stewart G. Trost

Keyword(s):

Physical Activity ◽

Internal Consistency ◽

Screen Time ◽

Parenting Practices ◽

Concurrent Validity ◽

Retest Reliability ◽

Culturally Adapted ◽

Total Movement ◽

Objectively Measured ◽

Test Retest Reliability

Abstract Background Childhood obesity has increased remarkably in low and middle-income (LMIC) countries. Movement behaviors (physical activity, screen time, and sleep) are crucial in the development of overweight and obesity in young children. Yet, few studies have investigated the relationship between children’s movement behaviors and parenting practices because validated measures for use among families from LMIC are lacking. This study evaluated the psychometric properties of previously validated measures of young children’s physical activity, screen time, and sleep and parenting practices, translated and culturally adapted to Brazilian families. Methods A total of 78 parent-child dyads completed an interviewer-administered survey twice within 7 days. Child physical activity, sedentary time and sleep were concurrently measured using a wrist-worn accelerometer. Internal consistency and test-retest reliability was assessed using McDonald’s Omega and Intraclass Correlation Coefficients (ICC’s). Concurrent validity was evaluated by calculating Spearman correlations between parent reported child behaviors and accelerometer measured behaviors. Results Seventeen of the 19 parenting practices scales exhibited acceptable internal consistency reliability (Ω ≥ 0.70). Test-retest reliability ICC’s were acceptable and ranged from 0.82 - 0.99. Parent reported child physical activity was positively correlated with objectively measured total movement (rho= 0.29 - 0.46, p < .05) and energetic play (rho= 0.29 – 0.40, p < .05). Parent reported child screen time was positively correlated with objectively measured sedentary time; (rho = 0.26, p < .05), and inversely correlated with total movement (rho = - 0.39 – - 0.41, p < .05) and energetic play (rho = - 0.37 – - 0.41, p < .05). Parent reported night-time sleep duration was significantly correlated with accelerometer measured sleep duration on weekdays (rho = 0.29, p < .05), but not weekends. Conclusions Measurement tools to assess children’s movement behaviors and parenting practices, translated and culturally adapted for use in Brazilian families, exhibited acceptable evidence of concurrent validity, internal consistency, and test-retest reliability.

Download Full-text

Validity, reliability, and calibration of the physical activity unit 7 item screener (PAU-7S) at population scale

International Journal of Behavioral Nutrition and Physical Activity ◽

10.1186/s12966-021-01169-w ◽

2021 ◽

Vol 18 (1) ◽

Author(s):

Helmut Schröder ◽

Isaac Subirana ◽

Julia Wärnberg ◽

María Medrano ◽

Marcela González-Gross ◽

...

Keyword(s):

Physical Activity ◽

Predictive Validity ◽

Internal Consistency ◽

Regression Models ◽

Weighted Kappa ◽

Linear Regression Models ◽

Retest Reliability ◽

Activity Unit ◽

Test Retest Reliability ◽

Acceptable Internal Consistency

Abstract Background Validation of self-reported tools, such as physical activity (PA) questionnaires, is crucial. The aim of this study was to determine test-retest reliability, internal consistency, and the concurrent, construct, and predictive validity of the short semi-quantitative Physical Activity Unit 7 item Screener (PAU-7S), using accelerometry as the reference measurement. The effect of linear calibration on PAU-7S validity was tested. Methods A randomized sample of 321 healthy children aged 8–16 years (149 boys, 172 girls) from the nationwide representative PASOS study completed the PAU-7S before and after wearing an accelerometer for at least 7 consecutive days. Weight, height, and waist circumference were measured. Cronbach alpha was calculated for internal consistency. Test-retest reliability was determined by intra-class correlation (ICC). Concurrent validity was assessed by ICC and Spearman correlation coefficient between moderate to vigorous PA (MVPA) derived by the PAU-7S and by accelerometer. Concordance between both methods was analyzed by absolute agreement, weighted kappa, and Bland-Altman statistics. Multiple linear regression models were fitted for construct validity and predictive validity was determined by leave-one-out cross-validation. Results The PAU-7S overestimated MVPA by 18%, compared to accelerometers (106.5 ± 77.0 vs 95.2 ± 33.2 min/day, respectively). A Cronbach alpha of 0.76 showed an acceptable internal consistency of the PAU-7S. Test-retest reliability was good (ICC 0.71 p < 0.001). Spearman correlation and ICC coefficients of MVPA derived by the PAU-7S and accelerometers increased from 0.31 to 0.62 and 0.20 to 0.62, respectively, after calibration of the PAU-7S. Between-methods concordance improved from a weighted kappa of 0.24 to 0.50 after calibration. A slight reduction in ICC, from 0.62 to 0.60, yielded good predictive validity. Multiple linear regression models showed an inverse association of MVPA with standardized body mass index (β − 0.162; p < 0.077) and waist to height ratio (β − 0.010; p < 0.014). All validity dimensions were somewhat stronger in boys compared to girls. Conclusion The PAU-7S shows a good test-retest reliability and acceptable internal consistency. All dimensions of validity increased from poor/fair to moderate/good after calibration. The PAU-7S is a valid instrument for measuring MVPA in children and adolescents. Trial registration Trial registration numberISRCTN34251612.

Download Full-text

Interview for Deterioration in Daily Living Activities in Dementia: construct and concurrent validity in patients with mild to moderate dementia

International Psychogeriatrics ◽

10.1017/s1041610211001785 ◽

2011 ◽

Vol 24 (3) ◽

pp. 382-390 ◽

Cited By ~ 14

Author(s):

Sebastian Voigt-Radloff ◽

Rainer Leonhart ◽

Matthias Schützwohl ◽

Luisa Jurjanz ◽

Thomas Reuster ◽

...

Keyword(s):

Activities Of Daily Living ◽

Internal Consistency ◽

Concurrent Validity ◽

Daily Living ◽

Factor Model ◽

Cognitive Testing ◽

Daily Living Activities ◽

Moderate Dementia ◽

Dementia Research ◽

And Performance

ABSTRACTBackground: The purpose of the study was to translate the Interview for Deterioration in Daily Living Activities in Dementia (IDDD) into German and to evaluate the construct and concurrent validity in people with mild to moderate dementia.Methods: IDDD data of two pooled samples (n = 301) were analyzed regarding ceiling and bottom effects, internal consistency, factor reliability and correlations with corresponding scales on cognition and activities of daily living.Results: We found minimal bottom (< 5%) and ceiling (≤ 2%) effects, good internal consistency (Cronbach's α > 0.7) and moderate to good factor reliability (0.66–0.87). Low correlations with cognition (Pearson coefficient: < 0.17) confirmed the differences between cognitive testing and activities of daily living (ADL). Minor correlations with other ADL scores (r < 0.2) indicated that different scores cover a different range of ADLs. The original two factor model could not be confirmed. A suggested four factor model distinguishing initiative and performance of basic and instrumental ADL demonstrated better indices of fit and higher correlations with corresponding scales.Conclusion: A four factor model of the IDDD can be used in dementia research for assessing initiative in and performance of basic and household activities of daily living. The findings suggest that ADL scales correlate only poorly and that further development of the IDDD is needed to cover a broader range of ADLs.

Download Full-text

Psychometric Evaluation of the Persian Version of Barkley Adult Attention Deficit/Hyperactivity Disorder Screening Tool among the Elderly

Scientifica ◽

10.1155/2017/9109783 ◽

2017 ◽

Vol 2017 ◽

pp. 1-6 ◽

Cited By ~ 1

Author(s):

Mostafa Sadeghi ◽

Homayoun Sadeghi-Bazargani ◽

Shahrokh Amiri

Keyword(s):

Attention Deficit Hyperactivity Disorder ◽

Internal Consistency ◽

Attention Deficit ◽

Concurrent Validity ◽

Rating Scale ◽

Retest Reliability ◽

Hyperactivity Disorder ◽

Persian Version ◽

Test Retest Reliability ◽

Tabriz City

Background. The Barkley Adult Attention Deficit/Hyperactivity Disorder (ADHD) Rating Scale-IV (BAARS-IV) was developed, and it demonstrated good psychometric properties. The BAARS-IV includes 27 questions on the symptoms of adult ADHD. The purpose of the present study is to investigate the psychometric testing of the Persian version of BAARS-IV among the elderlies in Tabriz City. Method. This cross-sectional study was conducted in Tabriz City—in the west of Iran—in 2015 via enrolling of 121 old-aged people. We did the process of translation and adaptation of BAARS-IV and examined its concurrent validity, internal consistency, and test-retest reliability. Result. The BAARS-IV demonstrated good internal consistency and test-retest reliability. Correlations between the BAARS-IV and the CAARS-S: SV were high and evidence supporting concurrent validity was revealed. Cronbach’s alpha for the overall scale and subscales stood at 0.89, 0.81, 0.66, 0.56, and 0.82, respectively. Conclusion. The Persian BAARS-IV showed acceptable reliability and validity. BAARS-IV was determined to be composed of internally consistent and psychometrically sound items.

Download Full-text