scholarly journals Reliability and Validity Evidence for the Hawaii Early Learning Profile, Birth-3 Years

2018 ◽  
Vol 41 (1) ◽  
pp. 62-83 ◽  
Author(s):  
Zijia Li ◽  
Caroline Gooden ◽  
Michael D. Toland

This study provides preliminary evidence for reliability and validity of the Hawaii Early Learning Profile Strands 0-3 (HELP Strands 0-3), an assessment instrument for young children. First, the degree of interobserver agreement for a sample of representative HELP items was examined; results indicated that HELP scoring was dependable and consistent across 82 providers. Second, content validity was evaluated by having 12 early childhood experts align HELP items with their related strands (i.e., specific developmental areas) and rank the developmental order of items within each strand. The experts agreed with the HELP item-to-strand alignment and with the developmental order of items. Finally, convergent and discriminant validity evidence was provided by correlating HELP domain scores with Battelle Developmental Inventory–Second Edition (BDI-2) domain scores. Evidence for convergent validity was found between similar domains; discriminant validity was evidenced by low correlations between unrelated domains of HELP and BDI-2.

Assessment ◽  
2017 ◽  
Vol 26 (8) ◽  
pp. 1427-1443 ◽  
Author(s):  
Tanya L. Hopwood ◽  
Nicola S. Schutte ◽  
Natasha M. Loi

Two studies, with a total of 707 participants, developed and examined the reliability and validity of a measure for anticipatory traumatic reaction (ATR), a novel construct describing a form of distress that may occur in response to threat-related media reports and discussions. Exploratory and confirmatory factor analysis resulted in a scale comprising three subscales: feelings related to future threat; preparatory thoughts and actions; and disruption to daily activities. Internal consistency was .93 for the overall ATR scale. The ATR scale demonstrated convergent validity through associations with negative affect, depression, anxiety, stress, neuroticism, and repetitive negative thinking. The scale showed discriminant validity in relationships to Big Five characteristics. The ATR scale had some overlap with a measure of posttraumatic stress disorder, but also showed substantial separate variance. This research provides preliminary evidence for the novel construct of ATR as well as a measure of the construct. The ATR scale will allow researchers to further investigate anticipatory traumatic reaction in the fields of trauma, clinical practice, and social psychology.


2014 ◽  
Vol 52 (4) ◽  
pp. 273-281 ◽  
Author(s):  
Marquell Johnson ◽  
Joonkoo Yun ◽  
Jeffrey A. McCubbin

Abstract Self-reported physical activity (PA) behavior with assistance from a secondary source has previously been used with adults with an intellectual disability (ID). Limited evidence of reliability and validity have been provided for this approach. This study examined evidence of convergent (CV) and discriminant (DV) validity for self-report with assistance from a secondary source as a measure of PA in adults with ID. PA of 37 participants with ID were assessed using (a) self-report, (b) accelerometers, and (c) pedometers. The multitrait-multimethod (MTMM) analysis was used to evaluate validity. MTMM analysis revealed high reliability among variables, low to strong CV, and moderate DV. The study outcomes provide initial convergent and discriminant validity evidence for this measure of PA in adults with ID.


2019 ◽  
Vol 38 (4) ◽  
pp. 286-295 ◽  
Author(s):  
Wei-Ting Hsu ◽  
Min Pan

Purpose: To develop a measure of student-perceived teacher relation-inferred self-efficacy (RISE) support in physical education in terms of the Teacher RISE Support Scale, through a series of three studies. Methods: In Studies 1 and 2, interviews, exploratory factor analysis, and confirmatory factor analysis were conducted to develop a conceptually sound and psychometrically robust measure for teachers’ RISE-supporting behaviors. In Study 3, the authors examined the concurrent validity of teachers’ RISE support construct in relation to students’ RISE and relevant student outcomes. Results: The three-factor, second-order structure of the Teacher RISE Support Scale was confirmed, with results supporting construct validity and providing evidence of factorial, convergent, and discriminant validity. Furthermore, structural equation modeling supported concurrent validity, showing that students’ perceptions of teacher RISE support correlated positively with RISE and responsibility. Conclusions: Overall, the results provide preliminary evidence for the reliability and validity of the Teacher RISE Support Scale as a measurement for teacher RISE-supporting behaviors in physical education.


2016 ◽  
Vol 76 (6) ◽  
pp. 912-932 ◽  
Author(s):  
Tyler Hamby ◽  
Wyn Taylor

This study examined the predictors and psychometric outcomes of survey satisficing, wherein respondents provide quick, “good enough” answers (satisficing) rather than carefully considered answers (optimizing). We administered surveys to university students and respondents—half of whom held college degrees—from a for-pay survey website, and we used an experimental method to randomly assign the participants to survey formats, which presumably differed in task difficulty. Based on satisficing theory, we predicted that ability, motivation, and task difficulty would predict satisficing behavior and that satisficing would artificially inflate internal consistency reliability and both convergent and discriminant validity correlations. Indeed, results indicated effects for task difficulty and motivation in predicting survey satisficing, and satisficing in the first part of the study was associated with improved internal consistency reliability and convergent validity but also worse discriminant validity in the second part of the study. Implications for research designs and improvements are discussed.


Author(s):  
Karla Gallo-Giunzioni ◽  
María Prieto-Ursúa ◽  
Cristina Fernández-Belinchón ◽  
Octavio Luque-Reca

Given the scarcity of instruments in Spanish to measure forgiveness, two studies were conducted in this population to obtain validity evidence of the Heartland Forgiveness Scale (HFS), an instrument that measures dispositional forgiveness of self, others, and situations. In the first study, 203 students (65% women) participated. After ensuring the linguistic adequacy and clarity of the wording of the items, a lack of congruence was found between the factors obtained in the exploratory factor analysis and the original theoretical structure of the HFS. A sample of 512 participants (63.9% women) attended the second study. This study aimed to analyze the construct validity of the HFS using confirmatory factor analysis through structural equation modelling and to explore convergent, discriminant, and criterion validity. Of the different factorial configurations tested (including the original), only a scale reduction to eight items, grouped into three factors, showed an appropriate fit. The HFS eight-item version also showed acceptable internal consistency, adequate convergent and discriminant validity, and criterion validity with respect to related variables. These findings suggest that the eight-item version of the HFS may be a valid and reliable tool for assessing forgiveness for self, others, and situations in Spanish adults.


2020 ◽  
Vol 22 (Supplement_2) ◽  
pp. ii145-ii145
Author(s):  
Giuliana Zarrella ◽  
Alice Perez ◽  
Jorg Dietrich ◽  
Michael Parsons

Abstract INTRODUCTION Subjective cognitive dysfunction is an important outcome measure in neuro-oncology and may provide additional information beyond performance-based neuropsychological testing. The Functional Assessment of Cancer Therapy-Brain (FACT-Br) is a frequently used quality of life (QoL) measure that includes indices of physical, emotional, social, and neurologic aspects of disease, but does not measure cognitive concerns. This study seeks to develop and validate an index of self-reported cognition derived from existing items on the FACT-Br. METHODS 145 patients (Mage=51.08, Medu=15.63) with heterogeneous brain tumor diagnoses completed neuropsychological evaluation including cognitive testing and self-report measures. Nine FACT-Br items regarding cognition were combined to form the Cognitive Index (CI). Reliability of the CI was measured with Cronbach’s alpha. Concurrent validity was assessed by correlating the CI with the Patient-Reported Outcomes Measurement Information System (PROMIS) Cognitive Abilities-8 or PROMIS Cognitive Concerns-8. Discriminant validity was assessed by correlation of the CI with other FACT-Br indices and the Beck Depression and Anxiety Inventories (BDI, BAI). RESULTS Internal consistency within the CI was high (Cronbach’s a 0.864). The CI correlated strongly with the PROMIS-Abilities (r =.680; p< 0.001) and PROMIS-Concerns (r=.780; p< 0.001) indicating high convergent validity. Moderate correlations were observed between the CI and the physical and functional subscales of the FACT (r=.453 and .555), whereas correlations with the social and emotional functioning subscales were weaker (r=.381 and .325). The FACT-Br-CI correlated strongly with BDI (r=-.622) and more weakly with the BAI (r=-.344). Consistent with prior literature, the CI showed modest correlations with neuropsychological measures, including verbal memory encoding (r=.300), verbal fluency (r=.252) and a composite measure of cognition (r=.249; all p’s< .01). CONCLUSIONS The FACT-Br-CI is a reliable and valid measure of self-reported cognition. Studies that include the FACT-Br could be retrospectively analyzed to assess self-reported cognitive outcomes, enriching the information gained from prior research.


Assessment ◽  
2017 ◽  
Vol 26 (1) ◽  
pp. 17-44 ◽  
Author(s):  
David Watson ◽  
Ericka Nus ◽  
Kevin D. Wu

The Faceted Inventory of the Five-Factor Model (FI-FFM) is a comprehensive hierarchical measure of personality. The FI-FFM was created across five phases of scale development. It includes five facets apiece for neuroticism, extraversion, and conscientiousness; four facets within agreeableness; and three facets for openness. We present reliability and validity data obtained from three samples. The FI-FFM scales are internally consistent and highly stable over 2 weeks (retest rs ranged from .64 to .82, median r = .77). They show strong convergent and discriminant validity vis-à-vis the NEO, the Big Five Inventory, and the Personality Inventory for DSM-5. Moreover, self-ratings on the scales show moderate to strong agreement with corresponding ratings made by informants ( rs ranged from .26 to .66, median r = .42). Finally, in joint analyses with the NEO Personality Inventory–3, the FI-FFM neuroticism facet scales display significant incremental validity in predicting indicators of internalizing psychopathology.


2008 ◽  
Vol 29 (1) ◽  
pp. 17-24 ◽  
Author(s):  
H. Michael Crowson ◽  
Teresa K. DeBacker ◽  
Kendrick A. Davis

Abstract. Since the 1960s Rokeach's conception and measurement of dogmatism has dominated the landscape of dogmatism research. In 1996, Altemeyer proposed a new conception of dogmatism, suggesting that it is best defined as an unchangeable and unjustified certainty in one's beliefs. This conception was operationalized in the form of the DOG Scale with validity evidence generally coming in the form of relationships between the measure and several criterion-related variables. The present study assessed the factorial validity of the measure and tested for convergent and discriminant validity. Criterion-related validity evidence was also reconsidered. The DOG Scale demonstrated reasonable factorial, discriminant, convergent, and criterion-related validity, providing additional support for the measure's construct validity.


2000 ◽  
Vol 17 (3) ◽  
pp. 143-154 ◽  
Author(s):  
Eleonora Gullone ◽  
Jacqueline Paul ◽  
Susan M. Moore

AbstractThe Adolescent Risk-taking Questionnaire (ARQ) was developed to comprehensively assess adolescent risk-taking beliefs and behaviours. Research has shown that it is a reliable instrument with strong construct validity. The current study investigated the convergent and discriminant validity of the ARQ by comparing responses of a sample of 52 male adolescents from a juvenile justice centre and 211 school-attending male adolescents. Consistent with past research, the juvenile justice centre youth reported significantly higher levels of depression and less optimal levels of parent attachment compared to school-attending youth. Convergent validity of the ARQ was demonstrated through significant relationships between attachment and risk-taking. Specifically, those adolescents with less optimal parent attachment were more likely to engage in risk-taking behaviour and were less likely to perceive the behaviours included in the ARQ as risky compared to those with more optimal levels of parent attachment. Discriminant validity of the ARQ was demonstrated through significant differences between the two groups on risk beliefs and behaviours. Responses on the ARQ indicated that youth from the juvenile justice centre were significantly more likely to engage in risky behaviours, if given the opportunity, than school-based youth. They also perceived the behaviours to be less risky. It was concluded that the ARQ has good convergent and discriminant validity.


2014 ◽  
Vol 3 (3) ◽  
pp. 179
Author(s):  
Adnan Adnan ◽  
Dyah Aryani Perwitasari ◽  
Ully Adhie Mulyani

Tuberculosis (TB) is one of the disease as the highest contributor to the disease burden in Indonesia. Tuberculosis can affect the patients’ quality of life, such as psychological, physical, and social functioning. St. George's Respiratory Questionnaire (SGRQ) is a special instrument which was widely used to measure the patients’ quality of life with respiratory disease. The objective of this study was to validate the Indonesian version of the SGRQ as instrument to collect data. A descriptive cross section design with 61 subjects was conducted at the Pulmonary Clinics and Primary Health Centers in the region of Yogyakarta within 3 months. The validation process included the known group validity, convergent and discriminant validity and factor analysis. There were 14 items question numbers which did not meet the criteria for convergent validity and 9 items which did not meet the criteria for discriminant validity. Known group validity analysis on gender showed that of the three domains of SGRQ, the activity domain gave statistically significant result. The factor analysis showed the result of Kaiser Meyer Olkin analysis (KMO) was less than 0.5. With a few modifications, the Indonesian version of SGRQ is valid and reliable for measuring quality of life in tuberculosis patients.


Sign in / Sign up

Export Citation Format

Share Document