Developing and Testing a Student-Focussed Teaching Evaluation Survey for University Instructors

2009 ◽  
Vol 104 (3) ◽  
pp. 1019-1032 ◽  
Author(s):  
Paul Ginns ◽  
Simon Barrie
Keyword(s):  
Concurrent Validity ◽  
Teaching And Learning ◽  
Principal Component ◽  
Strong Correlations ◽  
Factor Analyses ◽  
University Instructors ◽  
Exploratory Factor Analyses ◽  
Scale Scores ◽  
High Internal Consistency ◽  
Evaluation Survey

This paper describes a process for developing a student-focussed survey to gather teaching- and learning-related feedback from university students and examines the psychometric properties of a short survey for confidential feedback to lecturers in higher education regarding teaching. Analyses were performed at the level of individual respondents and on teacher-average responses. Principal component and exploratory factor analyses at both levels indicated a single underlying lecturing effectiveness factor. Scale scores had high internal consistency. The items and subsequent scale were also consistent in terms of interrater reliability, i.e., the average consistency of ratings of an individual lecturer. Finally, at both levels of analysis, strong correlations between responses to each item and an overall rating provided support for the concurrent validity of the items. These analyses provide initial evidence of the suitability of the survey for gathering confidential student feedback on lecturing effectiveness.

scholarly journals Development and Validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP)

2013 ◽  
Vol 35 (2) ◽  
pp. 180-196 ◽  
Author(s):  
Rachel Arnold ◽  
David Fletcher ◽  
Kevin Daniels
Keyword(s):  
Concurrent Validity ◽  
Structure Study ◽  
Item Pool ◽  
Factor Analyses ◽  
Confirmatory Factor Analyses ◽  
Organizational Stressors ◽  
Confirmatory Factor ◽  
Exploratory Factor Analyses ◽  
Initial Item ◽  
Development And Validation

The series of related studies reported here describe the development and validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP). In Study 1, an expert and usability panel examined the content validity and applicability of an initial item pool. The resultant 96 items were analyzed with exploratory factor analyses in Study 2, with the factorial structure comprising 5 factors (viz., Goals and Development, Logistics and Operations, Team and Culture, Coaching, Selection) and 33 items. Using confirmatory factor analyses, Studies 3 and 4 found support for the 5-factor structure. Study 4 also provided evidence for the OSI-SP’s concurrent validity and invariance across different groups. The OSI-SP is proposed as a valid and reliable measure of the organizational stressors encountered by sport performers.

Computerized Administration of the Multidimensional Personality Questionnaire

Assessment ◽  
1996 ◽  
Vol 3 (4) ◽  
pp. 365-374 ◽  
Author(s):  
David L. DiLalla
Keyword(s):  
Group Differences ◽  
Personality Questionnaire ◽  
Factor Analyses ◽  
Exploratory Factor Analyses ◽  
Structural Consistency ◽  
High Internal Consistency ◽  
Standard Paper ◽  
Order Factor ◽  
High Degree ◽  
Multidimensional Personality Questionnaire

A computer-administered (CA) form of the Multidimensional Personality Questionnaire (MPQ) was created.1 Respondents' scores on the CA form were compared to those of individuals who took the MPQ under standard paper-and-pencil (PP) conditions. Reliability analysis showed high internal consistency for the CA form of the MPQ and exploratory factor analyses showed a high degree of structural consistency with past findings. Multivariate analyses indicated no group differences between CA and PP groups on the MPQ's primary factor scales or higher order factor scales. Likelihood of profile invalidity, particularly for men, was decreased as a result of fewer skipped items and lower carelessness and variability in the CA condition. Gender differences consistent with previous research were obtained.

Exploring the factors of the English Comprehension Test

2018 ◽  
Vol 49 (3) ◽  
pp. 376-390 ◽  
Author(s):  
Danille Elize Arendse ◽  
David Maree
Keyword(s):  
Principal Component ◽  
Initial Step ◽  
Extraction Methods ◽  
Test Construction ◽  
Psychometric Validation ◽  
Dominant Factor ◽  
Factor Analyses ◽  
Comprehension Test ◽  
Exploratory Factor Analyses ◽  
Restriction Of Range

The empirically designed English Comprehension Test was initially developed as a means of assessing individual’s English comprehension skills. The test development of the English Comprehension Test led to the piloting of two test versions of the English Comprehension Test, namely, version 1.2 and version 1.3. The purpose of this study was to statistically explore the factors emerging from the two test versions of the English Comprehension Test. This study is the initial step towards establishing the construct validity, which forms part of the validation of the English Comprehension Test. This quantitative study involved an exploratory inspection of the factors of the English Comprehension Test, with the use of factor analyses. It also employed two factor extraction methods (Principal Component Analysis and Principal Axis Factoring) for comparison. These two factor extraction methods used for the exploratory factor analyses revealed a dominant factor for both test versions of the English Comprehension Test, thereby endorsing an argument for unidimensionality of the English Comprehension Test. The similarities between the results for the two test versions confirmed the existence of an inherent structure for the English Comprehension Test, despite the differences between the two test versions. The labelling of the factors of the test also suggests that the English Comprehension Test could be an assessment of cognitive (verbal) aptitude. A major limitation of this study is the restriction of range and lack of generalizability. The contribution made by this study will enhance psychometric validation studies in South Africa as well as increasing literature on South African test construction for multicultural and multilingual individuals.

Development, Reliability and Validation of the Diabetes Emotional Adjustment Scale in Spanish: Preliminary Findings

1995 ◽  
Vol 25 (1) ◽  
pp. 81-92 ◽  
Author(s):  
Ovidio A. De Leóan
Keyword(s):  
Concurrent Validity ◽  
Emotional Adjustment ◽  
Principal Component ◽  
Structure Stability ◽  
Diabetic Patients ◽  
Varimax Rotation ◽  
Retest Reliability ◽  
Scale Scores ◽  
Test Retest Reliability ◽  
Development And Validation

Objective: The development of instruments to measure emotional maladjustment in diabetic Hispanic populations has received little attention. We present the development and validation of the Diabetes Emotional Adjustment Scale in Spanish. Method: An eighteen-item self-administered scale was construed to assess emotional adjustment in Spanish-speaking diabetic patients and the psychometric properties of the scale were assessed. The scale was applied to a sample of sixty patients and scale scores were correlated with scores on a battery of Spanish versions of established measures of psychological distress, to assess concurrent validity. Test-retest reliability was established four years later re-examining thirty-eight of the initial sixty-patients sample. Results: Split-half reliability and test-retest reliability were satisfactory. There were significant correlations between the scale results and measures of depression, trait-anxiety, family adjustment, and locus of control of behavior. A principal component analysis with varimax rotation yielded a six-factor solution explaining 50.4 percent of the total variance. Conclusions: The scale is useful as a screening instrument, but the confirmation of factor structure stability and the correlation of the scale results with objective measures of metabolic control, require further investigation.

scholarly journals Factor Structure of the Urban Hassles Index

2016 ◽  
Vol 28 (6) ◽  
pp. 741-750 ◽  
Author(s):  
Meeyoung O. Min ◽  
June-Yung Kim ◽  
Tugba Olgac ◽  
Meredith W. Francis ◽  
En-Jung Shon ◽  
...  
Keyword(s):  
Factor Structure ◽  
Assessment Tool ◽  
Weighted Least Squares ◽  
Factor Analyses ◽  
Confirmatory Factor Analyses ◽  
First Order ◽  
Brief Assessment ◽  
Composite Scale ◽  
Exploratory Factor Analyses ◽  
Scale Scores

Objective: This study examined the factor structure and psychometric properties of the Urban Hassles Index (UHI). Method: Exploratory factor analyses (EFAs) were conducted via principal axis factoring extraction method. Confirmatory factor analyses were conducted to evaluate the fit of the EFA-derived model using the weighted least squares estimator with mean and variance adjustments. Composite/scale scores were created for the extracted factors, with a total score derived by summing the scale scores. Criterion-related validity was examined using hierarchical regressions. Results: The UHI had four first-order factors ( environmental nuisance, safety concerns, drug, and coercion) accounting for 43% of the total variance. Covariance among the first-order factors was explained by a higher second-order factor. Moderate factor correlations and evidence for the criterion-related validity of the subscales and total score indicated multidimensionality of the UHI. Conclusions: The shortened 16-item UHI is a brief assessment tool evaluating stressors unique to urban adolescents, providing specific intervention targets.

scholarly journals Psychometric Properties of the Colombian Version of the HIV Attitudes Scale for Adolescents

2020 ◽  
Vol 17 (13) ◽  
pp. 4686
Author(s):  
Mayra Gómez-Lugo ◽  
Alexandra Morales ◽  
Alejandro Saavedra-Roa ◽  
Janivys Niebles-Charris ◽  
Paola García-Roncallo ◽  
...  
Keyword(s):  
Factor Structure ◽  
External Validity ◽  
Concurrent Validity ◽  
Structural Equation ◽  
Equation Model ◽  
Factor Analyses ◽  
Reliable Measurement ◽  
Reliability Indices ◽  
Sexually Transmitted ◽  
Exploratory Factor Analyses

The HIV Attitudes Scale (HIV-AS) evaluates attitudes towards different aspects of HIV. In view of the lack of scales measuring this construct in Colombia, this study sought to validate the HIV-AS test for adolescents from Colombia. A total of 867 Colombian students, aged between 14 and 19 years (M = 15.97 years; SD = 1.37) were evaluated. Participants responded to the HIV-AS test and a set of scales used to assess external validity. Content validity analyses reflected good adequacy indices for the items. Exploratory factor analyses revealed a four-factor structure and reliability indices were satisfactory. The structural equation model showed good levels of fit. Most of the items presented a discrimination index above 0.30 and contributed to the reliability of the scale, except for item 9, which was eliminated. Concurrent validity showed significant correlations among the HIV-AS and other similar constructs. A reliable measurement of attitudes toward HIV allows for an improved assessment of the risk associated with exposure to sexually transmitted infections in adolescent populations.

The Stigma of Suicide Scale

Crisis ◽  
2013 ◽  
Vol 34 (1) ◽  
pp. 13-21 ◽  
Author(s):  
Philip J. Batterham ◽  
Alison L. Calear ◽  
Helen Christensen
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Factor Structure ◽  
Internal Consistency ◽  
Concurrent Validity ◽  
Online Survey ◽  
National University ◽  
Stigmatizing Attitudes ◽  
High Internal Consistency ◽  
At Home

Background: There are presently no validated scales to adequately measure the stigma of suicide in the community. The Stigma of Suicide Scale (SOSS) is a new scale containing 58 descriptors of a “typical” person who completes suicide. Aims: To validate the SOSS as a tool for assessing stigma toward suicide, to examine the scale’s factor structure, and to assess correlates of stigmatizing attitudes. Method: In March 2010, 676 staff and students at the Australian National University completed the scale in an online survey. The construct validity of the SOSS was assessed by comparing its factors with factors extracted from the Suicide Opinion Questionnaire (SOQ). Results: Three factors were identified: stigma, isolation/depression, and glorification/normalization. Each factor had high internal consistency and strong concurrent validity with the Suicide Opinion Questionnaire. More than 25% of respondents agreed that people who suicided were “weak,” “reckless,” or “selfish.” Respondents who were female, who had a psychology degree, or who spoke only English at home were less stigmatizing. A 16-item version of the scale also demonstrated robust psychometric properties. Conclusions: The SOSS is the first attitudes scale designed to directly measure the stigma of suicide in the community. Results suggest that psychoeducation may successfully reduce stigma.

Identification and Utility of a Short Form of the Pediatric Symptom Checklist-Youth Self-Report (PSC-17-Y)

2020 ◽  
Vol 36 (1) ◽  
pp. 56-64
Author(s):  
Paul Bergmann ◽  
Cara Lucke ◽  
Theresa Nguyen ◽  
Michael Jellinek ◽  
John Michael Murphy
Keyword(s):  
Psychosocial Functioning ◽  
Short Form ◽  
Parent Report ◽  
Self Report ◽  
Symptom Checklist ◽  
Factor Analyses ◽  
Youth Self Report ◽  
Confirmatory Factor Analyses ◽  
Pediatric Symptom Checklist ◽  
Exploratory Factor Analyses

Abstract. The Pediatric Symptom Checklist-Youth self-report (PSC-Y) is a 35-item measure of adolescent psychosocial functioning that uses the same items as the original parent report version of the PSC. Since a briefer (17-item) version of the parent PSC has been validated, this paper explored whether a subset of items could be used to create a brief form of the PSC-Y. Data were collected on more than 19,000 youth who completed the PSC-Y online as a self-screen offered by Mental Health America. Exploratory factor analyses (EFAs) were first conducted to identify and evaluate candidate solutions and their factor structures. Confirmatory factor analyses (CFAs) were then conducted to determine how well the data fit the candidate models. Tests of measurement invariance across gender were conducted on the selected solution. The EFAs and CFAs suggested that a three-factor short form with 17 items is a viable and most parsimonious solution and met criteria for scalar invariance across gender. Since the 17 items used on the parent PSC short form were close to the best fit found for any subsets of items on the PSC-Y, the same items used on the parent PSC-17 are recommended for the PSC-Y short form.

Comparing Hierarchical Models of Personality Pathology

2018 ◽  
Author(s):  
Whitney R. Ringwald ◽  
Aidan G.C. Wright ◽  
Joseph E. Beeney ◽  
Paul A. Pilkonis
Keyword(s):  
Hierarchical Models ◽  
Empirical Work ◽  
Hierarchical Classification ◽  
Personality Pathology ◽  
General Factor ◽  
Factor Analyses ◽  
Conceptual Structures ◽  
Individual Personality ◽  
Exploratory Factor Analyses ◽  
Specific Factors

Two dimensional, hierarchical classification models of personality pathology have emerged as alternatives to traditional categorical systems: multi-tiered models with increasing numbers of factors and models that distinguish between a general factor of severity and specific factors reflecting style. Using a large sample (N=840) with a range of psychopathology, we conducted exploratory factor analyses of individual personality disorder criteria to evaluate the validity of these conceptual structures. We estimated an oblique, “unfolding” hierarchy and a bifactor model, then examined correlations between these and multi-method functioning measures to enrich interpretation. Four-factor solutions for each model, reflecting rotations of each other, fit well and equivalently. The resulting structures are consistent with previous empirical work and provide support for each theoretical model.

Sign in / Sign up

Export Citation Format

Share Document