The Adaption of the Work Environment Survey for Public Health Nurses

2020 ◽  
pp. 019394592098279
Author(s):  
Shuying Sha ◽  
Olatubosun Aloba ◽  
Jaimee Watts-Isley ◽  
Thomas McCoy
Keyword(s):  
Public Health ◽  
Factor Analysis ◽  
Work Environment ◽  
Classical Test Theory ◽  
Secondary Data ◽  
Nurse Retention ◽  
Test Theory ◽  
Public Health Nurses ◽  
Convenience Sample ◽  
Managerial Support

The study presents the iterative process of the adaption and psychometric properties evaluation of the Work Environment/Support/Encouragement section of the Revised Casey-Fink Nurse Retention Survey© (2009) to measure the work environment of public health nurses (PHNs). This secondary data analysis was based on data collected from a convenience sample of 596 PHNs across North Carolina that were originally used to study PHNs workforce retention. Classical test theory analyses were used to evaluate scale reliability and identify potential problematic items that were further examined from a substantive perspective using content validity survey. Confirmatory factor analysis and exploratory factor analysis were performed to evaluate the construct validity and assist further development of the scale. Analyses suggest a three-factor structure for the retained 19-item scale including managerial support, professional nursing role, and recognition, with reliability ranging from alpha of .859 to .959.

scholarly journals The necessity of applying Rasch measurement theory in questionnaire-based public health research

2019 ◽  
Vol 29 (Supplement_4) ◽  
Author(s):  
H S Finbråten ◽  
A L Kleppang ◽  
A M Steigen
Keyword(s):  
Public Health ◽  
Psychometric Properties ◽  
Health Research ◽  
Measurement Theory ◽  
Classical Test Theory ◽  
Public Health Research ◽  
Rasch Measurement ◽  
Test Theory ◽  
Rasch Measurement Theory ◽  
Classical Test

Abstract Background Questionnaires are frequently used in public health research. In order to provide valid and reliable results to generate recommendations for practice and policies, scales with sound psychometric properties are required. Classical test theory such as factor analysis is most frequently used to assess the psychometric properties of scales. However, classical test theory may have limitations in confirming the validity of scales. Only Rasch measurement theory meet the requirements of fundamental measurement, such as additivity, invariance, sufficiency and specific objectivity. The objective is to exemplify how Rasch measurement theory can be used to evaluate the psychometric properties of a scale. Validation of the Hopkins Symptom Checklist-10 is used as an example. Methods This study is based on cross-sectional data from the Youth Data Survey. In total, 6777 adolescents responded to a web-based questionnaire. Data collection was carried out in lower and upper secondary schools in Norway during 2018. The data were analysed using the partial credit parameterization of the unidimensional Rasch model. Results Preliminary results indicated that the scale had acceptable reliability (person separation index: 0.82). However, one pair of items shows response dependence. The targeting could have been better (mean person location: -1.445). All items had ordered thresholds. Three items under-discriminated. Several items displayed differential item functioning with regard to gender and school level. Conclusions Applying Rasch measurement theory measurement problems that would go undetected using classical test theory approaches were observed. Scales used in public health research should be thoroughly validated applying Rasch measurement theory before the data are used to support claims about public health and used to provide recommendations for policy and practice. Key messages Public health practice and policy should be based on information from valid and reliable scales. Rasch measurement theory should be used to evaluate psychometric properties of scales used in public health research.

The Children's Behavior Questionnaire very Short Scale: Psychometric Properties and Development of a One-Item Temperament Scale

2012 ◽  
Vol 110 (1) ◽  
pp. 197-217 ◽  
Author(s):  
Ester F. C. Sleddens ◽  
Sheryl O. Hughes ◽  
Teresia M. O'Connor ◽  
Alicia Beltran ◽  
Janice C. Baranowski ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Item Response ◽  
Classical Test Theory ◽  
Test Theory ◽  
Item Response Modeling ◽  
Short Scale ◽  
Children's Behavior ◽  
Classical Test ◽  
Response Modeling ◽  
Item Scale

Little research has been conducted on the psychometrics of the very short scale (36 items) of the Children's Behavior Questionnaire, and no one-item temperament scale has been tested for use in applied work. In this study, 237 United States caregivers completed a survey to define their child's behavioral patterns (i.e., Surgency Negative Affectivity, Effortful Control) using both scales. Psychometrics of the 36-item Children's Behavior Questionnaire were examined using classical test theory, principal factor analysis, and item response modeling. Classical test theory analysis demonstrated adequate internal consistency and factor analysis confirmed a three-factor structure. Potential improvements to the measure were identified using item response modeling. A one-item (three response categories) temperament scale was validated against the three temperament factors of the 36-item scale. The temperament response categories correlated with the temperament factors of the 36-item scale, as expected. The one-item temperament scale may be applicable for clinical use.

scholarly journals CLASSICAL TEST THEORY OF INNAPROPRIATE INDEX SCORE’S ACCURACY COMPARISON USING CONFUSION MATRIX ACCURACY PROPORTION IN EDUCATIONAL MEASUREMENT

2017 ◽  
Vol 4 (1) ◽  
pp. 84
Author(s):  
Wardani Rahayu ◽  
Eko Wahyudi
Keyword(s):  
Confusion Matrix ◽  
Classical Test Theory ◽  
Secondary Data ◽  
Sampling Technique ◽  
Educational Measurement ◽  
Accurate Method ◽  
Index Score ◽  
Test Theory ◽  
West Kalimantan ◽  
National Examination

The objective of this study is to determine the Donlon Fischer aacuracy method, Jacob and SHL inappropriate score using confusion matrix accuracy proportion. This research was conducted by analyzing secondary data in response to the physics national examination results throughout the West Kalimantan Province in 2012 using 1545 research samples. The sampling of the research is done by using the random sampling technique of 1545 population. The research method is experimental method which is done by comparing the proportion of accuracy obtained from confusion matrix. The hypothesis was tested by using a differences in proportions Z test. Test results showed that the SHL inappropriate index score is more accurate than Donlon Fischer and Jacob innapropriate index score. This research is expected to find an accurate method in detecting the inappropriate score used as an evaluation parameter for educational measurement.

Measurement Development and Evaluation

2020 ◽  
Vol 7 (1) ◽  
pp. 213-232 ◽  
Author(s):  
Michael J. Zickar
Keyword(s):  
Factor Analysis ◽  
Scale Development ◽  
Best Practice ◽  
Classical Test Theory ◽  
Test Theory ◽  
Measurement Development ◽  
Organizational Research ◽  
Practice Recommendations ◽  
Confirmatory Factor ◽  
Item Writing

Psychological measurement is at the heart of organizational research. I review recent practices in the area of measurement development and evaluation, detailing best practice recommendations in both of these areas. Throughout the article, I stress that theory and discovery should guide scale development and that statistical tools, although they play a crucial role, should be chosen to best evaluate the theoretical underpinnings of scales as well as to best promote discovery. I review all stages of scale development and evaluation, ranging from construct specification and item writing, to scale revision. Different statistical frameworks are considered, including classical test theory, exploratory factor analysis, confirmatory factor analysis, and item response theory, and I encourage readers to consider how best to use each of these tools to capitalize on each approach's particular strengths.

scholarly journals Evaluating the MBTI® Form M in a South African context

2012 ◽  
Vol 38 (1) ◽  
Author(s):  
Casper J.J. Van Zyl ◽  
Nicola Taylor
Keyword(s):  
South Africa ◽  
Factor Analysis ◽  
South African ◽  
Quantitative Research ◽  
Classical Test Theory ◽  
Good Evidence ◽  
Test Theory ◽  
Cross Sectional ◽  
Classical Test ◽  
Gender Groups

Orientation: Psychological instruments require continued refinement, updating and evaluation.Research purpose: To investigate the reliability, validity and differential item functioning of the MBTI® Form M across groups in South Africa using Classical Test Theory (CTT) and Item Response Theory (IRT) methods.Motivation for the study: To add to the continual research and improvement of the MBTI® Form M through the investigation of its psychometric properties across groups in South Africa.Research design, approach and method: This study falls within the quantitative research paradigm. Classical test theory methods and Rasch analysis were used to evaluate the functioning of the MBTI Form M across gender and ethnic groups. A cross-sectional study was completed consisting of 10 705 South African respondents.Main findings: Excellent reliability was found for the instrument across groups in the sample. Good evidence for construct validity was found using exploratory factor analysis and confirmatory factor analysis. Some evidence for uniform bias was found across ethnic and gender groups and a few items reflected non-uniform DIF across gender groups only. The effect of uniform and non-uniform DIF did not appear to have major practical implications for the interpretation of the scales.Practical/managerial implications: The results provided evidence that supports the psychometric validity of the MBTI instrument in the South African context.Contribution/value-add: This study is the largest study to date regarding the psychometric functioning of the MBTI instrument in South Africa. It contributes to the evolution of the instrument in line with the legislative requirements concerning the use of psychometric tests in South Africa. 

Developing a mobile SNS addiction scale utilizing factor analysis and the Rasch model

2019 ◽  
Vol 43 (7) ◽  
pp. 1284-1301
Author(s):  
Xinghua Wang
Keyword(s):  
Factor Analysis ◽  
Rasch Model ◽  
Classical Test Theory ◽  
Academic Research ◽  
Test Theory ◽  
Negative Effects ◽  
Content Type ◽  
Mobile Social Networking ◽  
Mobile Sns ◽  
The Rasch Model

Purpose The purpose of this paper is to develop a mobile social networking service (SNS) addiction scale to measure respondents’ addiction levels. Design/methodology/approach Drawing on the existing literature on the components model of addiction by Griffiths (2005) and mobile SNS addiction, an initial scale in a five-point Likert-format was developed. It was refined through the pilot study with 100 participants and the main study with 423 participants utilizing factor analysis and Rasch analysis. Findings Mobile SNS addiction as a behavioral addiction, demonstrated six addiction symptoms: modification, salience, tolerance, withdrawal, conflict and relapse, which were interrelated with each other. The mobile SNS addiction scale developed in this study was found to be psychometrically robust and unidimensional. Practical implications The mobile SNS addiction scale consists of nine items, thus making it easier and more convenient to be applied to academic research and clinical practice. Originality/value The combined use of factor analysis and the Rasch model could largely reduce potential negative effects associated with limitations of classical test theory and improve the chance of developing a psychometrically robust instrument. The mobile SNS addiction scale covers a range of types of SNSs, thus being more generic. The items in the scale are unidimensionally loaded on the latent construct of mobile SNS addiction and demonstrate measurement invariance across respondents of different demographics.

Development and Validation of the College Admissions Knowledge Evaluation

2019 ◽  
Vol 22 (1b) ◽  
pp. 2156759X1983444
Author(s):  
Timothy A. Poynton ◽  
Bernalyn Ruiz ◽  
Richard T. Lapan
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Classical Test Theory ◽  
Initial Study ◽  
Test Construction ◽  
Test Theory ◽  
College Knowledge ◽  
Confirmatory Factor ◽  
Development And Validation ◽  
Knowledge Evaluation

This article describes the process used to develop a new measure of college knowledge and the findings from an initial study to examine the measure’s construct validity. We employed common test construction (item response theory, classical test theory) and factor analytic (exploratory factor analysis, confirmatory factor analysis) approaches to analyzing the data from 519 graduating high school seniors; these analyses support the construct validity of the measure. We discuss the importance of college knowledge in the college decision-making process and implications for school counseling practice and research.

Sign in / Sign up

Export Citation Format

Share Document