scholarly journals The Group Nurturance Inventory - Initial Psychometric Evaluation Using Rasch and Factor Analysis

2020 ◽  
Author(s):  
Magnus Johansson ◽  
Anthony Biglan
Keyword(s):  
Problem Behaviors ◽  
Behavioral Assessment ◽  
Group Development ◽  
Psychometric Evaluation ◽  
Well Being ◽  
Test Theory ◽  
Assessment Instrument ◽  
Response Scale ◽  
Limit Problems ◽  
Item Functioning

This paper describes the development and psychometric evaluation of a behavioral assessment instrument primarily intended for use with workgroups. The instrument is based on the Nurturing Environments framework which describes four domains important for health, well-being, and productivity; minimizing toxic social interactions, teaching and reinforcing prosocial behaviors, limiting opportunities for problem behaviors, and promoting psychological flexibility. In this article, questionnaire data of perceived frequency of behaviors relevant to nurturance are analyzed using both classic and modern test theory. The results indicate a 23-item instrument that best fit a bifactor model with a general nurturance factor explaining 87.1% of the variance in unit-weighted total scores, and three specific factors (toxic behavior, prosocial behavior, and behaviors that limit problems). Rasch analysis showed that the response scale works adequately, item fit is satisfactory, and no significant differential item functioning. Targeting is skewed towards lower levels of nurturance and item thresholds are distributed over the range of participant abilities. The instrument is freely available to use and adapt under a CC-BY license and intended as a tool that is easy for any group to use and interpret to identify key behaviors to improve their psychosocial work environment. By using a two-dimensional assessment with ratings of both frequency and perceived importance of behaviors the instrument can help facilitate a participatory group development process. We provide recommendations for how to work with a group based on their data, and how to optimize the measurement precision further. The next steps in research are suggested, such as group-level analysis, collecting observational data, and validation against concrete longitudinal outcomes. This instrument could help promote transparent assessment practices in organizational and group development.

scholarly journals The Group Nurturance Inventory — initial psychometric evaluation using Rasch and factor analysis

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Magnus Johansson ◽  
Anthony Biglan
Keyword(s):  
Factor Analysis ◽  
Rasch Analysis ◽  
Protective Factor ◽  
Group Development ◽  
Psychometric Evaluation ◽  
Psychological Flexibility ◽  
Well Being ◽  
Measurement Precision ◽  
Assessment Instrument ◽  
Measurement Properties

Abstract Background This paper describes the development and psychometric evaluation of a behavioral assessment instrument primarily intended for use with workgroups in any type of organization. The instrument was developed based on the Nurturing Environments framework which describes four domains important for health, well-being, and productivity; minimizing toxic social interactions, teaching and reinforcing prosocial behaviors, limiting opportunities for problem behaviors, and promoting psychological flexibility. The instrument is freely available to use and adapt under a CC-BY license and intended as a tool that is easy for any group to use and interpret to identify key behaviors to improve their psychosocial work environment. Methods Questionnaire data of perceived frequency of behaviors relevant to nurturance were collected from nine different organizations in Sweden. Data were analyzed using confirmatory factor analysis, Rasch analysis, and correlations to investigate relationships with relevant workplace measures. Results The results indicate that the 23-item instrument is usefully divided in two factors, which can be described as risk and protective factors. Toxic social behaviors make up the risk factor, while the protective factor includes prosocial behavior, behaviors that limit problems, and psychological flexibility. Rasch analysis showed that the response categories work as intended for all items, item fit is satisfactory, and there was no significant differential item functioning across age or gender. Targeting indicates that measurement precision is skewed towards lower levels of both factors, while item thresholds are distributed over the range of participant abilities, particularly for the protective factor. A Rasch score table is available for ordinal to interval data transformation. Conclusions This initial analysis shows promising results, while more data is needed to investigate group-level measurement properties and validation against concrete longitudinal outcomes. We provide recommendations for how to work in practice with a group based on their assessment data, and how to optimize the measurement precision further. By using a two-dimensional assessment with ratings of both frequency and perceived importance of behaviors the instrument can help facilitate a participatory group development process. The Group Nurturance Inventory is freely available to use and adapt for both commercial and non-commercial use and could help promote transparent assessment practices in organizational and group development.

Psychometric evaluation of the DSM-IV criterion B mania symptoms in an Australian national sample

2012 ◽  
Vol 43 (2) ◽  
pp. 433-443 ◽  
Author(s):  
N. Carragher ◽  
L. M. Weinstock ◽  
D. Strong
Keyword(s):  
Evaluation Studies ◽  
Psychometric Evaluation ◽  
Well Being ◽  
National Sample ◽  
Latent Structure ◽  
Item Functioning ◽  
The Usa ◽  
Dsm Iv ◽  
Health And Well Being ◽  
Two Parameter

BackgroundAlthough numerous studies have examined the latent structure of major depression, less attention has focused on mania. This paper presents the first investigation outside the USA to evaluate the psychometric properties of the DSM-IV criterion B mania symptoms using item response theory (IRT).MethodData were drawn from the Australian 2007 National Survey of Mental Health and Well-Being (NSMHWB, n = 8841). The psychometric performance of the mania symptoms was evaluated using a two-parameter logistic model. Because substance use disorders (SUDs) frequently co-occur with mania and can influence manic symptom expression, differential item functioning (DIF) between mania respondents with/without a SUD diagnosis was also assessed.ResultsFactor analysis supported a unidimensional trait underlying mania. The grandiosity symptom displayed the highest discrimination whereas discrimination was lowest for decreased need for sleep. Relatively speaking, grandiosity tapped the severe end and increased goal-oriented activities tapped the mild end of the mania severity continuum. The symptoms generally performed equivalently between those with/without a SUD diagnosis, with one exception; the activities with painful consequences symptom was endorsed at lower levels of severity, and hence more frequently, by those with a SUD diagnosis versus those without a SUD diagnosis.ConclusionsAccurate conceptualization of latent structure has crucial theoretical, statistical and clinical implications. The symptoms generally performed well in distinguishing between respondents with differing levels of liability, but others did not, suggesting modification is warranted to ensure optimal use in epidemiological samples. Given the dearth of psychometric evaluation studies of mania, further research replicating these results is necessary.

Psychometric evaluation of the Persian version of the spiritual well-being scale (SWBS) in Iranian patients with cancer

2021 ◽  
pp. 1-9
Author(s):  
Hamid Sharif Nia ◽  
Mobin Mohammadinezhad ◽  
Kelly A. Allen ◽  
Christopher Boyle ◽  
Saeed Pahlevan Sharif ◽  
...  
Keyword(s):  
Discriminant Validity ◽  
Psychometric Evaluation ◽  
Well Being ◽  
Validity And Reliability ◽  
Cross Sectional ◽  
Patients With Cancer ◽  
Persian Version ◽  
Convergent And Discriminant Validity ◽  
Spiritual Well Being ◽  
Iranian Patients

Abstract Objective The spiritual well-being scale (SWBS) is a widely used clinical scale which should be evaluated for Iranian patients with cancer. The aim of this study is to evaluate the psychometric properties of the Persian version of the SWBS in Iranian patients with cancer. Method This cross-sectional, methodological study was conducted among Iranian patients with cancer (n = 400). The participants were recruited using convenience sampling. The content, construct, convergent and discriminant validity, and reliability of the Persian version of the SWBS were evaluated. Results A two-factor structure for the scale was indicated with the factors being: connecting with God and meaningless life that explained 54.18% of the total variance of the concept of spiritual well-being. The results demonstrated the model had a good fit. Cronbach's alpha, McDonald's omega, and the inter-item correlation values of the factors indicated good internal consistency of the scale. Significance of results These results suggest that the Persian version of the SWBS is a reliable and valid measure to assess the spiritual well-being of patients with cancer through 16 items related to connecting with God and meaningless life.

scholarly journals The comparison of the scores obtained by Bayesian nonparametric model and classical test theory methods

2021 ◽  
Vol 104 (3) ◽  
pp. 003685042110283
Author(s):  
Meltem Yurtcu ◽  
Hülya Kelecioglu ◽  
Edward L Boone
Keyword(s):  
Classical Test Theory ◽  
Small Sample ◽  
Test Theory ◽  
Nonparametric Model ◽  
Bayesian Nonparametric ◽  
Test Equating ◽  
Classical Test ◽  
A Value ◽  
Item Functioning ◽  
The Individual

Bayesian Nonparametric (BNP) modelling can be used to obtain more detailed information in test equating studies and to increase the accuracy of equating by accounting for covariates. In this study, two covariates are included in the equating under the Bayes nonparametric model, one is continuous, and the other is discrete. Scores equated with this model were obtained for a single group design for a small group in the study. The equated scores obtained with the model were compared with the mean and linear equating methods in the Classical Test Theory. Considering the equated scores obtained from three different methods, it was found that the equated scores obtained with the BNP model produced a distribution closer to the target test. Even the classical methods will give a good result with the smallest error when using a small sample, making equating studies valuable. The inclusion of the covariates in the model in the classical test equating process is based on some assumptions and cannot be achieved especially using small groups. The BNP model will be more beneficial than using frequentist methods, regardless of this limitation. Information about booklets and variables can be obtained from the distributors and equated scores that obtained with the BNP model. In this case, it makes it possible to compare sub-categories. This can be expressed as indicating the presence of differential item functioning (DIF). Therefore, the BNP model can be used actively in test equating studies, and it provides an opportunity to examine the characteristics of the individual participants at the same time. Thus, it allows test equating even in a small sample and offers the opportunity to reach a value closer to the scores in the target test.

scholarly journals Sensitivity Of Differential Item Functioning Detection Methods On National Mathematics Examination In North Sumatera Province, Indonesia

2019 ◽  
Vol 8 (5C) ◽  
pp. 1538-1549
Keyword(s):  
Differential Item Functioning ◽  
Likelihood Ratio ◽  
Classical Test Theory ◽  
Test Theory ◽  
Detection Methods ◽  
Ratio Method ◽  
Suitable Model ◽  
Data Set ◽  
Item Functioning ◽  
Mathematics Examination

The purpose of this study was to examine the differences in sensitivity of three methods: IRT-Likelihood Ratio (IRT-LR), Mantel-Haenszel (MH) and Logistics Regression (LR), in detecting gender differential item functioning (DIF) on National Mathematics Examination (Ujian Nasional: UN) for 2014/2015 academic year in North Sumatera Province of Indonesia. DIF item shows the unfairness. It advantages the test takers of certain groups and disadvantages other group test takers, in the case they have the same ability. The presence of DIF was reviewed in grouping by gender: men as reference groups (R) and women as focus groups (F). This study used the experimental method, 3x1 design, with one factor (i.e. method) with three treatments, in the form of 3 different DIF detection methods. There are 5 types of UN Mathematics Year 2015 packages (codes: 1107, 2207, 3307, 4407 and 5507). The 2207 package code was taken as the sample data, consisting of 5000 participants (3067 women, 1933 men; for 40 UN items). Item selection was carried out based on the classical test theory (CTT) on 40 UN items, producing 32 items that fulfilled, and item response theory selection (IRT) produced 18 items that fulfilled. With program R 3.333 and IRTLRDIF 2.0, it was found 5 items were detected as DIF by the IRT-Likelihood Ratio-method (IRTLR), 4 items were detected as DIF by the Logistic Regression method (LR), and 3 items were detected as DIF by the MantelHaenszel method (MH). To test the sensitivity of the three methods, it is not enough with just one time DIF detection, but formed six groups of data analysis: (4400,40),(4400,32), (4400,18), (3000,40), (3000,32), (3000,18), and generate 40 random data sets (without repetitions) in each group, and conduct detecting DIF on the items in each data set. Although the data lacks model fit, the 3 parameter logistic model (3PL) is chosen as the most suitable model. With the Tukey's HSD post hoc test, the IRT-LR method is known to be more sensitive than the MH and LR methods in the group (4400,40) and (3000,40). The IRT-LR method is not longer more sensitive than LR in the group (4400,32) and (3000,32), but still more sensitive than MH. In the groups (4400,18) and (3000,18) the IRT-LR method is more sensitive than LR, but not significantly more sensitive than MH. The LR method is consistently tested to be more sensitive than the MH method in the entire analysis groups.

scholarly journals A Second Look at Subjective Wellbeing Using Differential Item Functioning

2021 ◽  
pp. 23-42
Author(s):  
Karen H. Larwin ◽  
Milton Harvey
Keyword(s):  
Differential Item Functioning ◽  
Latent Variable ◽  
Subjective Wellbeing ◽  
Satisfaction With Life ◽  
Weighted Least Squares ◽  
Well Being ◽  
Satisfaction With Life Scale ◽  
Subjective Well Being ◽  
Current Investigation ◽  
Item Functioning

The current investigation uses latent variable modeling to investigate Subjective Well-Being (SWB). As a follow-up to Larwin, Harvey, and Constantinou (2020), subjective wellbeing is presented through third-order factor model, which explains two-second order factors, SWB and Interpersonal Experiences (IES) while incorporating measures of relationship and resiliency self-evaluations. Additionally, the current investigation considers differential item functioning not considered in the existing SWB literature. JEL classification numbers: C1,C3,C4,C9. Keywords: Subjective Well-Being, Satisfaction with Life Scale, Subjective Happiness Scale, Brief Resiliency Scale, Relationship Assessment Scale, Multiple Indicators Multiple Causes (MIMIC), Weighted least squares mean variance adjusted estimator (WLSMV).

scholarly journals Pembelajaran Fiqh Mu’āmalāt Berorientasi Literasi Finansial

2019 ◽  
Author(s):  
Adib Rifqi Setiawan ◽  
Mita Puspaningrum ◽  
Khoirul Umam
Keyword(s):  
Financial Literacy ◽  
Lesson Plan ◽  
Well Being ◽  
Economic Life ◽  
Assessment Instrument ◽  
Learning Program ◽  
Three Stages ◽  
Development Approach ◽  
Motivation And Confidence ◽  
D Model

Financial literacy is the knowledge and understanding of financial concepts and risks, and the skills, motivation and confidence to apply such knowledge and understanding in order to make effective decisions across a range of financial contexts, to improve the financial well-being of individuals and society, and to enable participation in economic life. This research goals are to gain the design for a learning program that is aligning fiqh mu’āmalāt and financial literacy. We used research and development approach with four-D model that is reduced into three stages: define, design, and develop. It was gained a syllabus that is completed by lesson plan, student worksheets, and assessment instrument as well, that is validated by experts and practitioners and reliability counted based on test. The final test of these educational ideas are in learning implementation. The implementation of this program is not carreid out yet.

The Everyday Ageism Scale: Development and Evaluation

2021 ◽  
pp. 089826432110361
Author(s):  
Julie Ober Allen ◽  
Erica Solway ◽  
Matthias Kirch ◽  
Dianne Singer ◽  
Jeffrey T. Kullgren ◽  
...  
Keyword(s):  
Healthy Aging ◽  
Psychometric Evaluation ◽  
Well Being ◽  
Preliminary Evaluation ◽  
Internal Reliability ◽  
National Poll ◽  
The Everyday ◽  
Nationally Representative ◽  
Health And Well Being ◽  
Everyday Discrimination

Objectives Older adults regularly encounter age-based discrimination and stereotyping in their day-to-day lives. Whether this type of routine ageism negatively affects their health and well-being is unclear, in part due to the absence of validated scales that comprehensively measure this phenomenon and distinguish it from other sources of everyday discrimination. Methods This study describes the development of a novel scale, the Everyday Ageism Scale, and its psychometric evaluation using a nationally representative sample of US adults age 50–80 from the December 2019 National Poll on Healthy Aging ( N = 2012). Results Exploratory factor analysis indicated a 3-factor structure comprised of ageist messages, ageism in interpersonal interactions, and internalized ageism. The ten-item scale was psychometrically sound and demonstrated good internal reliability. Discussion Everyday ageism is a multidimensional construct. Preliminary evaluation of the Everyday Ageism Scale suggests its utility in future studies examining the prevalence of everyday ageism and its relationships with health.

Sign in / Sign up

Export Citation Format

Share Document