Development and validation of an instrument to measure students’ engagement and participation in science activities through factor analysis and Rasch analysis

Author(s):  
Italo Testa ◽  
Giovanni Costanzo ◽  
Marianna Crispino ◽  
Silvia Galano ◽  
Alessio Parlati ◽  
...  
2018 ◽  
Vol 34 (3) ◽  
pp. 193-205 ◽  
Author(s):  
Julia Steinbach ◽  
Heidrun Stoeger

Abstract. We describe the development and validation of an instrument for measuring the affective component of primary school teachers’ attitudes towards self-regulated learning. The questionnaire assesses the affective component towards those cognitive and metacognitive strategies that are especially effective in primary school. In a first study (n = 230), the factor structure was verified via an exploratory factor analysis. A confirmatory factor analysis with data from a second study (n = 400) indicated that the theoretical factor structure is appropriate. A comparison with four alternative models identified the theoretically derived factor structure as the most appropriate. Concurrent validity was demonstrated by correlations with a scale that measures the degree to which teachers create learning environments that enable students to self-regulate their learning. Retrospective validity was demonstrated by correlations with a scale that measures teachers’ experiences with self-regulated learning. In a third study (n = 47), the scale’s concurrent validity was tested with scales measuring teachers’ evaluation of the desirability of different aspects of self-regulated learning in class. Additionally, predictive validity was demonstrated via a binary logistic regression, with teachers attitudes as predictor on their registration for a workshop on self-regulated learning and their willingness to implement a seven-week training program on self-regulated learning.


2020 ◽  
Vol 36 (5) ◽  
pp. 852-863 ◽  
Author(s):  
George Gunnesch-Luca ◽  
Klaus Moser

Abstract. The current paper presents the development and validation of a unit-level Organizational Citizenship Behavior (OCB) scale based on the Referent-Shift Consensus Model (RSCM). In Study 1, with 124 individuals measured twice, both an Exploratory Factor Analysis (EFA) and a Confirmatory Factor Analysis (CFA) established and confirmed a five-factor solution (helping behavior, sportsmanship, loyalty, civic virtue, and conscientiousness). Test–retest reliabilities at a 2-month interval were high (between .59 and .79 for the subscales, .83 for the total scale). In Study 2, unit-level OCB was analyzed in a sample of 129 work teams. Both Interrater Reliability (IRR) measures and Interrater Agreement (IRA) values provided support for RSCM requirements. Finally, unit-level OCB was associated with group task interdependence and was more predictable (by job satisfaction and integrity of the supervisor) than individual-level OCB in previous research.


Religions ◽  
2021 ◽  
Vol 12 (3) ◽  
pp. 197
Author(s):  
Sungwon Kim

The purpose of this study is to develop and validate a faith scale for young children. Data were collected from 424 young children, who had not yet entered elementary school, with their parents rating their faith level. Sixty-five preliminary questions were formulated under three domains―knowing, loving, and living—that were based on existing studies related to faith. The questions were reduced to 40 through a content validity test conducted by a seven-member panel. These questions were subsequently refined through pilot study, main survey, and statistical analysis. After exploratory and confirmatory factor analysis, the scale was finalized, comprising 25 questions that can be categorized into three factors: confessional faith life, missional life, and distinctive life. This scale is expected to measure early childhood faith and prove the effectiveness of Christian education programs on a young child’s faith development.


SAGE Open ◽  
2021 ◽  
Vol 11 (2) ◽  
pp. 215824402110223
Author(s):  
Nabia Luqman Siddiquei ◽  
Ruhi Khalid

The present study aimed to develop an indigenous measure of learning styles for e-learners in Pakistan and to establish its psychometric properties. The objectives of the study were attained via three studies. First, the items for the development of the Learning Style Scale for e-Learners (e-LSS) were generated empirically based on a 5-point Likert-type scale. In Study I, the internal consistency and dimensionality of the measure were determined by sampling 360 e-learners aged from 20 to 40 years through a convenient sampling technique, whereas other demographic characteristics were kept in close consideration. For this purpose, exploratory factor analysis was utilized. In Study II of scale development, the factor structure that emerged in Study I was confirmed via confirmatory factor analysis using structural equation modeling. In Study III, the convergent and divergent validities of the newly constructed scale were established by correlating scores with preestablished scale scores that assess the similar construct (i.e., LSS) and with scores on the discriminant construct (i.e., Solving Problems Survey). The sample for this study consisted of 80 e-learners aged from 20 to 40 years. A total of 29 items were confirmed in the final scale with 8 distinctive factors (namely, visual, auditory, kinesthetic, global, analytical, individual, collaborative, and technological type) with sound psychometric properties. To conclude, the newly constructed scale was a significant addition to assess learning styles particularly of e-learners in the context of Pakistan.


2021 ◽  
pp. 003435522110142
Author(s):  
Deniz Aydemir-Döke ◽  
James T. Herbert

Microaggressions are daily insults to minority individuals such as people with disabilities (PWD) that communicate messages of exclusion, inferiority, and abnormality. In this study, we developed a new scale, the Ableist Microaggressions Impact Questionnaire (AMIQ), which assesses ableist microaggression experiences of PWD. Data from 245 PWD were collected using Amazon’s Mechanical Turk (MTurk) platform. An exploratory factor analysis of the 25-item AMIQ revealed a three-factor structure with internal consistency reliability ranging between .87 and .92. As a more economical and psychometrically sound instrument assessing microaggression impact as it pertains to disability, the AMIQ offers promise for rehabilitation counselor research and practice.


Author(s):  
Kang-Hyun Park ◽  
Ickpyo Hong ◽  
Ji-Hyuk Park

Lifestyle plays an important role in determining health and vitality among older adults. However, there is limited evidence regarding lifestyle assessment. This study examined the psychometric properties of the Yonsei Lifestyle Profile-Satisfaction (YLP-S). The participants in the study included 156 older adults. Rasch analysis was used to test unidimensionality, fit statistics, and the precision of the YLP-S. The YLP-S demonstrated a unidimensional measurement construct, and 18 items fit the Rasch model. The YLP-S illustrated reasonable precision (person strata = 5.37). Only 4 items showed differential item functioning by sex or age groups. The findings indicate that the YLP-S demonstrated sound internal validity and can be used by health professionals to measure the multifaceted lifestyle of older adults.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Magnus Johansson ◽  
Anthony Biglan

Abstract Background This paper describes the development and psychometric evaluation of a behavioral assessment instrument primarily intended for use with workgroups in any type of organization. The instrument was developed based on the Nurturing Environments framework which describes four domains important for health, well-being, and productivity; minimizing toxic social interactions, teaching and reinforcing prosocial behaviors, limiting opportunities for problem behaviors, and promoting psychological flexibility. The instrument is freely available to use and adapt under a CC-BY license and intended as a tool that is easy for any group to use and interpret to identify key behaviors to improve their psychosocial work environment. Methods Questionnaire data of perceived frequency of behaviors relevant to nurturance were collected from nine different organizations in Sweden. Data were analyzed using confirmatory factor analysis, Rasch analysis, and correlations to investigate relationships with relevant workplace measures. Results The results indicate that the 23-item instrument is usefully divided in two factors, which can be described as risk and protective factors. Toxic social behaviors make up the risk factor, while the protective factor includes prosocial behavior, behaviors that limit problems, and psychological flexibility. Rasch analysis showed that the response categories work as intended for all items, item fit is satisfactory, and there was no significant differential item functioning across age or gender. Targeting indicates that measurement precision is skewed towards lower levels of both factors, while item thresholds are distributed over the range of participant abilities, particularly for the protective factor. A Rasch score table is available for ordinal to interval data transformation. Conclusions This initial analysis shows promising results, while more data is needed to investigate group-level measurement properties and validation against concrete longitudinal outcomes. We provide recommendations for how to work in practice with a group based on their assessment data, and how to optimize the measurement precision further. By using a two-dimensional assessment with ratings of both frequency and perceived importance of behaviors the instrument can help facilitate a participatory group development process. The Group Nurturance Inventory is freely available to use and adapt for both commercial and non-commercial use and could help promote transparent assessment practices in organizational and group development.


Sign in / Sign up

Export Citation Format

Share Document