scholarly journals Evaluation of Reflective Measurement Models

2021 ◽  
pp. 75-90
Author(s):  
Joseph F. Hair ◽  
G. Tomas M. Hult ◽  
Christian M. Ringle ◽  
Marko Sarstedt ◽  
Nicholas P. Danks ◽  
...  

AbstractThe goal of reflective measurement model assessment is to ensure the reliability and validity of the construct measures and therefore provides support for the suitability of their inclusion in the path model. This chapter introduces the key criteria that are relevant in reflective measurement model assessment: indicator reliability, internal consistency reliability (Cronbach’s alpha, reliability coefficient rhoA, and composite reliability rhoC), convergent validity, and discriminant validity. We illustrate their use by means of the SEMinR package and a well-known model on corporate reputation.

2019 ◽  
Vol 4 (1) ◽  
pp. 1
Author(s):  
Dwi Yuniarto ◽  
A’ang Subiyakto ◽  
Aedah Binti Abd. Rohman ◽  
Reny Rian Marliana

The assessment of the use of information systems has been carried out by many researchers. This research was conducted in Private Universities in Indonesia, which currently involve many information systems in many ways, especially those related to the management of Higher Education, by measuring the readiness and usability of the use of information systems with models that I build from the integration of two models. The results of the measurement of this study were obtained from the distribution of questionnaires, there were 47% of respondents who filled 61-80% of the level of IS usage and 68% of respondents stated their readiness in the level of readiness to use IS. The stage consists of evaluating reflective measurement models and structural model assessments. Evaluating reflective measurement in evaluating internal consistency reliability using Composite Reliability, Reliability Indicator, Convergent Validity, and Discriminant Validity, finally concluded that the use of the Readiness and Usability integration model can be forwarded to a more complex research stage and can use the questionnaire.


2000 ◽  
Vol 8 (2) ◽  
pp. 179-191 ◽  
Author(s):  
Ann K. Carruth ◽  
Catherine Holland ◽  
Laura Larsen

Caregiver reciprocity is the collective affective and behavioral expression of exchanges given and received between a caregiver and care receiver, and among family members. This psychometric investigation was designed to further examine the reliability and validity of the revised Caregiver Reciprocity Scale II (CRSII). Items were rewritten to reflect valued exchanges and balance among the entire family network, including spouses. An alpha of .83 for Warmth and Regard; .73 for Intrinsic Rewards of Giving; .83 for Love and Affection; and .75 for Balance Within Family Caregiving indicated acceptable internal consistency. The study, conducted with 176 spouse or adult children caregivers, provides additional support for the conceptual model of the four-factor solution. Construct validity was supported by the standardized factor loadings and goodness-of-fit indices obtained from confirmatory factor analysis. The results of the analysis of the measurement model, taken as a whole, demonstrate that the CRS II has adequate psychometric properties. Model parsimony was supported by an AGFI of .87, combined with an adjusted chisquare between 1.0 to 3.0. All but two item loadings were greater than .50. This, combined with the fact that all standardized loadings were twice the standardized errors and t-values were greater than 2.0, contributes to concluding that convergent validity was strong. Discriminant validity, evaluated by variance extracted estimates, and confidence interval (± two standard errors) around the correlation estimate between factors, was adequate. This study provided evidence to support the reliability and validity of the CRS II.


2017 ◽  
Vol 69 (1) ◽  
pp. 64-75 ◽  
Author(s):  
Ruchi Jain Garg ◽  
Vinod Kumar ◽  
Vandana

Purpose The purpose of this paper is to develop and validate a scale involving the factors affecting usage of e-resources. Design/methodology/approach The present study identifies five factors affecting the usage of e-resources: training modes, awareness, influencers, utilitarian benefits, and experiential and hedonic benefits. To generate measurement items, two focus group discussions were carried out which resulted in 20 items. To empirically ensure reliability and validity of scale, data were collected from 347 postgraduate students actively using e-resources. To test reliability of scale, internal consistency reliability and construct reliability were examined. The construct validity of scale (which includes convergent validity and discriminant validity) was verified through confirmatory factor analysis using structure equation modeling. Findings Findings of the study present a statistically reliable and valid scale consisting of five factors and 18 items. Originality/value The present study is one of the distinctive studies on introducing a scale employing factors affecting usage of e-resources.


Author(s):  
Mat Rahimi Yusof ◽  
Mohd Faiz Mohd Yaakob ◽  
Aliff Nawi ◽  
Hapini Awang ◽  
Dayang Rafidah Syariff M. Fuad ◽  
...  

<p>This study conducted to develop a measurement model for measuring Geo-Education in Malaysia context. This cross-sectional survey involved 245 trainee teachers in Universities and Institut Pendidikan Guru Malaysia (IPGM). The data collection was made through a set of questionnaires and analyzed using SEM-AMOS. There are four main elements measured, which are loading factors, convergent validity, discriminant validity, and composite reliability. The findings indicated that Geo-Education had a significant contribution to the proposed constructs, namely primer, issues, ecosystem, lifestyle, and cross-curricular elements. A model of Geo-Education was successfully developed in this study using these five constructs, namely primer, issues, ecosystem, lifestyle, and cross-curricular elements. This study also identified twenty-five behaviours of Geo-Education among the trainee teachers in Malaysia. The findings of this study are essential as a guideline for Malaysian teachers to implement the concept of Geo-Education in Malaysia. Additionally, the application of this subject as cross-curricular elements in the Malaysian curriculum is essential to ensure the success of the implementation of Education Sustainable Development (ESD) in the school environment.</p>


2016 ◽  
Vol 76 (6) ◽  
pp. 912-932 ◽  
Author(s):  
Tyler Hamby ◽  
Wyn Taylor

This study examined the predictors and psychometric outcomes of survey satisficing, wherein respondents provide quick, “good enough” answers (satisficing) rather than carefully considered answers (optimizing). We administered surveys to university students and respondents—half of whom held college degrees—from a for-pay survey website, and we used an experimental method to randomly assign the participants to survey formats, which presumably differed in task difficulty. Based on satisficing theory, we predicted that ability, motivation, and task difficulty would predict satisficing behavior and that satisficing would artificially inflate internal consistency reliability and both convergent and discriminant validity correlations. Indeed, results indicated effects for task difficulty and motivation in predicting survey satisficing, and satisficing in the first part of the study was associated with improved internal consistency reliability and convergent validity but also worse discriminant validity in the second part of the study. Implications for research designs and improvements are discussed.


2019 ◽  
Vol 47 (3) ◽  
pp. 1154-1168 ◽  
Author(s):  
Xiaoqian Chen ◽  
Qi Yu ◽  
Feifei Yu ◽  
Yixiang Huang ◽  
Lingling Zhang

Objective This study was performed to assess the reliability and validity of the Chinese version of the Snizek-revised Hall’s Professionalism Inventory Scale (C-SR-HPIS). Methods Exploratory factor analysis and confirmatory factor analysis were used to evaluate the construct validity of the C-SR-HPIS. The average variance extracted (AVE) and square root of the AVE were calculated and correlation analyses were performed to test the convergent validity and discriminant validity, respectively. Cronbach’s alpha (α) coefficient was used to test the internal consistency reliability. Results Data for 355 clinical nurses in mainland China were collected. Five factors were extracted, accounting for 58.86% of the total explained variance, and 20 items were selected for the C-SR-HPIS. The confirmatory factor analysis suggested good fitness of the modified model. The AVE was acceptable for convergent validity. The square roots of the AVE of the five factors were larger than their correlation coefficients with other factors, showing suitable discriminant validity. Cronbach’s α coefficient of internal consistency reliability of the overall scale was 0.76, indicating good reliability of the scale. Conclusions This study demonstrated good reliability and validity of the C-SR-HPIS and provides a quantitative tool for the assessment of nursing professionalism in China.


2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Ahmad Farouk Musa ◽  
Mohamed Shajahan Mohamed Yasin ◽  
Julian Smith ◽  
Mohd Azhari Yakub ◽  
Rusli Bin Nordin

Abstract Background The Short Form 36 (SF-36) is a scoring system comprising of 36 items categorized into eight constructs corresponding to patients’ health-related quality of life. It has been used extensively in various countries on different sub-populations and used to indicate the health status and help to ascertain the effect of clinical interventions on the particular population. Objective To examine the psychometric properties of the Malay version of SF-36 (Malay SF-36) summated rating scales and validate the scale among post-coronary artery bypass grafting surgery (CABG) patients at the National Heart Institute (IJN), Kuala Lumpur. Methods Five hundred and nine post-CABG patients at the IJN, Malaysia completed the questionnaires between 1 July and 31 December 2017. Psychometric tests endorsed by the “International Quality of Life Assessment Project” were utilised. Results The data quality was excellent with a high questionnaire completion rate (100%). As hypothesized, the ordering of item means within scales was clustered. In unison, scaling assumptions were satisfied. Good discriminant validity was shown between subsets of patients with various levels of health status. Notwithstanding, there were probably translation issues of the Physical Functioning scale which showed small ceiling effects. We clearly observed high ceiling and floor effects in both Role Physical and Role Emotional scale most probably attributed to the dichotomous style of their choice of responses. Cronbach alpha values of the eight scales ranged from 0.73 to 0.90, showing good internal consistency reliability. Confirmatory Factor Analysis (CFA) confirmed the 8-factor solution and Composite Reliability revealed internal consistency reliability except for Vitality and Social Functioning. Based on the Average Variance Extracted (AVE), convergent validity was adequate except for two domains. Discriminant Validity is good for the eight constructs as the √AVE are generally higher than the correlation coefficients between the latent constructs. Conclusion The scoring for the Malay SF-36 based on the summated ratings method was proven to be valid to be applied in our local clinical population. The CFA, fitness estimates, reliability and validity assessments suggest that the Malay version of SF36 is a valid and reliable instrument. However, further work is warranted to further refine the convergent validity and reliability of some scales.


2020 ◽  
Vol 22 (Supplement_2) ◽  
pp. ii145-ii145
Author(s):  
Giuliana Zarrella ◽  
Alice Perez ◽  
Jorg Dietrich ◽  
Michael Parsons

Abstract INTRODUCTION Subjective cognitive dysfunction is an important outcome measure in neuro-oncology and may provide additional information beyond performance-based neuropsychological testing. The Functional Assessment of Cancer Therapy-Brain (FACT-Br) is a frequently used quality of life (QoL) measure that includes indices of physical, emotional, social, and neurologic aspects of disease, but does not measure cognitive concerns. This study seeks to develop and validate an index of self-reported cognition derived from existing items on the FACT-Br. METHODS 145 patients (Mage=51.08, Medu=15.63) with heterogeneous brain tumor diagnoses completed neuropsychological evaluation including cognitive testing and self-report measures. Nine FACT-Br items regarding cognition were combined to form the Cognitive Index (CI). Reliability of the CI was measured with Cronbach’s alpha. Concurrent validity was assessed by correlating the CI with the Patient-Reported Outcomes Measurement Information System (PROMIS) Cognitive Abilities-8 or PROMIS Cognitive Concerns-8. Discriminant validity was assessed by correlation of the CI with other FACT-Br indices and the Beck Depression and Anxiety Inventories (BDI, BAI). RESULTS Internal consistency within the CI was high (Cronbach’s a 0.864). The CI correlated strongly with the PROMIS-Abilities (r =.680; p&lt; 0.001) and PROMIS-Concerns (r=.780; p&lt; 0.001) indicating high convergent validity. Moderate correlations were observed between the CI and the physical and functional subscales of the FACT (r=.453 and .555), whereas correlations with the social and emotional functioning subscales were weaker (r=.381 and .325). The FACT-Br-CI correlated strongly with BDI (r=-.622) and more weakly with the BAI (r=-.344). Consistent with prior literature, the CI showed modest correlations with neuropsychological measures, including verbal memory encoding (r=.300), verbal fluency (r=.252) and a composite measure of cognition (r=.249; all p’s&lt; .01). CONCLUSIONS The FACT-Br-CI is a reliable and valid measure of self-reported cognition. Studies that include the FACT-Br could be retrospectively analyzed to assess self-reported cognitive outcomes, enriching the information gained from prior research.


Psichologija ◽  
2013 ◽  
Vol 47 ◽  
pp. 44-60
Author(s):  
M. Tvarijonavičius ◽  
D. Bagdžiūnienė

Straipsnyje analizuojama darbuotojų psichologinio įgalinimo problema, pristatomas lietuviškas psichologinio įgalinimo vertinimo klausimynas ir jo psichometrinės charakteristikos. Metodas parengtas dviem etapais, naudojant empirinę skalių konstravimo strategiją. Pirmajame etape, taikant grupinio interviu ir ekspertinio vertinimo metodus, parengti psichologinio įgalinimo vertinimo teiginiai. Antrajame etape atliktas empirinis tyrimas (dalyvavo 189 tiriamieji, reprezentuojantys 8 Lietuvos organizacijas). Remiantis jo rezultatais parengtas lietuviškas psichologinio įgalinimo vertinimo klausimynas. Tiriamosios faktorių analizės metodu išskirti penki faktoriai: prasmė, entuziazmas, sprendimų priėmimas, autonomija ir pasitikėjimas kompetencija. Klausimynas pasižymi dideliu vidiniu patikimumu (bendras Cronbacho α = 0,909, atskirų subskalių nuo 0,755 iki 0,880), dideliu konvergentiniu ir diskriminantiniu konstrukto validumu tiek viso klausimyno, tiek atskirų penkių skalių lygmeniu.Pagrindiniai žodžiai: psichologinis įgalinimas, psichologinio įgalinimo klausimynas, patikimumas, validumas.EMPLOYEE PSYCHOLOGICAL EMPOWERMENT: PSYCHOMETRIC PROPERTIES OF THE LITHUANIAN QUESTIONNAIREMantas Tvarijonavičius, Dalia Bagdžiūnienė SummaryEmployee psychological empowerment is treated as a multidimensional construct manifesting in several dimensions. It has been researched for several decades using various scales depending on the definition of psychological empowerment chosen by a reasercher. However, there is a lack of widely applicable, compact instruments for a reliable and valid assessment of psychological empowerment. Furthermore, there has been a lack of empowerment research in Lithuania. Therefore, the purpose of this study is to construct a Lithuanian psychological empowerment questionnaire and to evaluate its psychometric properties (reliability and validity).The strategy of the empirical construction of a questionnaire was used. At first, statements to describe the concept of psychological empowerment were generated, using group interviews and expert evaluation. Fifteen final items were included into the Lithuanian Psychological Empowerment Questionnaire (LPEQ). Then, an empirical research was performed: 189 respondents from 8 organizations filled up the LPEQ, G.M. Spreizer (1995) Psychological Empowerment Questionnaire (PEQ), B. E. Ashforth (1990) Helplessness Scale, Intrinsic Motivation Scale (Warr et al., 1979), and socio-demografic questions.The results of the study have revealed that the LPEQ has a high internal reliability (Cronbach α = 0.909). Five factors were extracted using the exploratoryfactor analysis, three items each. Psychological empowerment was defined based on five dimensions: meaning, enthusiasm, decision making, authonomy, and trust in competence. The Cronbach α was between 0.755 and 0.880 for the dimension level. These five dimensions show support for the existing models of psychological empowerment (Spreitzer, 1995; Menon, 2001), but also they supplement these models with for instance, the dimension of enthusiasm.The convergent validity of the LPEQ was confirmed by strong correlations (p < 0.01) between the LPEQ and the PEQ subscales, and the Intrinsic Motivation Scale. It was supported by a negative correlation between the LPEQ subscales and the Helplessness Scale. Based on the analysis of correlations, the discriminant validity of the LPEQ dimensions’ levels was confirmed.In conclusion, the Lithuanian Psychological Empowerment Questionnaire (LPEQ) can be characterized as an instrument with appropriate psychometricproperties for the use in research and practice. Directions for the future research in the field have been offered.Key words: psychological empowerment, psychological empowerment questionnaire, reliability, validity.


2018 ◽  
Vol 35 (2) ◽  
pp. 68-76 ◽  
Author(s):  
Qaisar Iqbal ◽  
Siti Hasnah Hassan ◽  
Noor Hazlina Ahmad

Infollution management is a substantial dilemma in this century. There is lacking empirical evidence about infollution management. Perceived infollution has been explored based on information quality. This study aims to identify the factors of perceived infollution (information pollution) and validate those factors using confirmatory factor analysis (CFA). Researchers have personally collected data from employees of the banking sector. Factor analysis was performed to explore the factors using Statistical Package for the Social Science, and CFA was conducted to check the reliability, validity, and the model fitness in SmartPLS. The scale developed in this study has exhibited high values of reliability and validity and ensured the presence of both discriminant validity and convergent validity. The newly developed scale of perceived infollution provides a basis for most of the academicians and researchers to empirically investigate the relationship of perceived infollution with individual’s performance and organizational effectiveness, which is considered an important area of interest among the academic researchers in recent years. Extent literature review suggests that it is the first study conducted to develop measurement scale of perceived infollution (information pollution).


Sign in / Sign up

Export Citation Format

Share Document