scholarly journals Crossing the seven Cs of internal consistency: Assessing the reliability of formative instruments

2021 ◽  
Author(s):  
Stefan L.K. Gruijters ◽  
Bram P.I. Fleuren ◽  
Gjalt - Jorn Ygram Peters
Keyword(s):  
Internal Consistency ◽  
Measurement Model ◽  
Composite Score ◽  
Measurement Instruments ◽  
Psychological Construct ◽  
Formative Measurement ◽  
Multiple Indicators ◽  
Item Scores ◽  
Formative Measurement Model ◽  
Reflective Measurement

Evaluating the reliability of measurement instruments is common practice in organizational psychology. When measurement proceeds using composites of multiple indicators, reliability is often examined with internal consistency estimates. This is common practice for both measurement instruments with a reflective measurement model, where a latent psychological construct is assumed to cause the item scores, and with a formative measurement model, where the composite score defines the construct. In the latter case, however, internal consistency indices such as Coefficient Alpha or Omega are not informative about reliability. In this paper, we review the assumption of reflective measurement and discuss why internal consistency estimates assume this model. We then provide an illustration of a checklist (originally proposed by Jarvis et al., 2003) intended to aid researchers, reviewers and editors in recognizing reflective measurement. Finally, the paper describes how researchers can estimate the reliability of instruments that use formative items. With these contributions, the paper aims to promote awareness of measurement assumptions when estimating reliability, and to provide tailored alternatives for assessing the reliability of formative instruments.

scholarly journals Engagement in Games: Developing an Instrument to Measure Consumer Videogame Engagement and Its Validation

2017 ◽  
Vol 2017 ◽  
pp. 1-10 ◽  
Author(s):  
Amir Zaib Abbasi ◽  
Ding Hooi Ting ◽  
Helmut Hlavacs
Keyword(s):  
Measurement Model ◽  
Second Order ◽  
Factor Solution ◽  
Formative Measurement ◽  
Multidimensional Construct ◽  
First Order ◽  
New Instrument ◽  
Valid Instrument ◽  
Formative Measurement Model ◽  
Reflective Measurement

The aim of the study is to develop a new instrument to measure engagement in videogame play termed as consumer videogame engagement. The study followed the scale development procedure to develop an instrument to measure the construct of consumer videogame engagement. In this study, we collected the data in two different phases comprising study 1 (n=136) and study 2 (n=270). We employed SPSS 22.0 for exploratory factor analysis using study 1 respondents to explore the factors for consumer videogame engagement and reliability analysis. Results of EFA resulted with six-factor solution. We further used SmartPLS 3.0 software on study 2 respondents to further confirm the six-factor solution as reflective measurement model on the first-order level, and three second-order formative constructs on the second-order or higher-order level as formative measurement model. Results of the reflective measurement model and formative measurement model evidenced that consumer videogame engagement has strong psychometric properties and is a valid instrument to measure engagement in videogame play. Results also confirmed that consumer videogame engagement is a multidimensional construct as well as a reflective-formative construct. The study is unique in its investigation as it develops an instrument to measure engagement in videogame play which comprises the cognitive, affective, and behavioral dimensions.

Going through the motions

2016 ◽  
Vol 4 (2) ◽  
pp. 149-175 ◽  
Author(s):  
Annamaria Kubovcikova
Keyword(s):  
Internal Consistency ◽  
Structural Equation ◽  
Three Dimensional ◽  
Equation Modeling ◽  
Content Type ◽  
Multiple Indicators ◽  
Concept Definition ◽  
Confirmatory Factor ◽  
Reflective Measurement ◽  
Stability And Consistency

Purpose – The purpose of this paper is to test the properties of the well-known three-dimensional adjustment scale, established by Black et al. (1988, 1989), namely, its dimensionality and internal consistency. The theoretical basis of the construct is discussed in relation to formative and reflective measurement approaches. Design/methodology/approach – Two different ways of organizing the adjustment items (random/non-random) were used to assess the internal consistency of the three-dimensional adjustment scale. The quantitative analysis presented is based on survey data from 468 assigned expatriates in Asia that were subjected to an exploratory and confirmatory factor analysis as well as a structural equation modeling – more specifically the multiple indicators multiple causes model (MIMIC). Findings – The study revealed that the adjustment construct is possibly misspecified, especially the general adjustment dimension, that was tested as a formative, not a reflective scale. There is further evidence that the wrong measurement approach skewed the coefficient that connects adjustment to performance, which is the key construct in its nomological network. Moreover, the dimensionality and the internal consistency of the scale are deteriorated to a large extent by randomization of the items. The findings highlight the need for a clear concept definition that would lead to an appropriate operationalization of the construct. Originality/value – The study is one of the few rigorously testing the properties of a construct that has been used for almost 30 years, thus yielding some novel conclusions about its stability and consistency.

Percezione del management e percezione del cliente: un confronto sui punti di forza dell'impresa

2009 ◽  
pp. 125-146
Author(s):  
Stefano Cabras ◽  
Cinzia Dessě ◽  
Michela Floris
Keyword(s):  
Customer Value ◽  
Measurement Model ◽  
Measurement Scale ◽  
Marketing Theory ◽  
Formative Measurement ◽  
Analysis Measurement ◽  
Proposed Model ◽  
Additive Contribution ◽  
Formative Measurement Model ◽  
Value Measurement

Customer value is unanimously considered to be one of the most fundamental concepts in marketing theory. Nonetheless, customer value measurement has been at best sparse or minimal. The authors specify and test a formative measurement model of customer value which describes the additive contribution of four categories of benefits and three categories of sacrifices to customer value formation. The authors present results of measurement scale development process in three consumption contexts, and show that the proposed model, which they call perceived consumption experience value (PCEV), is reliable and valid, and is able to predict customer satisfaction and loyalty better than the Gale method.Keywords: customer value, benefits and sacrifices analysis, measurement Parole chiave: valore per il cliente, analisi benefici/sacrifici, misurazione

scholarly journals Reflective or formative measurement model of sustainability factor? A three industry comparison

2016 ◽  
Vol 13 (2) ◽  
pp. 83-92 ◽  
Author(s):  
Eijaz Ahmed Khan ◽  
Mohammed Naim A. Dewan ◽  
Md. Maruf Hossan Chowdhury
Keyword(s):  
Quantitative Research ◽  
Measurement Model ◽  
Partial Least Square ◽  
Least Square ◽  
Formative Measurement ◽  
Sustainability Concept ◽  
Pls Analysis ◽  
Context Specific ◽  
Formative Measurement Model ◽  
Industry Comparison

The sustainability concept is commonly used in many domains. However, the assessment of reflective and formative measurement has been ignored largely. As a result, sustainability factor scales are specified wrongly and this might lead to reduced scale validity. The aim of the study is find out the nature of sustainability factors either reflective or formative by investigating three distinct industrial settings in Bangladesh. A quantitative research design is used and the data is analysed through Partial Least Square (PLS) analysis. PLS analysis validates the indicators and factors. Sustainability factors in context of microbusiness and supply chain found reflective in nature whereas in e-business it was formative. The study suggests that sustainability factor is a context specific phenomena and it can be treated either reflective or formative.

scholarly journals Reflective –Formative Measurement Model of Social Factors and Willlingness To Share Knowledge

2019 ◽  
Vol 11 (2-2) ◽  
Author(s):  
Norfadzilah Abdul Razak ◽  
Faizuniah Pangil ◽  
Md Lazim Mohd Zin
Keyword(s):  
Construct Validity ◽  
Social Factors ◽  
Discriminant Validity ◽  
Influence Factor ◽  
Knowledge Worker ◽  
Measurement Model ◽  
Formative Measurement ◽  
The Difference ◽  
Ict Industry ◽  
Formative Measurement Model

This paper aims to investigate the convergent and construct validity between reflective and formative measurement model. The difference assessment presents a different result of the validity. This paper analysed the reflective construct followed by formative measurement of second-order constructs (i.e., social factors and willingness to share knowledge) using SmartPLS. The data were collected from 150 of the knowledge worker in the ICT industry which registered in a MSC Company. The finding confirmed the indicator and construct examined in the model were valid and reliable. Furthermore, details of discriminant validity, collinearity, tolerance, and variance influence factor were also further discussed. The implication of this finding are brought to fore.

Development and validation of employee wellbeing scale – a formative measurement model

2019 ◽  
Vol 12 (5) ◽  
pp. 352-368
Author(s):  
Puja Khatri ◽  
Pragya Gupta
Keyword(s):  
Convergent Validity ◽  
Measurement Model ◽  
Model Specification ◽  
Primary Data ◽  
Cross Sectional ◽  
Content Type ◽  
Four Dimensions ◽  
Formative Measurement ◽  
Employee Wellbeing ◽  
Formative Measurement Model

Purpose The purpose of this paper is to conceptualize a suitable measure for the employee wellbeing construct and validate this tool in Indian workplace settings, especially with reference to IT/ITes and BFSI sectors. Design/methodology/approach This study is descriptive and cross-sectional in nature. The literature was first reviewed to identify the underlying probable dimensions of employee wellbeing and its corresponding items. These items were then subjected to elaborate discussions with experts from industry as well as academia. The index, thus, developed was administered to collect primary data from employees working in IT/ITeS and BFSI sectors based in Delhi-NCR. PLS SEM 3 was applied as employee wellbeing was construed as a first-order reflective second-order formative construct. Thereafter, it was subjected to suitable assessments of reliability and convergent validity. Findings The findings reveal that employee wellbeing can be conceptualized as a construct having four dimensions namely, purpose in life (PIL), work–life balance (WLB), job wellness (JW) and physical wellness (PW). It was also revealed that all the dimensions identified in the study capture different facets of the employee wellbeing and collectively define the construct; omission of any items may lead to change in the nature of the construct. This investigation is unique as it frames the index of employee wellbeing with specifications of a formative measurement model. To the best of the authors’ knowledge, no published study so far has measured EWB as a formative construct. Originality/value Many earlier studies have incorporated a unidimensional approach to individual wellbeing and lacked a crucial outlook of having multi-dimensional understanding of the employee wellbeing construct in the social and work context. Furthermore, this paper contributes not only to the existing body of knowledge in employee wellbeing, but also brings forth an important aspect of measurement model specification, i.e. formative measurement model by bringing the specific reasons for taking employee wellbeing as a formative concept.

scholarly journals Design of Batik Crafts Industrial Performance Measurement Model in Wukirsari Region Bantul

2018 ◽  
Vol 4 ◽  
Author(s):  
Yasrin Zabidi
Keyword(s):  
Performance Measurement ◽  
Balanced Scorecard ◽  
Performance Indicators ◽  
Performance Indicator ◽  
Problem Formulation ◽  
Measurement Model ◽  
Measurement Instruments ◽  
The Balanced Scorecard ◽  
Craft Industry ◽  
Initial Research

One important factor in influencing the progress and decline of an industry is the performance factor. Performance issues are not only important for middle-to-upper-level companies and large companies, but also important for small and medium industries such as the batik craft industry in the Wukirsari region, Bantul. Given the importance of performance, researchers tried to design a performance measurement model of the batik craft industry in the Wukirsari region, Bantul with the aim of identifying performance criteria, determining performance indicators, formulating performance indicators, and making performance measurement instruments. The steps in this study are divided into four phases, namely the initial research phase and problem formulation, the design phase, the analysis phase and the conclusion phase. The initial research phase and problem formulation include, the profile of the batik craft industry in the Wukirsari region, Bantul, the current performance evaluation system, problem formulation and research objectives. The design phase includes the design process of the performance measurement model with the Balanced Scorecard method which includes setting strategic objectives, establishing performance indicators (key performance indicators), determining performance indicator formulas, making performance measurement instruments. Analysis phase includes KPI analysis and strategy map analysis. Conclusion phase includes conclusions from the results of research and suggestions for the batik craft industry in Wukirsari, Bantul. From the results of the study obtained four performance perspectives based on the balanced scorecard, namely financial, customer, internal business processes, learning and growth. five, namely: increased sales growth, high customer satisfaction, improved system and better work processes, the creation of a good work climate, and increased employee productivity.There are seven performance indicators formed, namely: the rate of sales growth, the level of customer satisfaction, level of compliance with customer complaints, percentage of defective products, number of new products, level of job satisfaction, and employee productivity. The establishment of a performance measurement worksheet, so that the performance values of each performance indicator and total performance can be known in a certain period.Keywords: Performance, Measurement, Batik

Exploring competitiveness and wellbeing in Italy by spatial principal component analysis

2021 ◽  
pp. 141-146
Author(s):  
Carlo Cusatelli ◽  
Massimiliano Giacalone ◽  
Eugenia Nissi
Keyword(s):  
Principal Component Analysis ◽  
Principal Component ◽  
Well Being ◽  
Component Analysis ◽  
Measurement Model ◽  
Statistical Technique ◽  
Multivariate Statistical ◽  
Spatial Principal Component Analysis ◽  
Italian Provinces ◽  
Reflective Measurement

Well being is a multidimensional phenomenon, that cannot be measured by a single descriptive indicator and that, it should be represented by multiple dimensions. It requires, to be measured by combination of different dimensions that can be considered together as components of the phenomenon. This combination can be obtained by applying methodologies knows as Composite Indicators (CIs). CIs are largely used to have a comprehensive view on a phenomenon that cannot be captured by a single indicator. Principal Component Analysis (PCA) is one of the most popular multivariate statistical technique used for reducing data with many dimension, and often well being indicators are obtained using PCA. PCA is implicitly based on a reflective measurement model that it non suitable for all types of indicators. Mazziotta and Pareto (2013) in their paper discuss the use and misuse of PCA for measuring well-being. The classical PCA is not suitable for data collected on the territory because it does not take into account the spatial autocorrelation present in the data. The aim of this paper is to propose the use of Spatial Principal Component Analysis for measuring well being in the Italian Provinces.

Sign in / Sign up

Export Citation Format

Share Document