scholarly journals A Multilevel Bifactor Approach to Construct Validation of Mixed-Format Scales

2017 ◽  
Vol 78 (2) ◽  
pp. 253-271 ◽  
Author(s):  
Yan Wang ◽  
Eun Sook Kim ◽  
Robert F. Dedrick ◽  
John M. Ferron ◽  
Tony Tan
Keyword(s):  
Construct Validity ◽  
Predictive Validity ◽  
Construct Validation ◽  
Bifactor Model ◽  
Systematic Bias ◽  
Correlated Traits ◽  
Validity Coefficient ◽  
Negative Wording ◽  
Mixed Format ◽  
Interpretation Of Results

Wording effects associated with positively and negatively worded items have been found in many scales. Such effects may threaten construct validity and introduce systematic bias in the interpretation of results. A variety of models have been applied to address wording effects, such as the correlated uniqueness model and the correlated traits and correlated methods model. This study presents the multilevel bifactor approach to handling wording effects of mixed-format scales used in a multilevel context. The Students Confident in Mathematics scale is used to illustrate this approach. Results from comparing a series of models showed that positive and negative wording effects were present at both the within and the between levels. When the wording effects were ignored, the within-level predictive validity of the Students Confident in Mathematics scale was close to that under the multilevel bifactor model. However, at the between level, a lower validity coefficient was observed when ignoring the wording effects. Implications for applied researchers are discussed.

Construct Validation of a New Instrument to Measure Declarative Tactical Knowledge in Basketball

2021 ◽  
pp. 003151252110162
Author(s):  
Cleiton Pereira Reis ◽  
Juan Carlos Pérez Morales ◽  
Cristiano Mauro Assis Gomes ◽  
Fernando de Azevedo Alves Pereira ◽  
Sergio José Ibáñez
Keyword(s):  
Construct Validity ◽  
Teaching And Learning ◽  
Construct Validation ◽  
Weighted Least Squares ◽  
Basketball Players ◽  
Final Model ◽  
New Instrument ◽  
Mean And Variance ◽  
Fit Index ◽  
Tactical Knowledge

Measuring basketball players’ declarative tactical knowledge is relevant to the teaching and learning process. In this study we aimed to verify the construct validity and construct reliability of the Instrument for Measuring Declarative Tactical Knowledge in Basketball (IMDTK-Bb). We recruited 1,188 male basketball athletes aged 10-19 years old. We used confirmatory factor analysis with weighted least squares mean and variance estimator for construct validation and MacDonald´s omega for internal consistency. We established a final model with 17 scenes referring to the declarative tactical knowledge and type of action players used to solve game situations the scenes represented. The final model presented a good Comparative Fit Index (CFI = 1.000), Tucker–Lewis Index (TLI = 1.001) and Root Mean Square Error of Approximation (RMSEA = .000). The reliability index was .779. We conclude that the IMDTK-Bb has good construct validity and can be used in further research.

scholarly journals Questionnaire sur l’Ambiance du Groupe: A French-Language Instrument for Measuring Group Cohesion

2002 ◽  
Vol 24 (1) ◽  
pp. 42-67 ◽  
Author(s):  
Jean-Philippe Heuzé ◽  
Paul Fontayne
Keyword(s):  
Construct Validity ◽  
Predictive Validity ◽  
Present Report ◽  
Group Cohesion ◽  
French Language ◽  
Validity And Reliability ◽  
Group Environment ◽  
Psychometric Analyses ◽  
French Culture ◽  
Sport Teams

The present report provides a summary of five studies undertaken to develop a French-language instrument to assess cohesiveness in sport teams—the “Questionnaire sur l’Ambiance du Groupe” (QAG). For the initial version of the instrument, the Group Environment Questionnaire (Carron, Widmeyer, & Brawley, 1985) was translated into French using the protocol outlined by Vallerand (1989). However, psychometric analyses undertaken in Studies 1, 2, and 3 failed to yield acceptable evidence of construct validity. Items were then revised in an attempt to make them more suitable for the French culture. Subsequent analyses in Study 4 provided support for the construct validity and reliability (internal consistency and interscale equivalence) of the QAG. In Study 5, predictive validity was demonstrated. The QAG has been found to possess satisfactory psychometric properties as a measure of cohesion in sport teams.

scholarly journals Pediatric patient classification system: improvement of an instrument

2014 ◽  
Vol 48 (5) ◽  
pp. 787-793 ◽  
Author(s):  
Ariane Polidoro Dini ◽  
Edinêis de Brito Guirardello
Keyword(s):  
Construct Validity ◽  
Content Validity ◽  
Construct Validation ◽  
Validity Index ◽  
Content Validity Index ◽  
Correlational Design ◽  
Centered Care ◽  
Therapeutic Procedures ◽  
System Improvement ◽  
Family Centered

Objective Improve the content validity of the instrument for classification of pediatric patients and evaluate its construct validity. Method A descriptive exploratory study in the measurement of the content validity index, and correlational design for construct validation through exploratory factor analysis. Results The content validity index for indicators was 0.99 and it was 0.97 for graded situations. Three domains were extracted in the construct validation, namely: patient, family and therapeutic procedures, with 74.97% of explained variance. The instrument showed evidences of content and construct validity. Conclusion The validation of the instrument occurred under the approach of family-centered care, and allowed incorporating some essential needs of childhood such as playing, interaction and affection in the content of the instrument.


scholarly journals The construction and empirical verification of the Sense of Team Efficacy Questionnaire (Kwestionariusz Poczucia Druzynowej Skutecznosci)

2015 ◽  
Vol 7 (1) ◽  
pp. 14-28
Author(s):  
ZUZANNA WALACH-BISTA
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Internal Structure ◽  
Predictive Validity ◽  
Discriminant Validity ◽  
Internal Reliability ◽  
Team Efficacy ◽  
Convergent And Discriminant Validity ◽  
Group Environment ◽  
The Stability

Background: This article presents the procedure of the elaboration and verification of the first Polish Sense of Team Efficacy Questionnaire (Kwestionariusz Poczucia Druzynowej Skutecznosci – KPDS). Material/Methods: Two research stages involved a total of 373 professional athletes. Based on the collected data, the internal structure and psychometric properties of the instrument were established. Results: As a result of the conducted statistical analyses, a questionnaire was obtained. Analyses confirmed the stability of the internal structure of the questionnaire. The instrument also obtained satisfactory coefficients of reliability (using Cronbach’s alpha internal reliability coefficient) and construct validity. In order to establish the convergent and discriminant validity of the KPDS, the analysis of the multitrait-multimethod matrix was applied, using the Group Environment Questionnaire (GEQ). Predictive validity was established using the result obtained in a match played directly after the conducted study. Conclusions: The obtained results confirmed the relevance of creating the KPDS. The questionnaire was made up of 21 items representing 4 subscales: fitness, preparation, effort and endurance. Calculation of a general score for the KPDS also proved to be possible.

scholarly journals Translation, Cross-Cultural Adaptation, Validity, and Reliability of the Indonesian Version of the IKDC Subjective Knee Form

2021 ◽  
Vol 9 (9) ◽  
pp. 232596712110383
Author(s):  
Romy Deviandri ◽  
Hugo C. van der Veen ◽  
Andri M.T. Lubis ◽  
Maarten J. Postma ◽  
Inge van den Akker-Scheek
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Cultural Adaptation ◽  
Acl Injury ◽  
Cross Cultural ◽  
Systematic Bias ◽  
Validity And Reliability ◽  
Acl Injuries ◽  
Cross Cultural Adaptation ◽  
Ceiling Effects

Background: No questionnaire is currently available for use in patients with anterior cruciate ligament (ACL) injuries in an Indonesian population. The most-used questionnaire in clinical research for these patients is the International Knee Documentation Committee (IKDC) Subjective Knee Form, as its psychometric properties are considered to be excellent. Purpose: To translate the IKDC into Indonesian and assess its validity for use in Indonesian-speaking patients with ACL injuries. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: After a forward-and-backward translation procedure and cross-cultural adaptation, the validity and reliability of the questionnaire were investigated. The responses of ACL injury patients on 3 questionnaires, the Indonesian-IKDC (I-IKDC), 36-Item Short Form Health Survey, and Kujala Anterior Knee Pain Scale, were compared. Following consensus-based standards for the selection of health measurement instruments guidelines, construct validity, test-retest reliability, internal consistency, floor and ceiling effects, and measurement error were determined. The Bland-Altman method was used to explore absolute agreement. Results: Of 253 ACL injury patients, 106 (42%) responded to the invitation. Construct validity was considered good, as all predefined hypotheses on correlations between the I-IKDC and other scores were confirmed. Reliability proved excellent, with a high test-retest correlation (intraclass correlation coefficient = 0.99). Bland-Altman analyses showed no systematic bias between test and retest. Internal consistency was good (Cronbach α = .90). There were no floor or ceiling effects. Standard error of measurement was 2.1, and the minimal detectable change was 5.8 at the individual level and 0.7 at the group level. Conclusion: The I-IKDC, as developed, appeared to be a good evaluation instrument for Indonesian patients with ACL injuries.

scholarly journals Psychometric evaluation of the Smartphone for Clinical Work Scale to measure nurses’ use of smartphones for work purposes

2018 ◽  
Vol 25 (8) ◽  
pp. 1018-1025
Author(s):  
John Robert Bautista ◽  
Sonny Rosenthal ◽  
Trisha Tsui-Chuan Lin ◽  
Yin-Leng Theng
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Predictive Validity ◽  
Structural Equation ◽  
Instant Messaging ◽  
Work Productivity ◽  
Psychometric Evaluation ◽  
Clinical Work ◽  
Equation Modeling ◽  
Five Factors

Abstract Objective This study reports the development and psychometric evaluation of the Smartphone for Clinical Work Scale (SCWS) to measure nurses’ use of smartphones for work purposes. Methods Items were developed based on literature review and a preliminary study. After expert consultations and pilot testing, a 20-item scale was administered in January-June 2017 to 517 staff nurses from 19 tertiary-level general hospitals in Metro Manila, Philippines. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were used to evaluate construct validity. Structural equation modeling (SEM) was used to test the predictive validity of SCWS on perceived work productivity. Results EFA results show that 15 out of 20 items loaded on five factors: communication with clinicians via call and text, communication with doctors via instant messaging, information seeking, communication with nurses via instant messaging, and communication with patients via call and text. CFA results suggest that the five factors that form SCWS have adequate fit to the data, thus supporting construct validity. SEM results suggest predictive validity since SCWS was positively associated with perceived work productivity. Conclusions The 15-item SCWS showed satisfactory psychometric properties for use in future studies. These studies can focus on identifying factors associated with nurses’ use of smartphones for work purposes.

scholarly journals The construct validation of an instrument designed to assess organisational socialisation

2008 ◽  
Vol 34 (1) ◽  
Author(s):  
Michelle Mudurai ◽  
Chantal Olckers ◽  
Michiel Buys
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
South African ◽  
Construct Validation ◽  
Language Politics ◽  
African Perspective ◽  
And Performance ◽  
Purposive Sample

The aim of this study was to establish the construct validity of an instrument for assessing organisational socialisation. A purposive sample of 170 respondents completed the socialisation instrument. Scale reliabilities and a confrmatory factor analysis confrmed six constructs (History, Language, Politics, People, Organisational Goals and Values, and Performance Profciency) as measures of this domain. The signifcance of the fndings of this study is that from a South African perspective, the socialisation instrument can be useful in measuring organisational socialisation. This instrument can also be valuable in assessing the effectiveness of the socialisation tactics used by organisations.

Construct Validation of the Test Anxiety Scale for Children: By Converging Analyses

1964 ◽  
Vol 14 (3) ◽  
pp. 887-892
Author(s):  
James A. Dunn
Keyword(s):  
Factor Analysis ◽  
Linkage Analysis ◽  
Construct Validity ◽  
Test Anxiety ◽  
Construct Validation ◽  
Physiological Arousal ◽  
Anxiety Scale ◽  
Clear Cut ◽  
School Anxiety

Two different analysis procedures were used to ascertain the response dimensionality inherent in Sarason's Test Anxiety Scale for Children (TASC) in order that inferences regarding the functional construct validity of the scale could be made. The analysis procedures were factor analysis and McQuitty's elementary linkage analysis. The four factors obtained were: test anxiety, generalized school anxiety, recitation anxiety, and physiological arousal in anticipated recitation situations. Linkage analysis clusters closely paralleled the factors. It was felt the results were compatable with the theoretical constructs on which the scale was constructed. However, because of the clear-cut multi-dimensionality of the scale, the utilization of single TASC scores was questioned.

Private Self-Consciousness as a Moderator Variable?

1987 ◽  
Vol 60 (1) ◽  
pp. 303-312
Author(s):  
John W. Osborne ◽  
T. O. Maguire ◽  
N. Angus
Keyword(s):  
Construct Validity ◽  
Predictive Validity ◽  
The Self ◽  
Self Report ◽  
Use Of Self ◽  
Moderator Variable ◽  
Method Variance ◽  
Methodological Difficulties

Previous studies suggested that private self-consciousness may function as a moderator of the predictive validity of self-report measures of personality. This paper critically examined the construct validity of the Self-consciousness Scale used to measure private self-consciousness. The conceptual and methodological difficulties involved in measuring private self-consciousness are discussed with particular reference to the ubiquity of self-consciousness theory and the problem of method variance associated with the exclusive use of self-report in validating the Self-consciousness Scale. A phenomenologically derived profile of test experience is offered as a way of checking the validity of self-reported measures.

Sign in / Sign up

Export Citation Format

Share Document