Content Validation Is Useful for Many Things, but Validity Isn't One of Them

2009 ◽  
Vol 2 (4) ◽  
pp. 453-464 ◽  
Author(s):  
Kevin R. Murphy
Keyword(s):  
Predictive Validity ◽  
Test Development ◽  
Empirical Support ◽  
Structural Factors ◽  
Content Validation ◽  
Legal Proceedings ◽  
Positive Correlations ◽  
Development And Validation ◽  
Job Content

Content-oriented validation strategies establish the validity of selection tests as predictors of performance by comparing the content of the tests with the content of the job. These comparisons turn out to have little if any bearing on the predictive validity of selection tests. There is little empirical support for the hypothesis that the match between job content and test content influences validity, and there are often structural factors in selection (e.g., positive correlations among selection tests) that strongly limit the possible influence of test content on validity. Comparisons between test content and job content have important implications for the acceptability of testing, the defensibility of tests in legal proceedings, and the transparency of test development and validation, but these comparisons have little if any bearing on validity.

The Team Role Test: Development and validation of a team role knowledge situational judgment test.

2008 ◽  
Vol 93 (2) ◽  
pp. 250-267 ◽  
Author(s):  
Troy V. Mumford ◽  
Chad H. Van Iddekinge ◽  
Frederick P. Morgeson ◽  
Michael A. Campion
Keyword(s):  
Test Development ◽  
Situational Judgment Test ◽  
Situational Judgment ◽  
Development And Validation

Development and Validation of the Multidimensional Motivational Climate Observation System

2015 ◽  
Vol 37 (1) ◽  
pp. 4-22 ◽  
Author(s):  
Nathan Smith ◽  
Damien Tessier ◽  
Yannis Tzioumakis ◽  
Eleanor Quested ◽  
Paul Appleton ◽  
...  
Keyword(s):  
Predictive Validity ◽  
Interobserver Reliability ◽  
Objective Assessment ◽  
Motivational Climate ◽  
Need Satisfaction ◽  
Future Research ◽  
Observation System ◽  
Validity And Reliability ◽  
Observational System ◽  
Development And Validation

This article outlines the development and validation of the Multidimensional Motivational Climate Observation System (MMCOS). Drawing from an integration of the dimensions of the social environment emphasized within achievement goal theory and self-determination theory (as assumed within Duda’s [2013] conceptualization of “empowering” and “disempowering” climates), the MMCOS was developed to enable an objective assessment of the coach-created motivational environment in sport. Study 1 supported the initial validity and reliability of the newly developed observation system. Study 2 further examined the interobserver reliability and factorial structure of the MMCOS. Study 3 explored the predictive validity of the observational system in relation to athletes’ reported basic psychological need satisfaction. Overall, the results of these studies provide preliminary support for the inter- and intraobserver reliability, as well as factorial and predictive validity of the MMCOS. Suggestions for the use of this observational system in future research in sport are provided.

scholarly journals Development and Validation of the Psychotherapeutic Effectiveness Attribution Questionnaire (PEAQ-12) in a Spanish Population

2021 ◽  
Vol 18 (19) ◽  
pp. 10372
Author(s):  
Antonio Romero-Moreno ◽  
Alberto Paramio ◽  
Serafín J. Cruces-Montes ◽  
Antonio Zayas ◽  
Diego Gómez-Carmona ◽  
...  
Keyword(s):  
Principal Component ◽  
Fit Indices ◽  
Content Validation ◽  
Theoretical Orientations ◽  
Confirmatory Factor ◽  
Attribution Questionnaire ◽  
Patient’S Perception ◽  
Development And Validation ◽  
Number Of Individuals ◽  
Initial Process

In recent decades, the study of psychotherapy effectiveness has been one of the pillars of clinical research because of its implication for therapeutic cure. However, although many studies have focused their interest on the patient’s perception, there are no instruments oriented to the study of psychotherapists’ attributions of effectiveness: to what factors psychotherapists attribute responsibility for the cure of the therapies they provide. The present study aimed to develop and validate an instrument for assessing the attribution of the effectiveness of psychotherapy in a population of 69 psychotherapists of different theoretical orientations. After an initial process of inter-judge content validation, 12 items were selected for validation in the targeted population, adequately fulfilling the quality requirements in the validity–reliability tests, and grouped into four factors after principal component analysis. These factors were as follows: (1) therapeutic alliance enhancers; (2) psychotherapist emotional characteristics; (3) therapy-specific variables; and (4) facilitators of patient engagement with therapy. This four-factor structure also showed a good fit for the fit indices checked in confirmatory factor analysis. In summary, we can conclude that the Psychotherapeutic Effectiveness Attribution Questionnaire (PEAQ-12) developed in our research can be helpful if tested on a larger number of individuals. The results can be replicated in other populations of psychotherapists.

scholarly journals Development and Validation of an Interdisciplinary Worker’s Health Approach Instrument (IWHAI)

2019 ◽  
Vol 16 (15) ◽  
pp. 2803 ◽  
Author(s):  
Lilian Monteiro Ferrari Viterbo ◽  
Maria Alzira Pimenta Dinis ◽  
André Santana Costa ◽  
Diogo Guedes Vidal
Keyword(s):  
Factor Analysis ◽  
Correlation Coefficient ◽  
Intraclass Correlation ◽  
Interdisciplinary Approach ◽  
Health Indicators ◽  
Development Stage ◽  
Five Dimensions ◽  
Positive Correlations ◽  
Response Coding ◽  
Development And Validation

The present study aimed to develop and validate an Interdisciplinary Worker’s Health Approach Instrument (IWHAI). The development stage comprised a group of 10 professionals, including physicians, nurses, nutritionists, dentists and physical educators, as well as a judges’ committee, composed by 19 recognized experts in the area of worker’s health (WH). For the validation of the IWHAI, the Spearman’s correlation coefficient (rs) was calculated, the factor analysis to the instrument was applied, and the Cronbach’s alpha (α) and the Intraclass correlation coefficient (ICC) were calculated. The IWHAI was structured in five dimensions, integrating 43 health indicators, on a scale of 0–4, totalling 215 sub-indices with closed response coding. The instrument was validated with a Kappa coefficient (KAPPA) (k), with excellent agreement for all attributes, i.e., k = 0.88 for applicability, k = 0.80 for clarity and k = 0.82 for relevance. p > 0.05 results reveal moderate to strong positive correlations between some variables, i.e., pests, vectors and air quality/drinking water quality (rs = 0.69). A total of 14 components of the factor analysis, explaining 62.6% of the data variance, were extracted. α value is considered moderate to high, α = 0.61, the ICC value also being considered moderate to high, with ICC = 0.61. The IWHAI is considered validated, constituting a technological innovation for an interdisciplinary approach in the field of WH, enabling the prevention and integral promotion of health.

scholarly journals Development and validation of a notational system to study the offensive process in football

Medicina ◽  
2010 ◽  
Vol 46 (6) ◽  
pp. 401 ◽  
Author(s):  
Hugo Sarmento ◽  
Teresa Anguera ◽  
Jorge Campaniço ◽  
José Leitão
Keyword(s):  
Ad Hoc ◽  
Intraobserver Agreement ◽  
Content Validation ◽  
Striking Change ◽  
Development And Validation ◽  
Notational System ◽  
Sophisticated Technology

The most striking change within football development is the application of science to its problems and in particular the use of increasingly sophisticated technology that, supported by scientifi c data, allows us to establish a “code of reading” the reality of the game. Therefore, this study describes the process of the development and validation of an ad hoc system of categorization, which allows the different methods of offensive game in football and the interaction to be analyzed. Therefore, through an exploratory phase of the study, we identified 10 vertebrate criteria and the respective behaviors observed for each of these criteria. We heard a panel of five experts with the purpose of a content validation. The resulting instrument is characterized by a combination of fi eld formats and systems of categories. The reliability of the instrument was calculated by the intraobserver agreement, and values above 0.95 for all criteria were achieved. Two FC Barcelona games were coded and analyzed, which allowed the detection of various Tpatterns. The results show that the instrument serves the purpose for which it was developed and can provide important information for the understanding of game interaction in football.

Measuring individual legitimacy perceptions: Scale development and validation

2018 ◽  
Vol 17 (4) ◽  
pp. 470-496 ◽  
Author(s):  
Kostas Alexiou ◽  
Jennifer Wiggins
Keyword(s):  
Scale Development ◽  
Empirical Research ◽  
Predictive Validity ◽  
Scale Structure ◽  
Scale Development And Validation ◽  
Comparison Of Results ◽  
Individual Perceptions ◽  
Development And Validation ◽  
Cognitive Legitimacy

To fully understand legitimacy as a complex construct, it is necessary to capture both collective perceptions and individual judgments. Much of the empirical research on legitimacy has focused on measuring the collective perceptions of groups of evaluators or critical institutions. This research develops and validates a psychometric measure of individual perceptions of pragmatic, moral, and cognitive legitimacy. Across seven studies, we demonstrate consistent reliability and scale structure, as well as convergent, discriminant, nomological, and predictive validity. We further show the generalizability and robustness of the measure across a variety of organizations and industries. This measure will advance empirical research on legitimacy by enabling researchers to capture the perceptions of individual evaluators directly and permit the comparison of results across studies.

scholarly journals Development and validation of an instrument for evaluating the ludicity of games in health education

2015 ◽  
Vol 49 (6) ◽  
pp. 978-987 ◽  
Author(s):  
Maria Raquel Gomes Maia Pires ◽  
Leila Bernarda Donato Göttems ◽  
Laianna Victoria Santiago Silva ◽  
Paloma Aparecida Carvalho ◽  
Gislane Ferreira de Melo ◽  
...  
Keyword(s):  
Content Analysis ◽  
Graduate Students ◽  
Health Education ◽  
Kappa Coefficient ◽  
Content Validation ◽  
Validity Index ◽  
Descriptive Research ◽  
Two Stages ◽  
Development And Validation

Abstract OBJECTIVE Developing and validating an instrument to evaluate the playfulness of games in health education contexts. METHODOLOGY A methodological, exploratory and descriptive research, developed in two stages: 1. Application of an open questionnaire to 50 graduate students, with content analysis of the answers and calculation of Kappa coefficient for defining items; 2. Procedures for construction of scales, with content validation by judges and analysis of the consensus estimate byContent Validity Index(CVI). RESULTS 53 items regarding the restless character of the games in the dimensions of playfulness, the formative components of learning and the profiles of the players. CONCLUSION Ludicity can be assessed by validated items related to the degree of involvement, immersion and reinvention of the subjects in the game along with the dynamics and playability of the game.

scholarly journals Teaching Digital Competence and Eco-Responsible Use of Technologies: Development and Validation of a Scale

2020 ◽  
Vol 12 (18) ◽  
pp. 7721 ◽  
Author(s):  
Raquel Barragán-Sánchez ◽  
María-Carmen Corujo-Vélez ◽  
Antonio Palacios-Rodríguez ◽  
Pedro Román-Graván
Keyword(s):  
Structural Equation Modeling ◽  
Structural Equation ◽  
Reliability And Validity ◽  
Digital Technologies ◽  
Equation Modeling ◽  
Content Validation ◽  
Digital Competence ◽  
Validation Process ◽  
Modeling Techniques ◽  
Development And Validation

The environmental impact produced by digital technologies is one of the fundamental contents to be developed by teachers of the 21st century. Different investigations raise the need to redesign education towards sustainable models and promote a critical look at digital technologies. The main objective of this manuscript is to design a valid, reliable and useful scale to measure self-perceived teacher digital competence regarding the eco-responsible use of technologies. The instrument has been designed based on a detailed analysis of the main frameworks for the development of digital competence in Europe: INTEF and DigCompEdu. A content validation process has been followed through the expert judgment method. Subsequently, its reliability and validity are estimated using structural equation modeling techniques. The results obtained guarantee the reliability and validity of the model. Therefore, the need to establish environmental teacher training plans and more awareness about the eco-responsible use of technologies is established.

Sign in / Sign up

Export Citation Format

Share Document