Does Anyone Care About External Validity? A Call (or Plea?) for More OB/HR Research From Multiple Organizations/Industries, Panels, and Publicly Available Datasets

2021 ◽  
pp. 105960112110558
Author(s):  
Kevin S. Cruz
Keyword(s):  
External Validity

The German Post-Critical Belief Scale: Internal and External Validity

2003 ◽  
Vol 34 (4) ◽  
pp. 219-226 ◽  
Author(s):  
Bart Duriez ◽  
Claudia Appel ◽  
Dirk Hutsebaut
Keyword(s):  
Internal Structure ◽  
Present Article ◽  
External Validity ◽  
German Version ◽  
Dutch Version ◽  
German Sample ◽  
Belief Scale ◽  
Internal And External Validity

Abstract: Recently, Duriez, Fontaine and Hutsebaut (2000) and Fontaine, Duriez, Luyten and Hutsebaut (2003) constructed the Post-Critical Belief Scale in order to measure the two religiosity dimensions along which Wulff (1991 , 1997 ) summarized the various possible approaches to religion: Exclusion vs. Inclusion of Transcendence and Literal vs. Symbolic. In the present article, the German version of this scale is presented. Results obtained in a heterogeneous German sample (N = 216) suggest that the internal structure of the German version fits the internal structure of the original Dutch version. Moreover, the observed relation between the Literal vs. Symbolic dimension and racism, which was in line with previous studies ( Duriez, in press ), supports the external validity of the German version.

Analysis of Self-Concept in Older Adults in Different Contexts

2004 ◽  
Vol 20 (4) ◽  
pp. 262-274 ◽  
Author(s):  
Manuel de Gracia Blanco ◽  
Josep Garre Olmo ◽  
María Marcó Arbonès ◽  
Pilar Monreal Bosch
Keyword(s):  
Older Adults ◽  
Nursing Home ◽  
Depressive Symptoms ◽  
External Validity ◽  
Aging Process ◽  
Well Being ◽  
Self Esteem ◽  
Self Concept ◽  
Self Perceptions ◽  
Discriminatory Capacity

Summary: Self-concept is a construct consisting of a group of specific self-perceptions that are hierarchically organized. Age-associated changes of self-concept are related to the individual's perception of the changes occurring throughout the aging process. The authors examined external validity and internal consistency of an instrument that has been developed to assess self-concept in older adults and examined self-concept's characteristics in two different contexts. Results confirm the multidimensionality of the scale and show a satisfactory external validity, indicating good discriminatory capacity. Findings support the hypothesis that older people who live in a nursing home have a poor self-esteem, self-concept, and psychological well-being and have a greater presence of depressive symptoms than people who live in their own home.

A Preregistered Validation Study of the Taylor Aggression Paradigm

2017 ◽  
Author(s):  
David Skylan Chester
Keyword(s):  
Aggressive Behavior ◽  
Validation Study ◽  
Real World ◽  
External Validity ◽  
State Level ◽  
Taylor Aggression Paradigm ◽  
Psychological Science ◽  
Laboratory Measure ◽  
Behavioral Tasks ◽  
Preliminary Support

The Taylor Aggression Paradigm (TAP) is a frequently-used laboratory measure of aggressive behavior. However, the flexibility inherent in its implementation and analysis can undermine its validity. To test whether the TAP was a valid aggression measure irrespective of this flexibility, I conducted a preregistered study of a 25-trial version of the TAP using a single scoring approach with 160 diverse undergraduate participants. TAP scores showed agreement with other laboratory aggression measures and were magnified by an experimental provocation manipulation. Mixed evidence was found for associations with aggressive dispositions and real-world violence. These results provide preliminary support for this approach to the TAP to measure state-level aggressive behavior. However, more evidence is needed to assess the TAP’s external validity and ability to measure dispositional forms of aggression. Using preregistered designs, researchers should validate specific variants of their behavioral tasks in order to optimize the veridicality and reproducibility of psychological science.

scholarly journals External validity of somatostatin analogues trials in advanced neuroendocrine neoplasms: the GETNE-TRASGU study

2021 ◽  
Author(s):  
Paula Jimenez-Fonseca ◽  
Alberto Carmona-Bayonas ◽  
Angela Lamarca ◽  
Jorge Barriuso ◽  
Angel Castaño ◽  
...  
Keyword(s):  
Real World ◽  
External Validity ◽  
Randomized Clinical Trials ◽  
Cox Model ◽  
Analytical Data ◽  
Somatostatin Analogues ◽  
Unknown Primary ◽  
Octreotide Lar ◽  
Well Differentiated ◽  
Lanreotide Autogel

Introduction: Somatostatin analogues (SSA) prolong progression-free survival (PFS) in patients with well-differentiated gastroenteropancreatic neuroendocrine tumors (GEP-NETs). However, the eligibility criteria in randomized clinical trials (RCTs) have been restricted, which contrasts with the vast heterogeneity found in NETs. Methods: We identified patients with well-differentiated (Ki67% ≤20%), metastatic GEP-NETs treated in first-line with SSA monotherapy from the Spanish R-GETNE registry. The therapeutic effect was evaluated using a Bayesian Cox model. The objective was to compare survival-based outcomes from real world clinical practice versus RCTs. Results: The dataset contained 535 patients with a median age of 62 years (range: 26-89). The median Ki67% was 4 (range: 0-20). The most common primary tumor sites were: midgut, 46%; pancreas, 34%; unknown primary, 10%; and colorectal, 10%. Half of the patients received octreotide LAR (n=266) and half, lanreotide autogel (n=269). The median PFS was 28.0 months (95% CI, 22.1-32.0) for octreotide vs 30.1 months (95% CI, 23.1-38.0) for lanreotide. The overall hazard ratio for lanreotide vs octreotide was 0.90 (95% credible interval, 0.71-1.12). The probability of effect sizes >30% with lanreotide vs octreotide was 2% and 6% for midgut and foregut NENs, respectively. Conclusion: Our study evaluated the external validity of RCTs examining SSAs in the real world, as well as the main effect-modifying factors (progression status, symptoms, tumor site, specific metastases, and analytical data).. Our results indicate that both octreotide LAR and lanreotide autogel had a similar effect on PFS. Consequently, both represent valid alternatives in patients with well-differentiated, metastatic GEP-NENs.

Improving the External Validity of Conjoint Analysis: The Essential Role of Profile Distribution

2021 ◽  
pp. 1-27 ◽  
Author(s):  
Brandon de la Cuesta ◽  
Naoki Egami ◽  
Kosuke Imai
Keyword(s):  
Conjoint Analysis ◽  
Real World ◽  
External Validity ◽  
Causal Effect ◽  
The Other ◽  
Estimation Methods ◽  
Social Scientists ◽  
Actual Distribution ◽  
Open Source Software Package ◽  
Profile Distribution

Abstract Conjoint analysis has become popular among social scientists for measuring multidimensional preferences. When analyzing such experiments, researchers often focus on the average marginal component effect (AMCE), which represents the causal effect of a single profile attribute while averaging over the remaining attributes. What has been overlooked, however, is the fact that the AMCE critically relies upon the distribution of the other attributes used for the averaging. Although most experiments employ the uniform distribution, which equally weights each profile, both the actual distribution of profiles in the real world and the distribution of theoretical interest are often far from uniform. This mismatch can severely compromise the external validity of conjoint analysis. We empirically demonstrate that estimates of the AMCE can be substantially different when averaging over the target profile distribution instead of uniform. We propose new experimental designs and estimation methods that incorporate substantive knowledge about the profile distribution. We illustrate our methodology through two empirical applications, one using a real-world distribution and the other based on a counterfactual distribution motivated by a theoretical consideration. The proposed methodology is implemented through an open-source software package.

scholarly journals An Analysis of the External Validity of EEG Spectral Power in an Uncontrolled Outdoor Environment during Default and Complex Neurocognitive States

2021 ◽  
Vol 11 (3) ◽  
pp. 330
Author(s):  
Dalton J. Edwards ◽  
Logan T. Trujillo
Keyword(s):  
External Validity ◽  
Spectral Power ◽  
Brain Activity ◽  
Outdoor Environment ◽  
Oscillatory Activity ◽  
Brain State ◽  
Beta Band ◽  
Eeg Spectral Power ◽  
Eeg Power ◽  
Human Participants

Traditionally, quantitative electroencephalography (QEEG) studies collect data within controlled laboratory environments that limit the external validity of scientific conclusions. To probe these validity limits, we used a mobile EEG system to record electrophysiological signals from human participants while they were located within a controlled laboratory environment and an uncontrolled outdoor environment exhibiting several moderate background influences. Participants performed two tasks during these recordings, one engaging brain activity related to several complex cognitive functions (number sense, attention, memory, executive function) and the other engaging two default brain states. We computed EEG spectral power over three frequency bands (theta: 4–7 Hz, alpha: 8–13 Hz, low beta: 14–20 Hz) where EEG oscillatory activity is known to correlate with the neurocognitive states engaged by these tasks. Null hypothesis significance testing yielded significant EEG power effects typical of the neurocognitive states engaged by each task, but only a beta-band power difference between the two background recording environments during the default brain state. Bayesian analysis showed that the remaining environment null effects were unlikely to reflect measurement insensitivities. This overall pattern of results supports the external validity of laboratory EEG power findings for complex and default neurocognitive states engaged within moderately uncontrolled environments.

scholarly journals Development of a measure of kindness

2021 ◽  
Author(s):  
Donna E. Youngs ◽  
Miroslava A. Yaneva ◽  
David V. Canter
Keyword(s):  
Factor Analysis ◽  
Multivariate Analysis ◽  
Positive Psychology ◽  
Conceptual Framework ◽  
External Validity ◽  
Exploratory Study ◽  
Male And Female ◽  
Psychometric Instrument ◽  
Smallest Space Analysis ◽  
Item Questionnaire

AbstractIn the spirit of the growing developments in positive psychology, there is an increasing interest in how kind people are to each other. Yet, this area lacks any strong psychometric instrument. An initial exploratory study demonstrated that a 40-item questionnaire, completed by 165 people, revealed distinct aspects of kindness when subjected to multivariate analysis. A subsequent study is reported, using the structure of the exploratory results to further clarify the conceptual framework (Study 1). The revised 45-item questionnaire was administered to 1039 individuals from the general British population. Smallest Space Analysis of the variables, supported by Factor analysis, confirmed the hypothesis of two facets to kindness, the psychological source of the action (from principles or empathy), and the form of expression (through psychological involvement or following social prescription. It also revealed an additional general, core kindness, labelled Anthropophilia. Reliable scales derived from the combinations of the two elements from each facet were identified: Affective-Socially Prescribed; Affective-Proactive; Principle-Socially Prescribed and Principle-Proactive. Intercorrelations between the scales revealed that they measure different modes of kindness. Comparisons between male and female respondents provided external validity for the questionnaire. Study 2 (N = 251) reported that the scales measure independent dimensions when correlated with similar and dissimilar concepts.

Sign in / Sign up

Export Citation Format

Share Document