Developing a new human-autonomy team cohesion Scale

Cohesion is an important construct in understanding human-autonomy team dynamics and effectiveness, yet methods to adequately measure this construct are still being developed. Here we describe the initial steps of the development of a new human-autonomy team cohesion scale: item development, content validation, and preliminary scale item evaluation. The initial item pool was developed resulting in 134 items and underwent content validation with subject matter experts to reduce the item pool to 82. For the content validation, participants watched a set of video clips displaying examples of high and low human-autonomy team cohesion and rated the clips using the new human-autonomy team cohesion scale. Preliminary results revealed that our new human-autonomy team cohesion scale is a reliable and valid measure of cohesion in these contexts. Additionally, ratings for the high cohesion clips were somewhat higher than the low cohesion clips. Further analyses will determine if each of the items are contributing to the overall validity of the scale and will be further evaluated for possible removal.

Download Full-text

Initial development of the Dance Imagery Questionnaire for Children (DIQ-C): establishing content validity

Journal of Imagery Research in Sport and Physical Activity ◽

10.1515/jirspa-2020-0017 ◽

2020 ◽

Vol 15 (1) ◽

Author(s):

Irene Muir ◽

Krista Munroe-Chandler

Keyword(s):

Content Validity ◽

Cognitive Interviews ◽

Item Pool ◽

Initial Development ◽

Expert Rating ◽

Content Relevance ◽

Phase Study ◽

Initial Item ◽

Item Content ◽

Dance Imagery

AbstractGiven the differences between young dancers’ and adult dancers’ use of imagery, a valid and reliable questionnaire specific to young dancers was necessary. The current study is the first phase of a multi-phase study in the development of the Dance Imagery Questionnaire for Children (DIQ-C). Specifically, the purpose of this study was to establish content validity of the DIQ-C. This was achieved through the following three stages: (1) definition, item, and scale development, (2) assessment of item clarity and appropriateness via cognitive interviews, and (3) assessment of item-content relevance via an expert rating panel. Guided by previous qualitative research with young dancers, 46 items representing seven subscales (i.e., imagery types) were developed. The initial item pool was then implemented during cognitive interviews with 16 dancers (15 females; Mage=10.63, SD=1.82), which led to the removal of 13 items and the modification of 21 items. Consequently, the revised 33-item pool was then administered to an expert panel of four imagery researchers and four dance instructors to measure item-content relevance. This resulted in the removal of eight items, the revision of four items, and the merging of two subscales. Overall, the current study provides content validity evidence for a 25-item pool (representing five subscales) to be used in further development of the DIQ-C (i.e., identifying and establishing factor structure).

Download Full-text

Identifying New Team Trust and Team Cohesion Metrics that Support Future Human-Autonomy Teams

Advances in Simulation and Digital Human Modeling - Advances in Intelligent Systems and Computing ◽

10.1007/978-3-030-51064-0_12 ◽

2020 ◽

pp. 86-93

Author(s):

Alyssa Milner ◽

Dae Han Seong ◽

Ralph W. Brewer ◽

Anthony L. Baker ◽

Andrea Krausman ◽

...

Keyword(s):

Team Cohesion ◽

Human Autonomy ◽

Team Trust

Download Full-text

Practice-Based Measures of Elementary Science Teachers' Content Knowledge for Teaching: Initial Item Development and Validity Evidence

ETS Research Report Series ◽

10.1002/ets2.12168 ◽

2017 ◽

Vol 2017 (1) ◽

pp. 1-72 ◽

Cited By ~ 5

Author(s):

Jamie N. Mikeska ◽

Geoffrey Phelps ◽

Andrew J. Croft

Keyword(s):

Content Knowledge ◽

Science Teachers ◽

Elementary Science ◽

Validity Evidence ◽

Knowledge For Teaching ◽

Item Development ◽

Elementary Science Teachers ◽

Initial Item ◽

Content Knowledge For Teaching

Download Full-text

Assessing Personality States: What to Consider when Constructing Personality State Measures

European Journal of Personality ◽

10.1002/per.2266 ◽

2020 ◽

Vol 34 (6) ◽

pp. 1037-1059 ◽

Cited By ~ 1

Author(s):

Kai T. Horstmann ◽

Matthias Ziegler

Keyword(s):

Best Practices ◽

Daily Diary ◽

Test Construction ◽

Item Pool ◽

Validity And Reliability ◽

Personality Psychology ◽

Sampling Studies ◽

General Guideline ◽

State Measure ◽

Initial Item

Repeated assessments of personality states in daily diary or experience sampling studies have become a more and more common tool in the psychologist's toolbox. However, and contrary to the widely available literature on personality traits, no best practices for the development of personality state measures exist, and personality state measures have been developed in many different ways. To address this, we first define what a personality state is and discuss important components. On the basis of this, we define what a personality state measure is and suggest a general guideline for the development of such measures. Following the ABC of test construction can then guide the strategy for obtaining validity and reliability evidence: (A) What is the construct being measured? (B) What is the intended purpose of the measure? And (C) What is the targeted population of persons and situations? We then conclude with an example by developing an initial item pool for the assessment of conscientiousness personality states. © 2020 The Authors. European Journal of Personality published by John Wiley & Sons Ltd on behalf of European Association of Personality Psychology

Download Full-text

Development and Validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP)

Journal of Sport and Exercise Psychology ◽

10.1123/jsep.35.2.180 ◽

2013 ◽

Vol 35 (2) ◽

pp. 180-196 ◽

Cited By ~ 35

Author(s):

Rachel Arnold ◽

David Fletcher ◽

Kevin Daniels

Keyword(s):

Concurrent Validity ◽

Structure Study ◽

Item Pool ◽

Factor Analyses ◽

Confirmatory Factor Analyses ◽

Organizational Stressors ◽

Confirmatory Factor ◽

Exploratory Factor Analyses ◽

Initial Item ◽

Development And Validation

The series of related studies reported here describe the development and validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP). In Study 1, an expert and usability panel examined the content validity and applicability of an initial item pool. The resultant 96 items were analyzed with exploratory factor analyses in Study 2, with the factorial structure comprising 5 factors (viz., Goals and Development, Logistics and Operations, Team and Culture, Coaching, Selection) and 33 items. Using confirmatory factor analyses, Studies 3 and 4 found support for the 5-factor structure. Study 4 also provided evidence for the OSI-SP’s concurrent validity and invariance across different groups. The OSI-SP is proposed as a valid and reliable measure of the organizational stressors encountered by sport performers.

Download Full-text

Construction of a religious identity status questionnaire

Psihologija ◽

10.2298/psi190706020s ◽

2020 ◽

Vol 53 (2) ◽

pp. 199-220

Author(s):

Irena Stojkovic ◽

Sanja Dimoski ◽

Jovan Miric

Keyword(s):

Psychosocial Development ◽

Religious Identity ◽

Convergent Validity ◽

Psychometric Evaluation ◽

Ego Identity ◽

Identity Status ◽

Item Pool ◽

Identity Statuses ◽

Ego Identity Status ◽

Initial Item

This study presents a construction and psychometric evaluation of the Religious Identity Status Questionnaire ? RISQ for the assessment of the religious identity status according to Marcia?s ego identity status approach. The initial item pool was generated based on Erikson?s theory of psychosocial development, Marcia?s ego identity status approach and interviews with adolescents and young adults. A factor analysis of the initial item pool was performed on data obtained from a sample of 394 secondary school and university students from Serbia to select items for the questionnaire. Validity of the questionnaire was examined on a sample of 1155 subjects. The results of the CFA suggest that subscales of the RISQ measure four factors corresponding to the identity statuses of Marcia?s model. Correlations with ideological identity subscales of the EOM?EIS?2 suggest the convergent validity of the questionnaire. Configural measurement invariance was established for gender and denominational groups. Metric invariance was established for gender and among orthodox and catholic participants, whereas scalar invariance was established for gender, but not for denominational groups.

Download Full-text

Development and content validation of the Healthcare Transition Outcomes Inventory for young adults with type 1 diabetes

Journal of Patient-Reported Outcomes ◽

10.1186/s41687-019-0163-9 ◽

2019 ◽

Vol 3 (1) ◽

Cited By ~ 1

Author(s):

Jessica Pierce ◽

Karen Aroian ◽

Elizabeth Schifano ◽

Anthony Gannon ◽

Tim Wysocki

Keyword(s):

Type 1 Diabetes ◽

Young Adults ◽

Young Adult ◽

Healthcare Providers ◽

Cognitive Interviews ◽

Item Pool ◽

Content Validation ◽

Transition Outcomes ◽

Healthcare Transition

Abstract Background The literature on the specification and measurement of the outcomes of the healthcare transition from pediatric to adult centered-care is scarce and methodologically weak. To address these gaps, we conducted a series of studies to develop a multidimensional, multi-informant (young adults, parents, and healthcare providers) measure of healthcare transition outcomes for young adults with type 1 diabetes (T1D), the Healthcare Transition Outcomes Inventory (HCTOI). The current study describes the development and refinement of the HCTOI item pool. Methods Following Patient Reported Outcomes Measurement Information System (PROMIS) standards, the research team conducted qualitative interviews to define six content domains of healthcare transition outcomes from the perspectives of multiple stakeholders, developed an initial item pool of the HCTOI based on the six domains, analyzed expert item ratings and feedback for content validation, and conducted cognitive interviews with informants (patients, parents, and healthcare providers) for further item pool refinement. Results Qualitative findings revealed six healthcare transition outcome domains: 1) Biomedical markers of T1D control; 2) Navigation of a new health care system; 3) Possession of T1D self-management skills and knowledge; 4) Integration of T1D care into emerging adult roles; 5) Balance of parental involvement with autonomy; and 6) Attainment of T1D “ownership.” An initial pool of 88 items focused on the extent to which a young adult with T1D is successful on each of the six domains. Experts rated all content domains and all but six items as relevant. In addition to suggesting additional items, experts were concerned about the length of the measure, response burden, and whether every informant type would have sufficient knowledge to rate items in particular content domains. Cognitive interviews resulted in retaining all six content domains, but dropping some items and yielded fewer items for the healthcare provider version (47 items versus 54 items for the young adult- and parent-versions). Conclusions Expert review and cognitive interviews confirmed that all six domains of HCT outcomes were relevant and both procedures resulted in retaining a sufficient number of clear and representative items for each content domain. The HCTOI represents the first multi-informant, rigorously developed item pool that comprehensively measures the multiple components of the transition from pediatric to adult specialty healthcare.

Download Full-text

Development of a Litigaphobia Scale: Measurement of Excessive Fear of Litigation

Psychological Reports ◽

10.2466/pr0.1986.58.2.547 ◽

1986 ◽

Vol 58 (2) ◽

pp. 547-550 ◽

Cited By ~ 12

Author(s):

Frances A. Breslin ◽

Kathryn R. Taylor ◽

Stanley L. Brodsky

Keyword(s):

Item Pool ◽

Factor Analyses ◽

Factor I ◽

Scaling Procedure ◽

Initial Item ◽

Guttman Scaling ◽

Item Scale ◽

Main Factor

The present investigation was directed toward the development of a psychometrically sound instrument that would permit measurement and understanding of the phenomenon of litigaphobia. An initial item pool of 143 items was subjected to a Thurstone analysis. 47 items survived this screening for low ambiguity and uniform spread of tearfulness. These 47 items were administered to 123 physicians and psychologists in a six-point Likert format. The Kuder-Richardson-20 split-half analysis was .90. Next a series of factor analyses were performed. A main factor was identified as generalized litigaphobia and a second factor was labelled invulnerability to litigation. A Guttman scaling procedure for Factor I yielded a four-item scale with a reproducibility coefficient of .92.

Download Full-text

Assessing Personality States: What to Consider when Constructing Personality State Measures

10.31234/osf.io/sa49b ◽

2020 ◽

Author(s):

Kai Tobias Horstmann ◽

Matthias Ziegler

Keyword(s):

Best Practices ◽

Personality Traits ◽

Daily Diary ◽

Test Construction ◽

Item Pool ◽

Validity And Reliability ◽

Sampling Studies ◽

General Guideline ◽

State Measure ◽

Initial Item

Repeated assessments of personality states in daily diary or experience sampling studies have become a more and more common tool in the psychologist’s toolbox. However, and contrary to the widely available literature on personality traits, no best practices for the development of personality state measures exist, and personality state measures have been developed in many different ways. To address this, we first define what a personality state is and discuss important components. Based on this, we define what a personality state measure is and suggest a general guideline for the development of such measures. Following the ABC of test construction can then guide the strategy for obtaining validity and reliability evidence: (A) What is the construct being measured? (B) What is the intended purpose of the measure? And (C) What is the targeted population of persons and situations? We then conclude with an example by developing an initial item pool for the assessment of conscientiousness personality states.

Download Full-text