scholarly journals Assessing Personality States: What to Consider when Constructing Personality State Measures

2020 ◽  
Vol 34 (6) ◽  
pp. 1037-1059 ◽  
Author(s):  
Kai T. Horstmann ◽  
Matthias Ziegler
Keyword(s):  
Best Practices ◽  
Daily Diary ◽  
Test Construction ◽  
Item Pool ◽  
Validity And Reliability ◽  
Personality Psychology ◽  
Sampling Studies ◽  
General Guideline ◽  
State Measure ◽  
Initial Item

Repeated assessments of personality states in daily diary or experience sampling studies have become a more and more common tool in the psychologist's toolbox. However, and contrary to the widely available literature on personality traits, no best practices for the development of personality state measures exist, and personality state measures have been developed in many different ways. To address this, we first define what a personality state is and discuss important components. On the basis of this, we define what a personality state measure is and suggest a general guideline for the development of such measures. Following the ABC of test construction can then guide the strategy for obtaining validity and reliability evidence: (A) What is the construct being measured? (B) What is the intended purpose of the measure? And (C) What is the targeted population of persons and situations? We then conclude with an example by developing an initial item pool for the assessment of conscientiousness personality states. © 2020 The Authors. European Journal of Personality published by John Wiley & Sons Ltd on behalf of European Association of Personality Psychology

scholarly journals Assessing Personality States: What to Consider when Constructing Personality State Measures

2020 ◽  
Author(s):  
Kai Tobias Horstmann ◽  
Matthias Ziegler
Keyword(s):  
Best Practices ◽  
Personality Traits ◽  
Daily Diary ◽  
Test Construction ◽  
Item Pool ◽  
Validity And Reliability ◽  
Sampling Studies ◽  
General Guideline ◽  
State Measure ◽  
Initial Item

Repeated assessments of personality states in daily diary or experience sampling studies have become a more and more common tool in the psychologist’s toolbox. However, and contrary to the widely available literature on personality traits, no best practices for the development of personality state measures exist, and personality state measures have been developed in many different ways. To address this, we first define what a personality state is and discuss important components. Based on this, we define what a personality state measure is and suggest a general guideline for the development of such measures. Following the ABC of test construction can then guide the strategy for obtaining validity and reliability evidence: (A) What is the construct being measured? (B) What is the intended purpose of the measure? And (C) What is the targeted population of persons and situations? We then conclude with an example by developing an initial item pool for the assessment of conscientiousness personality states.

scholarly journals FunQ: Measuring the fun experience of a learning activity with adolescents

2021 ◽  
Author(s):  
Gabriella Tisza ◽  
Panos Markopoulos
Keyword(s):  
Latent Variable ◽  
Essential Element ◽  
Psychometric Evaluation ◽  
Learning Activity ◽  
Item Pool ◽  
Validity And Reliability ◽  
Social Barriers ◽  
Systematic Effort ◽  
Initial Item ◽  
Development Approach

AbstractResearchers and practitioners in learning sciences, educational technology and child-computer interaction often argue that fun is an essential element of learning. Therefore, researchers in the above fields aim to explore how learning activities could be made more enjoyable in order to facilitate engagement in the learning process and to improve the learning outcomes. Despite such wide interest, there has been little systematic effort to define and measure fun. The herein introduced research aims to (a) define the term “fun” and (b) to create a tool for the reliable measurement of it. In the first study testing the initial item pool 75 students (μage = 11.78); in the think-aloud study testing the comprehensibility of the items six 11-year-old children and in the final validation study, 128 students (μage = 12.15) participated. We applied a deductive scale development approach. For the model testing, CFA was used and second-order latent variable models were fitted. In this paper, we conceptualize the term of fun and introduce the final 18-item version of the FunQ that consists of six dimensions (Autonomy, Challenge, Delight, Immersion, Loss of Social Barriers and Stress) and bears with the appropriate validity and reliability measures (ωoverall = 0.875 and ωpartial = 0.864; RMSEA = 0.052 and SRMR = 0.072). We contribute with (a) a review of the literature regarding the concept of fun, (b) a conception of fun as a multidimensional theoretically motivated concept, (c) a multidimensional instrument for assessing experienced fun—the FunQ—and (d) a psychometric evaluation of the proposed instrument. FunQ is put forward as a reliable and much-needed addition to the current palette of instruments.

scholarly journals Developing Mathematics Motivation Scale for the United Arab Emirates

2012 ◽  
Vol 6 (3) ◽  
pp. 1
Author(s):  
Jalal Haj Hussien ◽  
Othman Alsawaie ◽  
Abdelaziz Alsartawi ◽  
Iman Alghazo ◽  
Sana Tibi
Keyword(s):  
United Arab Emirates ◽  
Item Type ◽  
Temporal Stability ◽  
Self Determination Theory ◽  
Self Determination ◽  
Item Pool ◽  
Validity And Reliability ◽  
Initial Item ◽  
Mathematics Motivation ◽  
Motivation Scale

The objective of this study was to develop a valid and reliable mathematics motivation scale (MMS) for UAE students in grades 4 through 12 based on the self-determination theory. A total of 1,481 students (713 boys and 768 girls) from the UAE participated in this study. The process of developing the MMS involved: a) Development of an initial item pool, b) investigating the item-type of motivation membership, c) examining the appropriateness of the administration instructions and the items phrasing, d) and exploring various types of validity and reliability of the MMS. The results indicate that the MMS has acceptable levels of content validity and structure validity. The results also provided evidence that the MMS has acceptable levels of internal consistency and temporal stability. 

Initial development of the Dance Imagery Questionnaire for Children (DIQ-C): establishing content validity

2020 ◽  
Vol 15 (1) ◽  
Author(s):  
Irene Muir ◽  
Krista Munroe-Chandler
Keyword(s):  
Content Validity ◽  
Cognitive Interviews ◽  
Item Pool ◽  
Initial Development ◽  
Expert Rating ◽  
Content Relevance ◽  
Phase Study ◽  
Initial Item ◽  
Item Content ◽  
Dance Imagery

AbstractGiven the differences between young dancers’ and adult dancers’ use of imagery, a valid and reliable questionnaire specific to young dancers was necessary. The current study is the first phase of a multi-phase study in the development of the Dance Imagery Questionnaire for Children (DIQ-C). Specifically, the purpose of this study was to establish content validity of the DIQ-C. This was achieved through the following three stages: (1) definition, item, and scale development, (2) assessment of item clarity and appropriateness via cognitive interviews, and (3) assessment of item-content relevance via an expert rating panel. Guided by previous qualitative research with young dancers, 46 items representing seven subscales (i.e., imagery types) were developed. The initial item pool was then implemented during cognitive interviews with 16 dancers (15 females; Mage=10.63, SD=1.82), which led to the removal of 13 items and the modification of 21 items. Consequently, the revised 33-item pool was then administered to an expert panel of four imagery researchers and four dance instructors to measure item-content relevance. This resulted in the removal of eight items, the revision of four items, and the merging of two subscales. Overall, the current study provides content validity evidence for a 25-item pool (representing five subscales) to be used in further development of the DIQ-C (i.e., identifying and establishing factor structure).

Validity and reliability of the Self-administered-Psycho-TherApy-SystemS (SELFPASS) depression and anxiety self-assessment item pool: a cross-sectional online survey (Preprint)

2021 ◽  
Author(s):  
Gwendolyn Mayer ◽  
Svenja Hummel ◽  
Nadine Gronewold ◽  
Oetjen Neele ◽  
Thomas Hilbel ◽  
...  
Keyword(s):  
Mental Health ◽  
Psychometric Properties ◽  
Factor Structure ◽  
Healthy Subjects ◽  
Criterion Validity ◽  
Depression And Anxiety ◽  
Item Pool ◽  
Validity And Reliability ◽  
Self Assessment ◽  
Underlying Factor

BACKGROUND E-mental-health applications targeting at depression and anxiety have gained increased attention in mental health care. Daily self-assessment is an essential part of e-mental-health apps. The app SELFPASS (Self-administered-Psycho-TherApy-SystemS) is a self-management app to manage depressive and anxious symptoms. A self-developed item pool with 40 depression items and 12 anxiety items is included to provide symptom specific suggestions for interventions. However, the psychometric properties of the item pool have not yet been tested. OBJECTIVE The aim of this study is to investigate the validity and reliability of the SELFPASS item pool that has been developed for an internet-based daily self-assessment of depressive and anxious symptoms. METHODS An online link with the SELFPASS item pool and validated mood assessment scales were distributed to healthy subjects and patients who had received a diagnosis of a depressive disorder within the last year. Two scores were derived from the SELFPASS item pool: SELFPASS depression (SP-D) and SELFPASS anxiety (SP-A). The reliability was examined using Cronbach’s α. The construct validity was assessed via Pearson correlations with the Patients Health Questionnaire-9 (PHQ-9), the General Anxiety Disorder Scale-7 (GAD-7) and the WHO-5-Wellbeing-Scale (WHO-5). A logistic regression was performed as an indicator for concurrent criterion validity of SP-D and SP-A. A factor analysis provides information about the underlying factor structure of the item pool. Item-scale-correlations were calculated in order to determine item quality. RESULTS A total of n=284 participants were included, with n=192 (67.6%) healthy subjects and n=92 (32.4%) patients. Cronbach’s α was α=0.94 for SP-D and α=0.88 for SP-A. We found significant positive correlations of SP-D and PHQ-9 (r=0.87, P<.001), SP-A and GAD-7 (r=0.80, P<.001), and negative correlations of SP-D and WHO-5 (r=-0.80, P<.001) and SP A and WHO-5 (r=-.69, P<.001). Increasing scores of SP-D and SP-A led to increased odds of belonging to the patient group (SP-D: OR=1.03 (1.01 – 1.05), P<.001; SP-A: 1.05 (1.05 – 1.01), P=.01). The item pool showed two factors with one that consisted of mood-related items and another factor with somatic-related items. CONCLUSIONS The SELFPASS item pool showed good psychometric properties in terms of reliability, construct and criterion validity. However, the underlying factor structure could not be reduced to the two diagnostic categories depression and anxiety, but to a more mood related and a rather somatic factor. Few items should be replaced for future use.

scholarly journals Validity and reliability of the Self-administered-Psycho-TherApy-SystemS (SELFPASS) item pool for the daily mood tracking of depressive symptoms: a cross-sectional online survey (Preprint)

10.2196/29615 ◽  
2021 ◽  
Author(s):  
Gwendolyn Mayer ◽  
Svenja Hummel ◽  
Nadine Gronewold ◽  
Neele Oetjen ◽  
Thomas Hilbel ◽  
...  
Keyword(s):  
Depressive Symptoms ◽  
Online Survey ◽  
The Self ◽  
Item Pool ◽  
Validity And Reliability ◽  
Cross Sectional

scholarly journals When Good Feelings Turn Mixed: Affective Dynamics and Big Five Trait Predictors of Mixed Emotions in Daily Life

2020 ◽  
Vol 34 (3) ◽  
pp. 393-411
Author(s):  
Kate A. Barford ◽  
Peter Koval ◽  
Peter Kuppens ◽  
Luke D. Smillie
Keyword(s):  
Big Five ◽  
Daily Life ◽  
Negative Events ◽  
Positive Events ◽  
Personality Psychology ◽  
Total N ◽  
Mixed Emotions ◽  
Sampling Studies ◽  
Affective Dynamics ◽  
Negative Feelings

In this study, we examine how daily life fluctuations in positive affect (PA) and negative afect (NA) relate to mixed emotions—that is, simultaneous positive and negative feelings. We utilised three experience sampling studies (total N = 275), in which participants reported their affect 10 times each day for up to 14 days. Because people generally experience fairly stable moderate levels of PA in daily life, we proposed that mixed emotions would typically occur when NA increases and overlaps with, but does not entirely eliminate, PA. Accordingly, within individuals, we found that mixed emotions in daily life were more strongly predicted by changes in NA and the occurrence of negative events than by changes in PA and positive events. At the between–person level, individuals with more variable NA, more stable PA, and higher trait Neuroticism scores experienced higher average levels of mixed emotions. Further, we found evidence that the average magnitude of NA increases may partially mediate the association between Neuroticism and mixed emotions. We also found that positive predictors of mixed emotions are negative predictors of individuals’ within–person PA/NA correlations—that is, affective synchrony. Our findings elucidate trait predictors and affective dynamics of daily life mixed emotions, which appear closely intertwined with NA variability. © 2020 European Association of Personality Psychology

scholarly journals Situational Affordances for Prosocial Behaviour: On the Interaction between Honesty–Humility and (Perceived) Interdependence

2019 ◽  
Vol 33 (6) ◽  
pp. 655-673 ◽  
Author(s):  
Simon Columbus ◽  
Isabel Thielmann ◽  
Daniel Balliet
Keyword(s):  
European Association ◽  
Two Dimensions ◽  
Future Research ◽  
Prosocial Behaviour ◽  
Personality Psychology ◽  
Economic Games ◽  
Sampling Studies ◽  
Subjective Perceptions ◽  
High Conflict ◽  
Situational Affordances

Individual differences in prosocial behaviour are well–documented. Increasingly, there has been a focus on the specific situations in which particular personality traits predict prosocial behaviour. HEXACO Honesty–Humility—the basic trait most consistently linked to prosocial behaviour in prior studies—has been found to predict prosociality most strongly in situations that afford the exploitation of others. Importantly, though, it may be the subjectively perceived situation that affords the behavioural expression of a trait. Following this reasoning, we tested the proposition that Honesty–Humility would predict prosocial behaviour more strongly in situations characterised by, and perceived to contain, two dimensions of interdependence that can afford exploitation: high conflict and high power. However, across a series of incentivised economic games and two large experience sampling studies, we only found inconsistent evidence for the association between Honesty–Humility and prosocial behaviour. Furthermore, the link between Honesty–Humility and prosociality was neither conditional on objective interdependence nor on subjective perceptions of interdependence. Nonetheless, perceptions of conflict and power tracked objective properties of economic games and were related to prosocial behaviour in the lab and field. Future research should take individuals’ subjective understanding of situations into account, which may also help understand the (generalisability of the) effect of Honesty–Humility on prosocial behaviour. © 2019 The Authors. European Journal of Personality published by John Wiley & Sons Ltd on behalf of European Association of Personality Psychology

scholarly journals Development and Validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP)

2013 ◽  
Vol 35 (2) ◽  
pp. 180-196 ◽  
Author(s):  
Rachel Arnold ◽  
David Fletcher ◽  
Kevin Daniels
Keyword(s):  
Concurrent Validity ◽  
Structure Study ◽  
Item Pool ◽  
Factor Analyses ◽  
Confirmatory Factor Analyses ◽  
Organizational Stressors ◽  
Confirmatory Factor ◽  
Exploratory Factor Analyses ◽  
Initial Item ◽  
Development And Validation

The series of related studies reported here describe the development and validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP). In Study 1, an expert and usability panel examined the content validity and applicability of an initial item pool. The resultant 96 items were analyzed with exploratory factor analyses in Study 2, with the factorial structure comprising 5 factors (viz., Goals and Development, Logistics and Operations, Team and Culture, Coaching, Selection) and 33 items. Using confirmatory factor analyses, Studies 3 and 4 found support for the 5-factor structure. Study 4 also provided evidence for the OSI-SP’s concurrent validity and invariance across different groups. The OSI-SP is proposed as a valid and reliable measure of the organizational stressors encountered by sport performers.

scholarly journals Measuring Students’ Perceptions of Teacher Involvement in Mathematics Homework Assignments: A Scale Development

2020 ◽  
Vol 9 (6) ◽  
pp. 102
Author(s):  
Bülent Nuri ÖZCAN
Keyword(s):  
Social Sciences ◽  
Middle School ◽  
Middle School Students ◽  
Teacher Involvement ◽  
Item Pool ◽  
Main Study ◽  
Validity And Reliability ◽  
School Students ◽  
Mathematics Homework ◽  
Academic Year

This study aimed to develop a scale to determine students&rsquo; perceptions of teacher involvement in mathematics homework assignments. An item pool (n = 30) was generated based on a literature review. Based on expert feedback, the number of items was reduced to 21 scored on a 5-point Likert-type scale. A draft named the &ldquo;Scale of Teacher Involvement in Mathematics Homework Assignments (STIMHA)&rdquo; was developed after the items were reviewed by a linguist. A pilot study was conducted with six middle school students to check for comprehensibility. The items were revised and finalized based on their feedback. The main study sample consisted of 751 middle school students from four schools in Demirci/Manisa in Turkey during the 2017-2018 academic year. Data were analyzed using the Statistical Package for Social Sciences (SPSS 24.0) and Analysis of Moment Structures (AMOS 21.0). Validity and reliability were established.

Sign in / Sign up

Export Citation Format

Share Document