scholarly journals Assessing Personality States: What to Consider when Constructing Personality State Measures

2020 ◽  
Author(s):  
Kai Tobias Horstmann ◽  
Matthias Ziegler
Keyword(s):  
Best Practices ◽  
Personality Traits ◽  
Daily Diary ◽  
Test Construction ◽  
Item Pool ◽  
Validity And Reliability ◽  
Sampling Studies ◽  
General Guideline ◽  
State Measure ◽  
Initial Item

Repeated assessments of personality states in daily diary or experience sampling studies have become a more and more common tool in the psychologist’s toolbox. However, and contrary to the widely available literature on personality traits, no best practices for the development of personality state measures exist, and personality state measures have been developed in many different ways. To address this, we first define what a personality state is and discuss important components. Based on this, we define what a personality state measure is and suggest a general guideline for the development of such measures. Following the ABC of test construction can then guide the strategy for obtaining validity and reliability evidence: (A) What is the construct being measured? (B) What is the intended purpose of the measure? And (C) What is the targeted population of persons and situations? We then conclude with an example by developing an initial item pool for the assessment of conscientiousness personality states.

scholarly journals Assessing Personality States: What to Consider when Constructing Personality State Measures

2020 ◽  
Vol 34 (6) ◽  
pp. 1037-1059 ◽  
Author(s):  
Kai T. Horstmann ◽  
Matthias Ziegler
Keyword(s):  
Best Practices ◽  
Daily Diary ◽  
Test Construction ◽  
Item Pool ◽  
Validity And Reliability ◽  
Personality Psychology ◽  
Sampling Studies ◽  
General Guideline ◽  
State Measure ◽  
Initial Item

Repeated assessments of personality states in daily diary or experience sampling studies have become a more and more common tool in the psychologist's toolbox. However, and contrary to the widely available literature on personality traits, no best practices for the development of personality state measures exist, and personality state measures have been developed in many different ways. To address this, we first define what a personality state is and discuss important components. On the basis of this, we define what a personality state measure is and suggest a general guideline for the development of such measures. Following the ABC of test construction can then guide the strategy for obtaining validity and reliability evidence: (A) What is the construct being measured? (B) What is the intended purpose of the measure? And (C) What is the targeted population of persons and situations? We then conclude with an example by developing an initial item pool for the assessment of conscientiousness personality states. © 2020 The Authors. European Journal of Personality published by John Wiley & Sons Ltd on behalf of European Association of Personality Psychology

scholarly journals FunQ: Measuring the fun experience of a learning activity with adolescents

2021 ◽  
Author(s):  
Gabriella Tisza ◽  
Panos Markopoulos
Keyword(s):  
Latent Variable ◽  
Essential Element ◽  
Psychometric Evaluation ◽  
Learning Activity ◽  
Item Pool ◽  
Validity And Reliability ◽  
Social Barriers ◽  
Systematic Effort ◽  
Initial Item ◽  
Development Approach

AbstractResearchers and practitioners in learning sciences, educational technology and child-computer interaction often argue that fun is an essential element of learning. Therefore, researchers in the above fields aim to explore how learning activities could be made more enjoyable in order to facilitate engagement in the learning process and to improve the learning outcomes. Despite such wide interest, there has been little systematic effort to define and measure fun. The herein introduced research aims to (a) define the term “fun” and (b) to create a tool for the reliable measurement of it. In the first study testing the initial item pool 75 students (μage = 11.78); in the think-aloud study testing the comprehensibility of the items six 11-year-old children and in the final validation study, 128 students (μage = 12.15) participated. We applied a deductive scale development approach. For the model testing, CFA was used and second-order latent variable models were fitted. In this paper, we conceptualize the term of fun and introduce the final 18-item version of the FunQ that consists of six dimensions (Autonomy, Challenge, Delight, Immersion, Loss of Social Barriers and Stress) and bears with the appropriate validity and reliability measures (ωoverall = 0.875 and ωpartial = 0.864; RMSEA = 0.052 and SRMR = 0.072). We contribute with (a) a review of the literature regarding the concept of fun, (b) a conception of fun as a multidimensional theoretically motivated concept, (c) a multidimensional instrument for assessing experienced fun—the FunQ—and (d) a psychometric evaluation of the proposed instrument. FunQ is put forward as a reliable and much-needed addition to the current palette of instruments.

scholarly journals Developing Mathematics Motivation Scale for the United Arab Emirates

2012 ◽  
Vol 6 (3) ◽  
pp. 1
Author(s):  
Jalal Haj Hussien ◽  
Othman Alsawaie ◽  
Abdelaziz Alsartawi ◽  
Iman Alghazo ◽  
Sana Tibi
Keyword(s):  
United Arab Emirates ◽  
Item Type ◽  
Temporal Stability ◽  
Self Determination Theory ◽  
Self Determination ◽  
Item Pool ◽  
Validity And Reliability ◽  
Initial Item ◽  
Mathematics Motivation ◽  
Motivation Scale

The objective of this study was to develop a valid and reliable mathematics motivation scale (MMS) for UAE students in grades 4 through 12 based on the self-determination theory. A total of 1,481 students (713 boys and 768 girls) from the UAE participated in this study. The process of developing the MMS involved: a) Development of an initial item pool, b) investigating the item-type of motivation membership, c) examining the appropriateness of the administration instructions and the items phrasing, d) and exploring various types of validity and reliability of the MMS. The results indicate that the MMS has acceptable levels of content validity and structure validity. The results also provided evidence that the MMS has acceptable levels of internal consistency and temporal stability. 

scholarly journals Relationship Between Patient and Informant Assessment of Personality and Cognitive Status

2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 260-260
Author(s):  
Magdalena Tolea ◽  
James Galvin
Keyword(s):  
Cognitive Impairment ◽  
Personality Traits ◽  
Caregiver Burden ◽  
Disease Onset ◽  
Cognitive Status ◽  
Cognitively Normal ◽  
Psychotherapeutic Interventions ◽  
State Measure ◽  
Personality Ratings ◽  
Neuropsychological Evaluations

Abstract Personality has been linked to risk of dementia. Most studies ask individuals to rate their own personality traits or for a knowledgeable informant to perform the rating; few collect data from both. When informants are asked to give an estimate of the patient’s lifelong personality traits, they often describe personality before disease onset. When asked to self-rate, patients may instead assess their personality as they see themselves, providing a personality-state measure. The goal of this study was to assess agreement between two independent measures of personality and evaluate whether stage of cognitive impairment and characteristics of patients or caregivers impact concordance. In 79 consecutive patient-caregiver dyads presenting to our center (mean age:76.8±8.4; 44.1% female; 6% cognitively normal, 41% MCI; and 53% dementia) with in-depth psychosocial and neuropsychological evaluations, we found informants rated patients lower on openness (O) (ICC=0.434; 95%CI: 0.235-0.598) and agreeableness (A) (ICC=0.491; 95%CI: 0.302-0.643) and higher on extraversion (O) (ICC=0.396; 95%CI: 0.191-0.568) and neuroticism (N) (ICC=0.444; 95%CI: 0.247-0.607). Greater discordance was observed in established dementia (ICCE=0.497; 95%CI: 0.222-0.700; ICCA=0.337; 95%CI:0.031-0.586; ICCN=0.422; 95%CI: 0.191-0.683), compared with MCI (ICCO=0.568; 95%CI: 0.282-0.762). We explored the effect of patient and caregiver mood and caregiver burden on personality ratings. Although personality is typically described as a trait, we present evidence that in the eyes of patients, personality ratings may represent a state that changes across the spectrum of cognitive impairment. Understanding how patients and caregivers differentially perceive personality may assist in developing novel psychotherapeutic interventions and approaches dealing with behavioral manifestations of dementia.

Initial development of the Dance Imagery Questionnaire for Children (DIQ-C): establishing content validity

2020 ◽  
Vol 15 (1) ◽  
Author(s):  
Irene Muir ◽  
Krista Munroe-Chandler
Keyword(s):  
Content Validity ◽  
Cognitive Interviews ◽  
Item Pool ◽  
Initial Development ◽  
Expert Rating ◽  
Content Relevance ◽  
Phase Study ◽  
Initial Item ◽  
Item Content ◽  
Dance Imagery

AbstractGiven the differences between young dancers’ and adult dancers’ use of imagery, a valid and reliable questionnaire specific to young dancers was necessary. The current study is the first phase of a multi-phase study in the development of the Dance Imagery Questionnaire for Children (DIQ-C). Specifically, the purpose of this study was to establish content validity of the DIQ-C. This was achieved through the following three stages: (1) definition, item, and scale development, (2) assessment of item clarity and appropriateness via cognitive interviews, and (3) assessment of item-content relevance via an expert rating panel. Guided by previous qualitative research with young dancers, 46 items representing seven subscales (i.e., imagery types) were developed. The initial item pool was then implemented during cognitive interviews with 16 dancers (15 females; Mage=10.63, SD=1.82), which led to the removal of 13 items and the modification of 21 items. Consequently, the revised 33-item pool was then administered to an expert panel of four imagery researchers and four dance instructors to measure item-content relevance. This resulted in the removal of eight items, the revision of four items, and the merging of two subscales. Overall, the current study provides content validity evidence for a 25-item pool (representing five subscales) to be used in further development of the DIQ-C (i.e., identifying and establishing factor structure).

Validity and reliability of the Self-administered-Psycho-TherApy-SystemS (SELFPASS) depression and anxiety self-assessment item pool: a cross-sectional online survey (Preprint)

2021 ◽  
Author(s):  
Gwendolyn Mayer ◽  
Svenja Hummel ◽  
Nadine Gronewold ◽  
Oetjen Neele ◽  
Thomas Hilbel ◽  
...  
Keyword(s):  
Mental Health ◽  
Psychometric Properties ◽  
Factor Structure ◽  
Healthy Subjects ◽  
Criterion Validity ◽  
Depression And Anxiety ◽  
Item Pool ◽  
Validity And Reliability ◽  
Self Assessment ◽  
Underlying Factor

BACKGROUND E-mental-health applications targeting at depression and anxiety have gained increased attention in mental health care. Daily self-assessment is an essential part of e-mental-health apps. The app SELFPASS (Self-administered-Psycho-TherApy-SystemS) is a self-management app to manage depressive and anxious symptoms. A self-developed item pool with 40 depression items and 12 anxiety items is included to provide symptom specific suggestions for interventions. However, the psychometric properties of the item pool have not yet been tested. OBJECTIVE The aim of this study is to investigate the validity and reliability of the SELFPASS item pool that has been developed for an internet-based daily self-assessment of depressive and anxious symptoms. METHODS An online link with the SELFPASS item pool and validated mood assessment scales were distributed to healthy subjects and patients who had received a diagnosis of a depressive disorder within the last year. Two scores were derived from the SELFPASS item pool: SELFPASS depression (SP-D) and SELFPASS anxiety (SP-A). The reliability was examined using Cronbach’s α. The construct validity was assessed via Pearson correlations with the Patients Health Questionnaire-9 (PHQ-9), the General Anxiety Disorder Scale-7 (GAD-7) and the WHO-5-Wellbeing-Scale (WHO-5). A logistic regression was performed as an indicator for concurrent criterion validity of SP-D and SP-A. A factor analysis provides information about the underlying factor structure of the item pool. Item-scale-correlations were calculated in order to determine item quality. RESULTS A total of n=284 participants were included, with n=192 (67.6%) healthy subjects and n=92 (32.4%) patients. Cronbach’s α was α=0.94 for SP-D and α=0.88 for SP-A. We found significant positive correlations of SP-D and PHQ-9 (r=0.87, P<.001), SP-A and GAD-7 (r=0.80, P<.001), and negative correlations of SP-D and WHO-5 (r=-0.80, P<.001) and SP A and WHO-5 (r=-.69, P<.001). Increasing scores of SP-D and SP-A led to increased odds of belonging to the patient group (SP-D: OR=1.03 (1.01 – 1.05), P<.001; SP-A: 1.05 (1.05 – 1.01), P=.01). The item pool showed two factors with one that consisted of mood-related items and another factor with somatic-related items. CONCLUSIONS The SELFPASS item pool showed good psychometric properties in terms of reliability, construct and criterion validity. However, the underlying factor structure could not be reduced to the two diagnostic categories depression and anxiety, but to a more mood related and a rather somatic factor. Few items should be replaced for future use.

scholarly journals Development and Validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP)

2013 ◽  
Vol 35 (2) ◽  
pp. 180-196 ◽  
Author(s):  
Rachel Arnold ◽  
David Fletcher ◽  
Kevin Daniels
Keyword(s):  
Concurrent Validity ◽  
Structure Study ◽  
Item Pool ◽  
Factor Analyses ◽  
Confirmatory Factor Analyses ◽  
Organizational Stressors ◽  
Confirmatory Factor ◽  
Exploratory Factor Analyses ◽  
Initial Item ◽  
Development And Validation

The series of related studies reported here describe the development and validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP). In Study 1, an expert and usability panel examined the content validity and applicability of an initial item pool. The resultant 96 items were analyzed with exploratory factor analyses in Study 2, with the factorial structure comprising 5 factors (viz., Goals and Development, Logistics and Operations, Team and Culture, Coaching, Selection) and 33 items. Using confirmatory factor analyses, Studies 3 and 4 found support for the 5-factor structure. Study 4 also provided evidence for the OSI-SP’s concurrent validity and invariance across different groups. The OSI-SP is proposed as a valid and reliable measure of the organizational stressors encountered by sport performers.

scholarly journals Measuring Students’ Perceptions of Teacher Involvement in Mathematics Homework Assignments: A Scale Development

2020 ◽  
Vol 9 (6) ◽  
pp. 102
Author(s):  
Bülent Nuri ÖZCAN
Keyword(s):  
Social Sciences ◽  
Middle School ◽  
Middle School Students ◽  
Teacher Involvement ◽  
Item Pool ◽  
Main Study ◽  
Validity And Reliability ◽  
School Students ◽  
Mathematics Homework ◽  
Academic Year

This study aimed to develop a scale to determine students&rsquo; perceptions of teacher involvement in mathematics homework assignments. An item pool (n = 30) was generated based on a literature review. Based on expert feedback, the number of items was reduced to 21 scored on a 5-point Likert-type scale. A draft named the &ldquo;Scale of Teacher Involvement in Mathematics Homework Assignments (STIMHA)&rdquo; was developed after the items were reviewed by a linguist. A pilot study was conducted with six middle school students to check for comprehensibility. The items were revised and finalized based on their feedback. The main study sample consisted of 751 middle school students from four schools in Demirci/Manisa in Turkey during the 2017-2018 academic year. Data were analyzed using the Statistical Package for Social Sciences (SPSS 24.0) and Analysis of Moment Structures (AMOS 21.0). Validity and reliability were established.

scholarly journals Construction and validation of barriers to Iranian ESP instructors’ reflective practice scale

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Milad Sheikhbanooie ◽  
Majid Farahian
Keyword(s):  
Factor Analysis ◽  
Reflective Practice ◽  
Design Methodology ◽  
English For Specific Purposes ◽  
Item Pool ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Content Type ◽  
Final Version ◽  
Efl Teachers

PurposeSince reflectivity has a crucial role in education, it has attracted researchers’ attention in the last decades. As such, the present study aimed to construct and validate a questionnaire to assess the barriers to reflective practices of Iranian ESP (English for Specific Purposes) instructors. Furthermore, this study aimed to investigate the reliability of the scale.Design/methodology/approachTo attain the purpose of the study, the researchers developed the first item pool of the questionnaire which included 67 items. Then, 4 experts were asked to pass their judgments on the items. Accordingly, 37 items were excluded and the next draft of the questionnaire that included 30 items remained. After their feedback, the revised scale was piloted with 10 ESP instructors to check the clarity of items. Then, the scale was administered to 210 ESP instructors. At the next stage, an exploratory factor analysis (EFA) was run to assess the construct validity of the questionnaire. Based on the results, three items were removed. To investigate the internal consistency of the scale, a Cronbach’s alpha coefficient was employed.FindingsThe final version of the scale included 27 items with three subscales, namely, learners, instructors and institutions’ issues. The results revealed that the questionnaire enjoyed an acceptable level of validity and reliability.Originality/valueApart from a few studies, no other study has scrutinized barriers to EFL teachers’ reflectivity. In addition, in the realm of ESP, no study has developed a scale to measure barriers to ESP teachers’ reflective practice.

Sign in / Sign up

Export Citation Format

Share Document