Ultrashort Version of the Utrecht Work Engagement Scale (UWES-3): A Psychometric Assessment

The objective was to determine the validity of the UWES-3, an ultrashort measure of work engagement lacking evidence in Hispanic populations. In total, 200 workers with heterogeneous positions and careers from Metropolitan Lima were enrolled via nonprobabilistic sampling. The UWES-3 and measures of external variables (work accidents, stress overload, and others) were used. Data were collected through a web platform. Items were analysed, nonparametric response theory methods (Mokken scale analysis and Ramsay curves) were applied to the items, and ordinal and linear regression were used to determine the relationships with external variables. The items had statistically similar distributional properties and monotonic associations with external variables but with fewer functional response options. The UWES-3 complied with the monotonic homogeneity model and invariant ordering of items; the scaling of the items, score (greater than 0.80), and reliability (0.94) were high. With the effects of age and sex controlled, the UWES-3 significantly predicted minor accidents at work and job satisfaction and revealed effects of stress overload and perceived efficacy. The theoretical implications of the UWES-3 as a brief unidimensional measure integrating the three original dimensions of the instrument and the practical implications of its use for research and professional practice are discussed.

Psychometric Properties of the Diener Satisfaction With Life Scale With Five Response Options Applied to the Colombian Population

Introduction: The Satisfaction with Life Scale (SWLS), developed by Diener, Emmons, Larsen, and Griffin in 1985, comprises five items with seven response options in terms of agreement–disagreement. Recently, there has been a suggestion to reduce the response options of the SWLS to optimize its applicability in different cultural contexts.Objective: The study aims to assess the psychometric properties of the SWLS with five response options in the Colombian population. Specifically, we studied the dimensionality, invariance by gender and age (among a group of adolescents and emerging adults under 25 years and a group of adults of intermediate age and established adulthood under 59 years), convergent validity (with optimism), and divergent (with pessimism) and concurrent validity with other measures of well-being (flourishing, positive, and negative affects).Methodology: This project was a cross-sectional study using a non-probabilistic sample of the general population. Participants were included if they identified themselves as Colombian and were at least 18 years of age. The final sample comprised 1,255 participants. The average age was 25.62 years (SD = 8.60) ranging from 18 to 67 years of age, and 35.8% of the participants were men. In addition to SWLS, we used the Flourishing Scale (FS), Life Orientation Test-Revised (LOT-R), and Scale of Positive and Negative Experience (SPANE).Results: Cronbach's alpha coefficient (0.842), composite reliability (0.851), and average variance extracted (0.537) showed very good values. CFA was conducted to test the one-dimensional structure of FS, showing excellent goodness of fit [χ(5)2 = 15.774, p < 0.001, CFI = 0.992, TLI = 0.985, RMSEA = 0.042, 90% RMSEA CI (0.020, 0.066), and SRMR = 0.016]. The correlations calculated among life satisfaction (SWLS) with flourishing (FS), positive and negative affects (SPANE), optimism, and pessimism (LOT-R) were statistically significant and as expected. Configural, metric, and scalar invariance across gender and age were confirmed. Percentiles were provided for the total score and for age.Conclusions: The SWLS with five response options has adequate psychometric properties in the Colombian population, and the use of this version (with 5 response options) is recommended due to its greater applicability.

Diagnostic Classification Model for Forced-Choice Items and Noncognitive Tests

The forced-choice (FC) item formats used for noncognitive tests typically develop a set of response options that measure different traits and instruct respondents to make judgments among these options in terms of their preference to control the response biases that are commonly observed in normative tests. Diagnostic classification models (DCMs) can provide information regarding the mastery status of test takers on latent discrete variables and are more commonly used for cognitive tests employed in educational settings than for noncognitive tests. The purpose of this study is to develop a new class of DCM for FC items under the higher-order DCM framework to meet the practical demands of simultaneously controlling for response biases and providing diagnostic classification information. By conducting a series of simulations and calibrating the model parameters with a Bayesian estimation, the study shows that, in general, the model parameters can be recovered satisfactorily with the use of long tests and large samples. More attributes improve the precision of the second-order latent trait estimation in a long test, but decrease the classification accuracy and the estimation quality of the structural parameters. When statements are allowed to load on two distinct attributes in paired comparison items, the specific-attribute condition produces better a parameter estimation than the overlap-attribute condition. Finally, an empirical analysis related to work-motivation measures is presented to demonstrate the applications and implications of the new model.

Real-Time Infectious Disease Modeling to Inform Emergency Public Health Decision Making

Infectious disease transmission is a nonlinear process with complex, sometimes unintuitive dynamics. Modeling can transform information about a disease process and its parameters into quantitative projections that help decision makers compare public health response options. However, modelers face methodologic challenges, data challenges, and communication challenges, which are exacerbated under the time constraints of a public health emergency. We review methods, applications, challenges and opportunities for real-time infectious disease modeling during public health emergencies, with examples drawn from the two deadliest pandemics in recent history: HIV/AIDS and coronavirus disease 2019 (COVID-19). Expected final online publication date for the Annual Review of Public Health, Volume 43 is April 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Use of open-text responses to recode categorical survey data on postpartum contraception use among women in the United States: A mixed-methods inquiry of Pregnancy Risk Assessment Monitoring System data

Background Postpartum contraception prevents unintended pregnancies and short interpregnancy intervals. The Pregnancy Risk Assessment Monitoring System (PRAMS) collects population-based data on postpartum contraception nonuse and reasons for not using postpartum contraception. In addition to quantitative questions, PRAMS collects open-text responses that are typically left unused by secondary quantitative analyses. However, abundant preexisting open-text data can serve as a resource for improving quantitative measurement accuracy and qualitatively uncovering unexpected responses. We used PRAMS survey questions to explore unprompted reasons for not using postpartum contraception and offer insight into the validity of categorical responses. Methods and findings We used 31,208 categorical 2012 PRAMS survey responses from postpartum women in the US to calculate original prevalences of postpartum contraception use and nonuse and reasons for contraception nonuse. A content analysis of open-text responses systematically recoded data to mitigate survey bias and ensure consistency, resulting in adjusted prevalence calculations and identification of other nonuse themes. Recoded contraception nonuse slightly differed from original reports (21.5% versus 19.4%). Both calculations showed that many respondents reporting nonuse may be at a low risk for pregnancy due to factors like tubal ligation or abstinence. Most frequent nonuse reasons were not wanting to use birth control (27.1%) and side effect concerns (25.0%). Other open-text responses showed common themes of infertility, and breastfeeding as contraception. Comparing quantitative and qualitative responses revealed contradicting information, suggesting respondent misinterpretation and confusion surrounding the term “pregnancy prevention.” Though this analysis may be limited by manual coding error and researcher biases, we avoided coding exhaustion via 1-hour coding periods and validated reliability through intercoder kappa scores. Conclusions In this study, we observed that respondents reporting contraception nonuse often described other methods of pregnancy prevention and contraception barriers that were not included in categorical response options. Open-text responses shed light on a more comprehensive list of pregnancy prevention methods and nonuse options. Our findings contribute to survey questions that can lead to more accurate depiction of postpartum contraceptive behavior. Additionally, future use of these qualitative methods may be used to improve other health behavior survey development and resulting data.

Student well-being during dedicated preparation for USMLE Step 1 and COMLEX Level 1 exams

Background Nearly all U.S. medical students engage in a 4–8 week period of intense preparation for their first-level licensure exams, termed a “dedicated preparation period” (DPP). It is widely assumed that student well-being is harmed during DPPs, but evidence is limited. This study characterized students’ physical, intellectual, emotional, and social well-being during DPPs. Methods This was a cross-sectional survey sent electronically to all second-year students at four U.S. medical schools after each school’s respective DPP for USMLE Step 1 or COMLEX Level 1 in 2019. Survey items assessed DPP characteristics, cost of resources, and perceived financial strain as predictors for 18 outcomes measured by items with Likert-type response options. Open-ended responses on DPPs’ influence underwent thematic analysis. Results A total of 314/750 (42%) students completed surveys. DPPs lasted a median of 7 weeks (IQR 6–8 weeks), and students spent 70 h/week (IQR 56–80 h/week) studying. A total of 62 (20%) reported experiencing a significant life event that impacted their ability to study during their DPPs. Most reported 2 outcomes improved: medical knowledge base (95%) and confidence in ability to care for patients (56%). Most reported 9 outcomes worsened, including overall quality of life (72%), feeling burned out (77%), and personal anxiety (81%). A total of 25% reported paying for preparation materials strained their finances. Greater perceived financial strain was associated with worsening 11 outcomes, with reported amount spent associated with worsening 2 outcomes. Themes from student descriptions of how DPPs for first-level exams influenced them included (1) opportunity for synthesis of medical knowledge, (2) exercise of endurance and self-discipline required for professional practice, (3) dissonance among exam preparation resource content, formal curriculum, and professional values, (4) isolation, deprivation, and anguish from competing for the highest possible score, and (5) effects on well-being after DPPs. Conclusions DPPs are currently experienced by many students as a period of personal and social deprivation, which may be worsened by perceived financial stress more than the amount of money they spend on preparation materials. DPPs should be considered as a target for reform as medical educators attempt to prevent student suffering and enhance their well-being.

Autism screening at 18 months of age: a comparison of the Q-CHAT-10 and M-CHAT screeners

Background Autism screening is recommended at 18- and 24-month pediatric well visits. The Modified Checklist for Autism in Toddlers—Revised (M-CHAT-R) authors recommend a follow-up interview (M-CHAT-R/F) when positive. M-CHAT-R/F may be less accurate for 18-month-olds than 24-month-olds and accuracy for identification prior to two years is not known in samples that include children screening negative. Since autism symptoms may emerge gradually, ordinally scoring items based on the full range of response options, such as in the 10-item version of the Quantitative Checklist for Autism in Toddlers (Q-CHAT-10), might better capture autism signs than the dichotomous (i.e., yes/no) items in M-CHAT-R or the pass/fail scoring of Q-CHAT-10 items. The aims of this study were to determine and compare the accuracy of the M-CHAT-R/F and the Q-CHAT-10 and to describe the accuracy of the ordinally scored Q-CHAT-10 (Q-CHAT-10-O) for predicting autism in a sample of children who were screened at 18 months. Methods This is a community pediatrics validation study with screen positive (n = 167) and age- and practice-matched screen negative children (n = 241) recruited for diagnostic evaluations completed prior to 2 years old. Clinical diagnosis of autism was based on results of in-person diagnostic autism evaluations by research reliable testers blind to screening results and using the Autism Diagnostic Observation Schedule—Second Edition (ADOS-2) Toddler Module and Mullen Scales of Early Learning (MSEL) per standard guidelines. Results While the M-CHAT-R/F had higher specificity and PPV compared to M-CHAT-R, Q-CHAT-10-O showed higher sensitivity than M-CHAT-R/F and Q-CHAT-10. Limitations Many parents declined participation and the sample is over-represented by higher educated parents. Results cannot be extended to older ages. Conclusions Limitations of the currently recommended two-stage M-CHAT-R/F at the 18-month visit include low sensitivity with minimal balancing benefit of improved PPV from the follow-up interview. Ordinal, rather than dichotomous, scoring of autism screening items appears to be beneficial at this age. The Q-CHAT-10-O with ordinal scoring shows advantages to M-CHAT-R/F with half the number of items, no requirement for a follow-up interview, and improved sensitivity. Yet, Q-CHAT-10-O sensitivity is less than M-CHAT-R (without follow-up) and specificity is less than the two-stage procedure. Such limitations are consistent with recognition that screening needs to recur beyond this age.

Interactive Narrative Simulation as a Method for Preceptor Development

(1) Background: This proof-of-concept study assessed an interactive web-based tool simulating three challenging non-academic learning situations—student professionalism, cross-cultural interactions, and student well-being—as a means of preceptor development. (2) Methods: Three scripts focused on professionalism, cross-cultural interactions, and student well-being were developed and implemented using a commercial narrative tool with branching dialog. Delivered online, this tool presented each challenge to participants. Participants had up to four response options at each turn of the conversation; the choice of response influenced the subsequent conversation, including coaching provided at the resolution of the situation. Participants were invited to complete pre-activity, immediate post-activity, and one-month follow-up questionnaires to assess satisfaction, self-efficacy, engagement, and knowledge change with the tool. Knowledge was assessed through situational judgment tests (SJTs). (3) Results: Thirty-two pharmacist preceptors participated. The frequency of participants reflecting on challenging learning situations increased significantly one-month post-simulation. Participants affirmatively responded that the tool was time-efficient, represented similar challenges they encountered in precepting, was easily navigable, and resulted in learning. Self-efficacy with skills in managing challenging learning situations increased significantly immediately post-simulation and at a one-month follow-up. Knowledge as measured through SJTs was not significantly changed. (4) Conclusions: Preceptors found an interactive narrative simulation a relevant, time-efficient approach for preceptor development for challenging non-academic learning situations. Post-simulation, preceptors more frequently reflected on challenging learning situations, implying behavior change. Self-efficacy and self-report of knowledge increased. Future research is needed regarding knowledge assessments.

Are You Willing to Self-Disclose for Science? Effects of Privacy Awareness and Trust in Privacy on Self-Disclosure of Personal and Health Data in Online Scientific Studies—An Experimental Study

Digital interactions via the internet have become the norm rather than the exception in our global society. Concerns have been raised about human-centered privacy and the often unreflected self-disclosure behavior of internet users. This study on human-centered privacy follows two major aims: first, investigate the willingness of university students (as digital natives) to disclose private data and information about their person, social and academic life, their mental health as well as their health behavior habits, when taking part as a volunteer in a scientific online survey. Second, examine to what extent the participants’ self-disclosure behavior can be modulated by experimental induction of privacy awareness (PA) or trust in privacy (TIP) or a combination of both (PA and TIP). In addition, the role of human factors such as personality traits, gender or mental health (e.g., self-reported depressive symptoms) on self-disclosure behavior was explored. Participants were randomly assigned to four experimental groups. In group A (n = 50, 7 males), privacy awareness (PA) was induced implicitly by the inclusion of privacy concern items. In group B (n = 43, 6 males), trust in privacy (TIP) was experimentally induced by buzzwords and by visual TIP primes promising safe data storage. Group C (n = 79, 12 males) received both, PA and TIP induction, while group D (n = 55, 9 males) served as control group. Participants had the choice to answer the survey items by agreeing to one of a number of possible answers including the options to refrain from self-disclosure by choosing the response options “don’t know” or “no answer.” Self-disclosure among participants was high irrespective of experimental group and irrespective of psychological domains of the information provided. The results of this study suggest that willingness of volunteers to self-disclose private data in a scientific online study cannot simply be overruled or changed by any of the chosen experimental privacy manipulations. The present results extend the previous literature on human-centered privacy and despite limitations can give important insights into self-disclosure behavior of young people and the privacy paradox.