Development and validation of a multi-lingual online questionnaire for surveying the COVID-19 prevention and control measures used in global workplaces

Background Despite widespread COVID-19 vaccination programs, there is an ongoing need for targeted disease prevention and control efforts in high-risk occupational settings. This study aimed to develop, pilot, and validate an instrument for surveying occupational COVID-19 infection prevention and control (IPC) measures available to workers in diverse geographic and occupational settings. Methods A 44-item online survey was developed in English and validated for face and content validity according to literature review, expert consultation, and pre-testing. The survey was translated and piloted with 890 workers from diverse industries in Canada, Ireland, Argentina, Poland, Nigeria, China, the US, and the UK. Odds ratios generated from univariable, and multivariable logistic regression assessed differences in ‘feeling protected at work’ according to gender, age, occupation, country of residence, professional role, and vaccination status. Exploratory factor analysis (EFA) was conducted, and internal consistency reliability verified with Cronbach’s alpha. Hypothesis testing using two-sample t-tests verified construct validity (i.e., discriminant validity, known-groups technique), and criterion validity. Results After adjustment for occupational sector, characteristics associated with feeling protected at work included being male (AOR = 1.88; 95% CI = 1.18,2.99), being over 55 (AOR = 2.17; 95% CI = 1.25,3.77) and working in a managerial position (AOR = 3.1; 95% CI = 1.99,4.83). EFA revealed nine key IPC domains relating to: environmental adjustments, testing and surveillance, education, costs incurred, restricted movements, physical distancing, masking, isolation strategies, and areas for improvement. Each domain showed sufficient internal consistency reliability (Cronbach’s alpha ≥0.60). Hypothesis testing revealed differences in survey responses by country and occupational sector, confirming construct validity (p < 0.001), criterion validity (p = 0.04), and discriminant validity (p < 0.001). Conclusions The online survey, developed in English to identify the COVID-19 protective measures used in diverse workplace settings, showed strong face validity, content validity, internal consistency, criterion validity, and construct validity. Translations in Chinese, Spanish, French, Polish, and Hindi demonstrated adaptability of the survey for use in international working environments. The multi-lingual tool can be used by decision makers in the distribution of IPC resources, and to guide occupational safety and health (OSH) recommendations for preventing COVID-19 and future infectious disease outbreaks.

Validity and reliability of resiliency measures trialled for the evaluation of a preventative Resilience-promoting social-emotional curriculum for remote Aboriginal school students

Purpose We aimed to test the reliability and validity of two brief measures of resilience adopted for the evaluation of a preventative social-emotional curriculum implemented for Aboriginal middle school students from socially disadvantaged remote communities in Australia’s Northern Territory. The questionnaires chosen were intended to measure psychological resilience and socio-cultural resilience as complementary dimensions of the capacity to cope in circumstances of significant life stress and risk of self-harm. Methods Confirmatory factor analysis (CFA) was conducted to assess construct validity of the 10-item Connor-Davidson Resilience Scale (CD-RISC-10), a measure of psychological resilience, and the 12-item Child and Youth Resilience Measure (CYRM-12), a measure of socio-cultural resilience, with a sample of 520 students. Associations between resilience and psychological distress and emotional and behavioural difficulty were analysed in relation to life stressors to assess criterion validity of the scales. Results CFA provided support for the validity of the respective constructs. There was good fit for both scales. However, assessment of criterion validity of the scales suggested that the adapted measure of socio-cultural resilience (CYRM-12NT) showed higher reliability and a clearer indication of predictive validity than the measure of psychological resilience (CD-RISC-10). Conclusions The CYRM-12NT appears to be a more useful measure of resilience among Aboriginal youth exposed to significant life stress and disadvantage. However, both measures may require further development to enhance their validity and utility among potentially at-risk adolescents in socially, culturally and linguistically diverse remote Aboriginal communities.

Criterion Validity and Applicability of Motor Screening Instruments in Children Aged 5–6 Years: A Systematic Review

The detection of motor developmental problems, especially developmental coordination disorder, at age 5–6 contributes to early interventions. Here, we summarize evidence on (1) criterion validity of screening instruments for motor developmental problems at age 5–6, and (2) their applicability. We systematically searched seven databases for studies assessing criterion validity of these screening instruments using the M-ABC as reference standard. We applied COSMIN criteria for systematic reviews of screening instruments to describe the correlation between the tests and the M-ABC. We extracted information on correlation coefficients or area under the receiver operating curve, sensitivity and specificity, and applicability in practice. We included eleven studies, assessing eight instruments: three performance-based tests (MAND, MOT 4–6, BFMT) and five questionnaires (DCD-Q, PQ, ASQ-3, MOQ-T-FI, M-ABC-2-C). The quality of seven studies was fair, one was good, and three were excellent. Seven studies reported low correlation coefficients or AUC (<0.70), four did not report these. Sensitivities ranged from 21–87% and specificities from 50–96%, with the MOT4–6 having the highest sensitivity and specificity. The DCD-Q, PQ, ASQ-3, MOQ-T-FI, and M-ABC-2-C scored highest on applicability. In conclusion, none of the instruments were sufficiently valid for motor screening at age 5–6. More research is needed on screening instruments of motor delay at age 5–6.

A validation study of data in the National Tonsil Surgery Register in Sweden: high agreement with medical records ensures that data can be used to monitor clinical practices and outcomes

Background The ambition of the National Tonsil Surgery Register in Sweden (NTSRS) is to improve otorhinolaryngological care by monitoring trends in the clinical practices, complications, and outcomes of tonsil surgery. The NTSRS collects data from both surgeons and patients and provides the participating clinics with daily updated data on a publicly available website. On the website, national and local results can be compared and monitored. The use of NTSRS data necessitates that the data is valid, but the NTSRS has not yet been validated. With approximately half of the registered patients responding to the postoperative questionnaires, an analysis of responders and non-responders is also necessary. The aim of this study was to assess the criterion validity of NTSRS data. Another aim was to compare the characteristics and rates of complications between postoperative questionnaire responders and non-responders. Methods Data in the NTSRS were compared with data in electronic medical records. The 200 most recent surgeries, up to 31 Dec 2019, in each of 11 surgical units were included. Criterion validity was analysed in terms of observed agreement, Cohens kappa, Gwet’s AC1, and positive and negative agreement. The sign test was used to analyse systematic differences between the NTSRS and the medical records. Comparisons of rates between groups were made with Fisher’s exact test, the chi-square test, and Fisher’s non-parametric permutation test. Results A total of 1991 registrations were included in the study. All variables showed very high observed agreement ranging from 0.91 to 1.00, and all variables had AC1 values corresponding to almost perfect agreement. The analysis of questionnaire responders and non-responders showed no statistically significant differences regarding age, indication, or type of surgery. The proportion of women was higher in the responder group. The rate of reoperation due to bleeding was higher in the responder group, but there were no differences regarding other complications. Conclusions The results of this study show that data in the NTSRS have criterion validity. The NTSRS is thus well suited for monitoring the clinical practices and outcomes of tonsil surgery. The quality of the data also implies that the registry can be used in both clinical improvement projects and research.

Validation of the German Five-Factor Narcissism Inventory and construction of a brief form using Ant Colony Optimization

Narcissism is a multifaceted construct commonly conceptualized as comprising grandiose and vulnerable aspects in a two-factor model. While the manifold correlates of these aspects imposed a challenge for research on the structure of narcissism, recent models converge in a three-factor structure of agentic-extraverted, antagonistic, and neurotic aspects, capturing variance in different conceptualizations and correlates of narcissism. We construct and validate a German adaptation of the Five-Factor Narcissism Inventory (FFNI; Glover et al., 2012), a measure assessing these aspects based on the Five-Factor Model. In eight samples (N = 2,921), we found the German FFNI to align with both, two- and three-factor models. The factors display good criterion validity with other narcissism measures, (non-)clinical personality dimensions, interpersonal styles, and (mal-)adaptive adjustment. Neurotic and antagonistic narcissism discriminated between individuals with/without mental disorder diagnoses, and displayed a characteristic profile in incarcerated offenders. Since the FFNI is comprehensive but long, we constructed a 30-item brief-form (FFNI-BF) optimizing the internal structure and external validity using Ant Colony Optimization. The FFNI-BF displayed good psychometric characteristics and similar, in certain aspects even advantageous criterion validity. We conclude that the German FFNI validly measures key aspects of narcissism, and the FFNI-BF captures these in a concise manner.

Psychometric Properties of the English–Spanish Vocabulary Inventory in Toddlers With and Without Early Language Delay

Purpose: Despite the increasing population of dual language learners (DLLs) in the United States, vocabulary measures for young DLLs have largely relied on instruments developed for monolinguals. The multistudy project reports on the psychometric properties of the English–Spanish Vocabulary Inventory (ESVI), which was designed to capture unique cross-language measures of lexical knowledge that are critical for assessing DLLs' vocabulary, including translation equivalents (whether the child knows the words for the same concept in each language), total vocabulary (the number of words known across both languages), and conceptual vocabulary (the number of words known that represent unique concepts in either language). Method: Three studies included 87 Spanish–English DLLs ( M age = 26.58 months, SD = 2.86 months) with and without language delay from two geographic regions. Multiple measures (e.g., caregiver report, observation, behavioral tasks, and standardized assessments) determined content validity, construct validity, social validity, and criterion validity of the ESVI. Results: Monolingual instruments used in bilingual contexts significantly undercounted lexical knowledge as measured on the ESVI. Scores on the ESVI were related to performance on other measures of communication, indicating acceptable content, construct, and criterion validity. Social validity ratings were similarly positive. ESVI scores were also associated with suspected language delay. Conclusions: These studies provide initial evidence of the adequacy of the ESVI for use in research and clinical contexts with young children learning English and Spanish (with or without a language delay). Developing tools such as the ESVI promotes culturally and linguistically responsive practices that support accurate assessment of DLLs' lexical development. Supplemental Material https://doi.org/10.23641/asha.17704391

Estimating Crime in Place: Moving Beyond Residence Location

We assess if asking victims about the places where crimes happen leads to estimates of “crime in place” with better measurement properties. We analyze data from the Barcelona Victimization Survey (2015–2020) aggregated in 73 neighborhoods using longitudinal quasi-simplex models and criterion validity to estimate the quality of four types of survey-based measures of crime. The distribution of survey-based offense location estimates, as opposed to victim residence estimates, is highly similar to police-recorded crime statistics, and there is little trade off in terms of the reliability and validity of offense location and victim residence measures. Estimates of crimes reported to the police show a better validity, but their reliability is lower and capture fewer crimes.

Reliability and Validity of the German Version of the Emotional Style Questionnaire

Until recently, emotional processes have played little role in personality psychology. Based on neuroscientific findings, Davidson and colleagues proposed a theory of emotional styles, postulating six dimensions of emotional life: outlook, resilience, social intuition, self-awareness, sensitivity to context, and attention. Recently, an English version of the Emotional Style Questionnaire (ESQ) was developed and tested for reliability and validity. The aim of the present work was to test the test–retest reliability, internal consistency, construct validity, and criterion validity of the German version of the ESQ. Two separate samples consisting of 365 and 344 subjects took part in an online survey. The results of the two studies indicated satisfactory test–retest reliability and internal consistency. Regarding the construct validity, the results from Study 1 to Study 2 indicate good model fit indices. Although there was a high correlation between the subscales outlook and resilience, the analyses supported the six-factor structure postulated by Davidson and colleagues. Substantial correlations were found between the dimensions of the ESQ and other validated scales, confirming the criterion validity of the questionnaire. Our results suggest that the German version of the ESQ is a reliable and valid measurement of emotional styles. It is a feasible and economical questionnaire that can be applied in various psychology disciplines, such as personality psychology, clinical psychology, industrial psychology or sport and exercise psychology.

Development of the UNC Perceived Message Effectiveness Scale for Youth

PurposeTobacco prevention media campaigns are an important tool to address youth tobacco use. We developed a theory-based perceived message effectiveness (PME) Scale to use when vetting messages for campaigns.MethodsParticipants were a national sample of N=623 US adolescents (ages 13–17 years) recruited from a national probability-based panel. In an online experiment, we randomised adolescents to view tobacco prevention ads. All participants viewed an ad on smoking or vaping from the US Food and Drug Administration’s The Real Cost campaign and a control video, in a random order. After ad exposure, we assessed PME using nine candidate items and constructs for convergent and criterion validity analyses. We used confirmatory factor analysis and examined information curves to select the scale items.ResultsA brief PME scale with three items (α=0.95) worked equally well for demographically diverse adolescents with different patterns of tobacco use. The Real Cost ads generated higher PME scores than the control videos for both vaping and smoking (convergent validity; p<0.05). Higher PME scores were associated with greater attention, fear, cognitive elaboration and anticipated social interactions (convergent validity; r=0.31–0.66), as well as more negative attitudes toward and lower susceptibility to vaping and smoking (criterion validity; r=−0.14 to −0.37). A single-item PME measure performed similarly to the three-item version.ConclusionsThe University of North Carolina PME Scale for Youth is a reliable and valid measure of the potential effectiveness of vaping and smoking prevention ads. Employing PME scales during message development and selection may help youth tobacco prevention campaigns deploy more effective ads.

Assessment of systemic joint laxity in the clinical context: Relevance and replicability of the Beighton score in chronic fatigue

BACKGROUND: Persistent symptoms in patients with systemic joint laxity (SJL) are often equivalent with complications. Screening for SJL is an important part of the assessment of musculoskeletal phenotype. The common measuring tool, the Beighton score (BS), still has unclear evidence. OBJECTIVE: To assess the Beighton score in a clinical context for (1) ability to classify SJL as absent or present (criterion validity), and (2) interrater reliability (physician-physiotherapist), for a dichotomous cut-off (yes/no), as well as for interpretation in categories (no, some, clear SJL). METHODS: This real-world observational study included 149 consecutive patients seeking secondary care for investigation of possible myalgic encephalomyelitis/chronic fatigue syndrome. Assessment was done during a routine examination. Data were evaluated with Cohen’s kappa and Spearman’s rho. RESULTS: BS criterion validity showed poor agreement with the assessment of SJL: percentage agreement was 74 % and kappa 0.39 (3-cut level), 73 % and kappa 0.39/0.45 (4-/5-cut level). The best interrater reliability was moderate (rho 0.66) for interpretation in categories. CONCLUSIONS: The BS alone was not a reliable proxy for SJL and should be supplemented with a targeted history. Nevertheless, its interrater reliability was acceptable, and the categorised score appears to have greater clinical relevance than the dichotomous score.