Test-retest reliability of the HEXACO-100—And the value of multiple measurements for assessing reliability

Despite the widespread use of the HEXACO model as a descriptive taxonomy of personality traits, there remains limited information on the test-retest reliability of its commonly-used inventories. Studies typically report internal consistency estimates, such as alpha or omega, but there are good reasons to believe that these do not accurately assess reliability. We report 13-day test-retest correlations of the 100- and 60-item English HEXACO Personality Inventory-Revised (HEXACO-100 and HEXACO-60) domains, facets, and items. In order to test the validity of test-retest reliability, we then compare these estimates to correlations between self- and informant-reports (i.e., cross-rater agreement), a widely-used validity criterion. Median estimates of test-retest reliability were .88, .81, and .65 (N = 416) for domains, facets, and items, respectively. Facets’ and items’ test-retest reliabilities were highly correlated with their cross-rater agreement estimates, whereas internal consistencies were not. Overall, the HEXACO Personality Inventory-Revised demonstrates test-retest reliability similar to other contemporary measures. We recommend that short-term retest reliability should be routinely calculated to assess reliability.

Application of Infrared Thermography in an Adequate Reusability Analysis of Photovoltaic Modules Affected by Hail

Infrared thermography, in the analysis of photovoltaic (PV) power plants, is a mature technical discipline. In the event of a hailstorm that leaves the PV system without the support of the power grid (and a significant portion of the generation potential), thermography is the easiest way to determine the condition of the modules and revive the existing system with the available resources. This paper presents research conducted on a 30 kW part of a 420 kW PV power plant, and demonstrates the procedure for inspecting visually correct modules that have suffered from a major natural disaster. The severity of the disaster is shown by the fact that only 14% of the PV modules at the test site remained intact. Following the recommendations of the standard IEC TS 62446-3, a thermographic analysis was performed. The thermographic analysis was preceded by an analysis of the I-V curve, which was presented in detail using two characteristic modules as examples. I-V curve measurements are necessary to relate the measured values of the radiation and the measured contact temperature of the module to the thermal patterns. The analysis concluded that soiled modules must be cleaned, regardless of the degree of soiling. The test results clearly indicated defective module elements that would result in a safety violation if reused. The research shows that the validity criterion defined on the basis of the analysis of the reference module can be supplemented, but can also be replaced by a statistical analysis of several modules. The comparison between the thermographic analysis and the visual inspection clearly confirmed thermography as a complementary method for testing PV-s.

Quality and Validity of Diet Quality Indices for Use in Australian Contexts: A Systematic Review

Diet quality indices (DQIs) are tools used to evaluate the overall diet quality against dietary guidelines or known healthy dietary patterns. This review aimed to evaluate DQIs and their validation processes to facilitate decision-making in the selection of appropriate DQIs for use in Australian contexts. A search of CINAHL, PubMed and Scopus electronic databases was conducted for studies published between January 2010 – May 2020, which validated a DQI, measuring >1 dimension of diet quality (adequacy, balance, moderation, variety) and was applicable to the Australian context. Data on constructs, scoring, weighting and validation methods (construct validity, criterion validity, reliability and reproducibility) were extracted and summarised. The quality of the validation process was evaluated using COSMIN Risk of Bias and Joanna Briggs Appraisal checklists. The review identified 27 indices measuring adherence to: national dietary guidelines (n=13), Mediterranean diet (n=8), and specific population recommendations and chronic disease risk (n=6). Extensiveness of the validation process varied widely across and within categories. Construct validity was the most strongly assessed measurement property, while evaluation of measurement error was frequently inadequate. DQIs should capture multiple dimensions of diet quality, possess a reliable scoring system, and demonstrate adequate evidence in their validation framework to support use in the intended context. Researchers need to understand the limitations of newly developed DQIs and interpret results in view of the validation evidence. Future research on DQIs is indicated to improve evaluation of measurement error, reproducibility and reliability.

Reliability and Validity of the Chinese Nine-Item Basic Psychological Need Satisfaction Scale Based on Self-Determination Theory With Older Adults

Background: Self-determination theory distinguishes three basic human psychological needs: competence, relatedness, and autonomy. The measurement of these needs in populations of older adults has been limited and inadequate. Yet, results from such an assessment are likely to be valuable in policymaking, specifically toward the goal of healthy aging.Aim: The objective of this study was to test the reliability and validity of the Chinese version of the Basic Psychological Need Satisfaction Scale (BPNS) based on self-determination theory with older adults.Methods: A total of 809 older adults were invited to participate in this study. We examined the item analysis, internal reliability, factorial validity, criterion validity, and measurement invariance across sex of a Chinese translation of the BPNS.Results: The findings demonstrated that the scale had a good factorial validity, criterion validity, and satisfactory internal reliability. All the items were qualified according to item analysis (p < 0.001). The Cronbach’s α coefficient for the total scale was 0.877. The coefficients of three subscales were 0.826 (autonomy), 0.807 (competence), and 0.847 (relatedness). Exploratory factor analysis indicated three factors that explained 75.12% of the total variance. Confirmatory factor analysis showed measurement fit exceeded the recommended criteria in all the cases. Measurement invariance analysis manifested that the factor loadings, factor variances and covariances, and residuals to measurement structure were invariant across the male and female participants.Conclusion: The Chinese version of the BPNS based on self-determination theory was proven to be reliable and valid. The usability of the scale to assess the satisfaction of the basic psychological needs of older adults in China was demonstrated.

Diagnostic Performances of an Occupational Burnout Detection Method Designed for Healthcare Professionals

Background: We aimed to assess the validity (criterion and cross-cultural validity) and reliability of the first occupational burnout (OB) detection tool designed for healthcare professionals in Belgium in the context of Swiss medical practice. Methods: First, we assessed the sensitivity and specificity of the Tool. We developed this tool based on the consultation reports of 42 patients and compared its detection to the results of the Oldenburg Burnout Inventory (OLBI), filled-in by patients before a consultation. Second, we performed an inter-rater reliability (IRR) assessment on the OB symptoms and detection reached by the Tool between a psychiatrist, two psychologists, and an occupational physician. Results: The Tool correctly identified over 80% of patients with OB, regardless of the cutoff value used for OLBI scores, reflecting its high sensitivity. Conversely, its specificity strongly varied depending on the OLBI cutoff. There was a slight to fair overall agreement between the four raters on the detection of OB and the number of OB symptoms. Around 41% of symptoms showed a substantial to an almost perfect agreement, and 36% showed a slight to a moderate agreement. Conclusions: The Tool seems useful for identifying OB of moderate and strong severity in both the Belgian and Swiss contexts.

The Development and Testing of the MISSCARE Survey OR

BackgroundAn acceptable, reliable, and valid survey instrument to measure missed nursing care in perioperative settings has not been developed.PurposeTo develop and conduct psychometric testing of the MISSCARE Survey OR.MethodsData were collected nationwide from 1,693 operating room (OR) nurses who completed the MISSCARE Survey OR. The survey contained two sections: Part A, “Elements of perioperative nursing care” (32 questions) and Part B, “Reasons for missing nursing care” (17 questions).ResultsThe MISSCARE Survey OR demonstrated acceptability, as few respondents missed questions in Part A (0.1%–1.1%) and Part B (0.8%–1.3%). Exploratory factor analysis revealed five subscales in Part A (Legal, Preparation, Safety, Communication, and Closing) and four in Part B (Urgency, Staffing, Materials, and Teamwork). In Part A, the five-factor solution explained 44% of the variance. In Part B, the four-factor solution explained 53% of the variance. Alpha coefficients for subscales in Part A ranged from 0.71 to 0.84 and 0.74 to 0.90 for Part B. Validity was measured using content validity, criterion validity, and construct validity. A panel of OR nurse experts established content validity. Criterion validity compared hospitals with fewer than six ORs to hospitals with hospitals with more than six ORs where it was hypothesized aprior that nurses in hospitals with fewer ORs would have missed less care (X = −.123, standard error [SE] = .041, p = .003). Construct validity was tested through exploratory and confirmatory factor analyses (CFA). Correlation coefficients for Part A ranged from 0.34 to 0.73 and 0.60 to 0.73 for Part B. Overall model fit was acceptable: goodness-of-fit index (GFI) and CFA were greater than 0.90, standardized root mean square residual (SMRM) was less than 0.06, and root mean square error of approximation (RMSEA) less than 0.08.ConclusionThe MISSCARE Survey OR promises to be a reliable, valid indicator of the extent of and reasons for missed nursing care.

Daily Tackling Heath Inequalities: French Child Individual-Level Deprivation Index Development and Validation

The purpose of this study was to develop and validate a pediatric individual-level index for deprivation, usable in clinical practice and in public health. The index had a 4 phases development: items generation with literature review and experts interviews, items reduction with steering committee consensus, index derivation with multivariate analysis, and index validation with psychometric and Pearson analysis. French Child Individual-Level Deprivation Index (FrenChILD-Index) was addressed by untrained healthcare professionals in a cross-sectional multicentric study. The deprivation burden was blindly evaluated in every domain of lifestyle by an expert. Children in need of one specific type of healthcare for deprived children were: moderately deprived. Children in need of referral to a socio-medical unit for access to healthcare were: severely deprived. The main outcome measure was the agreement between FrenChILD-Index results and expert evaluation.Development phases produced a 12-item instrument. Validation phases were carried out in a 986 children sample. FrenChILD-Index fulfilled the Terwee validity criterion for screening instruments. For moderate deprivation, sensitivity was 96.0% [92.6; 98.7] and specificity 68.3% [65.2; 71.4]. For severe deprivation, sensitivity was 96.3% [92.7; 100] and specificity 91.1% [89.2; 92.9]. It correlated with the number of lifestyle deprived domains 0.80 [0.77; 0.83] and the amount of specific healthcare for children 0.86 [0.83; 0.88].Conclusions: FrenChILD-Index is the first pediatric individual-level index of deprivation, methodologically validated in Europe. FrenChILD-Index enables individual appropriate referral for deprived children. It enables considering social determinants of health into account in epidemiological adjustment, patient sample stratification and program impact measurement. (NCT03640715, 21/08/2018)

The comprehensive inventory of thriving: a systematic review of published validation studies and a replication study

In this study we sought to collect evidence regarding the validity of the Comprehensive Inventory of Thriving (CIT), systematically reviewing studies that tested its psychometric properties (Study 1) and trying to replicate validity evidence collected across previous validation studies (Study 2). We found five studies that tested the validity of CIT scores through the collection of different kinds of evidence (score structure validity, convergent validity, discriminant validity, criterion-related validity, incremental validity, internal consistency, test-retest reliability). Results were often inconsistent across studies (especially for the score structure validity evidence). Using a sample of 483 Italian participants (63.0% female; aged 18–71 years), we replicated the tests performed in the previous validation studies. Findings suggest that the best fitting model is the one that (1) adds the overarching latent construct of thriving, which can be measured using the total scale score; and (2) merges the Skills and Flow factors in just one factor, named “Skills for Flow”. At the same time, the different kinds of validity evidence collected both in previous validation studies and in the current replication study indicate high overlap among thriving sub-dimensions and poor validity evidence. We concluded that the CIT in its present form is not an adequate instrument to assess thriving, thus mono-dimensional scales (e.g. Brief Inventory of Thriving) should be currently preferred. Suggestions to develop a multi-dimensional scale measuring thriving (both using a theory-driven approach or a data-drive approach) are discussed.

Validity and Reliability of the Korean Version of the Fear of COVID-19 Scale

Background: The present study aimed to translate the Fear of COVID-19 Scale (FCV-19S) into the Korean language and test the validity and reliability of the translated Korean version. Methods: An online questionnaire survey was conducted with 300 adults (aged ≥19 years) living in South Korea. The data collection period was 1 June to 15 October 2020. The Korean version of the FCV-19S (KFCV-19S) was tested in terms of content validity, construct validity, criterion validity, item response theory, and reliability. Results: When the content and construct validity of the FCV-19S was tested, the results showed that all items could be retained in the Korean version. When the criterion validity was tested based on correlation analysis between the KFCV-19S and the State-Trait Anxiety Inventory, the results showed a positive correlation (r = 0.53, p < 0.001). Item suitability test results showed that all items were within the reference value of 0.5–1.5. Internal consistency reliability test results showed a Cronbach’s alpha of 0.81. Conclusion: The applicability of the KFCV-19S for identifying the level of fear Korean people experience regarding COVID-19 was verified. This tool is recommended for use in future assessments of Korean populations regarding levels of fear and anxiety regarding COVID-19.