FIN-TIERA: A Tool for Assessing Technology Induced Errors

SummaryBackground: Due to the complexity of healthcare processes, the potential for Health Information Systems (HIS) to cause technology-induced errors is a growing concern. Health Information Technology (HIT) errors nearly always threaten good patient care and can lead to patient harm. Instruments to allow hospitals to proactively identify areas of Electronic Health Records (EHR) safety, to set priorities and to intervene before incidents occur are currently underdeveloped.Objectives: The aim was to design a Finnish questionnaire to measure EHR users’ perceptions of common EHR-related safety concerns in a specialized hospital district context through the lens of the theory of socio-technical dimensions. Moreover, the aim was to measure its reliability by assessing its internal consistency and validity, namely its content and construct validity.Methods: We constructed the instrument, based on the socio-technical theory and Sittig and Singh’s study findings, through a multi-stage process, and expert panels evaluated it to ensure its content validity. The final questionnaire consisted of eight error types to be assessed on a qualitative risk matrix scale. We used a cross-sectional design to test its psychometric properties. Application of the FIN-TIERA Questionnaire to a sample of 2864 clinicians in 2015 then served to evaluate the instrument’s reliability as well as its construct validity.Results: All eight multi-item scales showed high internal consistency (range α > 0.798-0.932 and CR 0.845-0.983). The average variance extracted (AVE) served to assess the confirmatory factor analysis (CFA). The results of the model fit with AGFI = .86, CFI = .898, RMSEA = .052, SRMR = .048 were deemed acceptable. For all factors, AVE yielded values > 0.5, which indicates adequate convergence and supports convergent validity. Discriminant validity was established for five out of a total of eight latent variables.Conclusions: FIN-TIERA is a new multi-dimensional instrument which may be a useful tool for assessing risk in EHR. Our testing shows its potential for use in-hospital settings: the involvement of EHR users demonstrated initial reliability and validity. Further research is recommended to assess the instrument’s psychometric properties.

Download Full-text

Psychometric properties of the Georgian version of the Safety Attitudes Questionnaire: a cross-sectional study

BMJ Open ◽

10.1136/bmjopen-2019-034863 ◽

2020 ◽

Vol 10 (2) ◽

pp. e034863

Author(s):

Nikoloz Gambashidze ◽

Antje Hammer ◽

Nicole Ernstmann ◽

Tanja Manser

Keyword(s):

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Discriminant Validity ◽

Factor Model ◽

Model Fit ◽

Short Version ◽

Cross Sectional ◽

Safety Attitudes ◽

Safety Attitudes Questionnaire

ObjectiveTo study the psychometric properties of the Georgian version of the Safety Attitudes Questionnaire short version.DesignCross-sectional study.SettingThree Georgian hospitals.ParticipantsPersonnel of participating hospitals (n=305 responses, estimated response rate 30%).InterventionsNone.Primary and secondary outcome measuresPsychometric properties (model fit, internal consistency, construct validity, convergent and discriminant validity) of the instrument, factor structure derived from the data.ResultsThe Georgian version of Safety Attitudes Questionnaire demonstrated acceptable construct validity and internal consistency (Cronbach’s alpha 0.61–0.91). Three factors, Teamwork Climate, Safety Climate and Working Conditions, had limited convergent and discriminant validity. Confirmatory factor analysis with the original six-factor model resulted in limited model fit (χ2/df=2.14, root mean square error of approximation (RMSEA)=0.06, goodness of fit index (GFI)=0.83, CFI=0.88, TLI=0.86). Exploratory factor analysis resulted in a modified four-factor model with satisfactory model fit (χ2/df=2.09, RMSEA=0.06, GFI=0.88, CFI=0.93, TLI=0.91).ConclusionsThe Georgian version of the Safety Attitudes Questionnaire (short version) demonstrated acceptable psychometric properties, with acceptable to good internal consistency and construct validity. While the whole model had limited fit to the data, a modified factor model resulted in good model fit. Our findings suggest the dimension Working Conditions has questionable psychometric properties and should be interpreted with caution. Other two correlated dimensions Teamwork Climate and Safety Climate share considerable variance and may be merged. Overall, the instrument can provide valuable information relevant for advancement of patient safety culture in Georgian hospitals.

Download Full-text

DARBUOTOJŲ PSICHOLOGINIS ĮGALINIMAS: LIETUVIŠKOJO TYRIMO METODO PSICHOMETRINĖS CHARAKTERISTIKOS

Psichologija ◽

10.15388/psichol.2013.47.1406 ◽

2013 ◽

Vol 47 ◽

pp. 44-60

Author(s):

M. Tvarijonavičius ◽

D. Bagdžiūnienė

Keyword(s):

Intrinsic Motivation ◽

Psychometric Properties ◽

Convergent Validity ◽

Discriminant Validity ◽

Psychological Empowerment ◽

Reliability And Validity ◽

Future Research ◽

Internal Reliability ◽

Five Dimensions ◽

Motivation Scale

Straipsnyje analizuojama darbuotojų psichologinio įgalinimo problema, pristatomas lietuviškas psichologinio įgalinimo vertinimo klausimynas ir jo psichometrinės charakteristikos. Metodas parengtas dviem etapais, naudojant empirinę skalių konstravimo strategiją. Pirmajame etape, taikant grupinio interviu ir ekspertinio vertinimo metodus, parengti psichologinio įgalinimo vertinimo teiginiai. Antrajame etape atliktas empirinis tyrimas (dalyvavo 189 tiriamieji, reprezentuojantys 8 Lietuvos organizacijas). Remiantis jo rezultatais parengtas lietuviškas psichologinio įgalinimo vertinimo klausimynas. Tiriamosios faktorių analizės metodu išskirti penki faktoriai: prasmė, entuziazmas, sprendimų priėmimas, autonomija ir pasitikėjimas kompetencija. Klausimynas pasižymi dideliu vidiniu patikimumu (bendras Cronbacho α = 0,909, atskirų subskalių nuo 0,755 iki 0,880), dideliu konvergentiniu ir diskriminantiniu konstrukto validumu tiek viso klausimyno, tiek atskirų penkių skalių lygmeniu.Pagrindiniai žodžiai: psichologinis įgalinimas, psichologinio įgalinimo klausimynas, patikimumas, validumas.EMPLOYEE PSYCHOLOGICAL EMPOWERMENT: PSYCHOMETRIC PROPERTIES OF THE LITHUANIAN QUESTIONNAIREMantas Tvarijonavičius, Dalia Bagdžiūnienė SummaryEmployee psychological empowerment is treated as a multidimensional construct manifesting in several dimensions. It has been researched for several decades using various scales depending on the definition of psychological empowerment chosen by a reasercher. However, there is a lack of widely applicable, compact instruments for a reliable and valid assessment of psychological empowerment. Furthermore, there has been a lack of empowerment research in Lithuania. Therefore, the purpose of this study is to construct a Lithuanian psychological empowerment questionnaire and to evaluate its psychometric properties (reliability and validity).The strategy of the empirical construction of a questionnaire was used. At first, statements to describe the concept of psychological empowerment were generated, using group interviews and expert evaluation. Fifteen final items were included into the Lithuanian Psychological Empowerment Questionnaire (LPEQ). Then, an empirical research was performed: 189 respondents from 8 organizations filled up the LPEQ, G.M. Spreizer (1995) Psychological Empowerment Questionnaire (PEQ), B. E. Ashforth (1990) Helplessness Scale, Intrinsic Motivation Scale (Warr et al., 1979), and socio-demografic questions.The results of the study have revealed that the LPEQ has a high internal reliability (Cronbach α = 0.909). Five factors were extracted using the exploratoryfactor analysis, three items each. Psychological empowerment was defined based on five dimensions: meaning, enthusiasm, decision making, authonomy, and trust in competence. The Cronbach α was between 0.755 and 0.880 for the dimension level. These five dimensions show support for the existing models of psychological empowerment (Spreitzer, 1995; Menon, 2001), but also they supplement these models with for instance, the dimension of enthusiasm.The convergent validity of the LPEQ was confirmed by strong correlations (p < 0.01) between the LPEQ and the PEQ subscales, and the Intrinsic Motivation Scale. It was supported by a negative correlation between the LPEQ subscales and the Helplessness Scale. Based on the analysis of correlations, the discriminant validity of the LPEQ dimensions’ levels was confirmed.In conclusion, the Lithuanian Psychological Empowerment Questionnaire (LPEQ) can be characterized as an instrument with appropriate psychometricproperties for the use in research and practice. Directions for the future research in the field have been offered.Key words: psychological empowerment, psychological empowerment questionnaire, reliability, validity.

Download Full-text

Cyberbullying among Adolescents: Psychometric Properties of the CYB-AGS Cyber-Aggressor Scale

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph17093090 ◽

2020 ◽

Vol 17 (9) ◽

pp. 3090 ◽

Cited By ~ 2

Author(s):

Sofia Buelga ◽

Javier Postigo ◽

Belén Martínez-Ferrer ◽

María-Jesús Cava ◽

Jessica Ortega-Barón

Keyword(s):

Factor Analysis ◽

Psychometric Properties ◽

Convergent Validity ◽

Reliability And Validity ◽

Anger Expression ◽

Cross Sectional Study ◽

Cross Sectional ◽

Cyber Aggression ◽

Institutional Authority ◽

Positive Correlations

The present study aims to analyze the psychometric properties of the revised version of the Adolescent Cyber-Aggressor scale (CYB-AGS). This scale is composed of 18 items that measure direct and indirect cyberbullying. A cross-sectional study was conducted using two independent samples of adolescents. The first sample included 1318 adolescents (52.6% girls) from 12 to 16 years old (M = 13.89, SD = 1.32). The second sample included 1188 adolescents (48.5% boys) from 12 to 16 years old (M = 14.19, SD = 1.80). First, to study the psychometric properties of the CYB-AGS, exploratory factor analysis was performed on Sample 1. Results indicated a two-factor structure: direct cyber-aggression and indirect cyber-aggression. Second, to verify the structure of the CYB-AGS, we selected Sample 2 to conduct confirmatory factor analysis and test the scale’s convergent validity with theoretically-related measures. Results confirmed the reliability and validity of the two-dimensional model. Moreover, measurement invariance was established. Finally, regarding convergent validity, positive correlations were obtained between cyberbullying and aggressive behaviors in school, anger expression, negative attitudes towards school, and transgression of norms. Furthermore, negative correlations were found between cyberbullying and attitudes towards institutional authority.

Download Full-text

Development and Evaluation of a Swedish Short Version of the Questionnaire About the Process of Recovery (QPR)

Community Mental Health Journal ◽

10.1007/s10597-019-00494-6 ◽

2019 ◽

Vol 56 (2) ◽

pp. 376-382

Author(s):

Eklund Mona ◽

Neil Sandra ◽

Argentzell Elisabeth

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Convergent Validity ◽

Discriminant Validity ◽

Psychiatric Symptoms ◽

Internal Consistency Reliability ◽

Short Version ◽

Level Of Functioning ◽

Ceiling Effects ◽

Good Internal Consistency

Abstract The aim was to develop a short version of the Swedish Process of Recovery Questionnaire (QPR-Swe) for use with people with severe mental illness and to investigate its internal consistency, construct validity, known-groups validity and any floor or ceiling effects. Two independent samples were used, the first (N = 226) to develop the short version and the second (N = 266) to test its psychometric properties. A seven-item version was developed by selecting items based on item-total correlations. The QPR-Swe-7 showed good internal consistency reliability (α = 0.82). It showed moderate correlations with indicators of convergent validity (self-rated health, self-mastery and quality of life) and weak with those selected to test discriminant validity (psychiatric symptoms and level of functioning). QPR-Swe-7 differentiated between people receiving two different levels of housing support. No floor or ceiling effects were found. The QPR-Swe-7 had appropriate psychometric properties for use with people with a variety of mental disorders when a brief scale is warranted.

Download Full-text

Psychometric Properties of the Multi-Affect Indicator in a Chinese Worker Sample

Psychological Reports ◽

10.1177/0033294116676464 ◽

2016 ◽

Vol 120 (1) ◽

pp. 179-188 ◽

Cited By ~ 2

Author(s):

Hui Li ◽

Yue Zhang ◽

Feng Li

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Convergent Validity ◽

Discriminant Validity ◽

Full Time ◽

Chinese Sample ◽

High Internal Consistency ◽

Four Quadrant ◽

Affect At Work ◽

Composite Reliability

The Multi-Affect Indicator is a new measure that assesses the core affect at work with 16 items. The current study examined the scale’s psychometric properties in terms of internal consistency and composite reliability, factorial validity, convergent validity, and discriminant validity with a Chinese sample of 370 full-time workers. The results demonstrated that Multi-Affect Indicator has high internal consistency and composite reliability and a correlated four-quadrant structure. Furthermore, three of its four subscales show adequate convergent validity. Thus, the Chinese version of the Multi-Affect Indicator behaves consistently with the original and can be used in future studies of core workplace affect in Chinese context.

Download Full-text

Dynamics of Health Technology Diffusion in Integrated Care System (DHTDICS): A Development and Validation Study

10.21203/rs.2.24573/v1 ◽

2020 ◽

Author(s):

Qingwen Deng ◽

Wenbin Liu

Keyword(s):

Integrated Care ◽

Internal Consistency ◽

Technology Diffusion ◽

Convergent Validity ◽

Discriminant Validity ◽

Health Technology ◽

Healthcare Outcomes ◽

Cross Sectional ◽

Valid Instrument ◽

Care System

Abstract Background Limited diffusion and utilization of health technology has greatly halted the improvement of resource integration and healthcare outcomes. However, the dynamic mechanism of health technology diffusion in the context of integrated care system (ICS) remained largely unknown. The purpose of this study was to develop and validate the scale on Dynamics of Health Technology Diffusion in Integrated Care System (DHTDICS) for providing instruments to investigate the health technology diffusion in ICS.Methods The scale was initially designed on the basis of the proposed model developed from previous research. And it was validated in a cross-sectional questionnaire survey. Exploratory factor analysis was used to assess domains in the questionnaire, and analyzed factorials, internal consistency and validity of the questionnaire. Results Reliability analysis revealed excellent internal consistency, as the value of Cronbach’s alpha all greater than 0.80 for four of the domains in this study. An acceptable validity was confirmed through tests of construct validity, convergent validity and discriminant validity. With respect to the potential domains and dimensions that DHTDICS contributes, the results highlight the existence of 4 domains: personal beliefs, technical drivers, organizational readiness and external environment.Conclusions The findings of this study will be capable to serve as a valid instrument to measure health technology diffusion, and be also helpful in developing future intervention strategies to promote the health technology diffusion in ICS.

Download Full-text

Psychometric Properties of the Stress Control Mindset Measure in University Students from Australia and the UK

10.31234/osf.io/8x5zu ◽

2019 ◽

Cited By ~ 1

Author(s):

Jacob J Keech ◽

Sheina Orbell ◽

Martin S Hagger ◽

Frances O'Callaghan ◽

Kyra Hamilton

Keyword(s):

Psychometric Properties ◽

Convergent Validity ◽

Discriminant Validity ◽

Performance Outcomes ◽

Future Research ◽

Cross Sectional Survey ◽

Cross Sectional ◽

Stress Control ◽

Health And Wellbeing ◽

And Performance

Introduction: Beliefs about the consequences of stress, stress mindsets, are associated with health and performance outcomes under stress. This article reports the development and examination of the psychometric properties of a measure of stress mindset: The Stress Control Mindset Measure (SCMM). The measure is consistent with theory on mindsets about self-attributes and conceptualizes stress mindset as the extent to which individuals endorse beliefs that stress can be enhancing. Methods: The study adopted a correlational cross-sectional survey design in two student samples. Undergraduate students from an Australian university (Sample 1, N = 218) and a UK university (Sample 2, N = 214) completed the SCMM and measures of health and wellbeing outcomes. Results: Confirmatory factor analyses supported a four-factor structure and strict measurement invariance across samples (ΔCFI < .01). Reliability, convergent validity, discriminant validity, and concurrent validity of the overall SCMM was supported in both samples. Incremental validity was supported for most outcomes, accounting for significantly more variance (between 2.2% and 5.9%) in health and wellbeing outcomes than an existing measure. Conclusions: Current data provide preliminary support for the SCMM as a reliable and valid measure with good psychometric properties and theoretically consistent relations with health outcomes under stress. Findings provide initial evidence supporting the potential utility of the SCMM in future research examining relations between stress mindsets and health and performance outcomes.

Download Full-text

The Italian Validation of the Level of Exposure-Dental Experiences Questionnaire

Applied Sciences ◽

10.3390/app10031143 ◽

2020 ◽

Vol 10 (3) ◽

pp. 1143 ◽

Cited By ~ 1

Author(s):

Cristiano Scandurra ◽

Roberta Gasparro ◽

Pasquale Dolce ◽

Vincenzo Bochicchio ◽

Benedetta Muzii ◽

...

Keyword(s):

Convergent Validity ◽

Discriminant Validity ◽

Dental Treatment ◽

Factor Model ◽

Dental Anxiety ◽

Reliability And Validity ◽

Cross Sectional Study ◽

Cross Sectional ◽

Dental Patients ◽

Italian Sample

The aim of this monocentric cross-sectional study was to evaluate the psychometric characteristics of the Italian version of the Level of Exposure-Dental Experiences Questionnaire (LOE-DEQ) in an Italian sample of 253 dental patients ranging from 18–80 years of age. The LOE-DEQ assesses 16 potential dental distressing experiences and 7 general traumatic life events through 4 subscales: (1) dentists’ behaviour and patients’ emotions (DBPE); (2) distressing dental procedures (DDP); (3) other distressing dental events (ODDE); and (4) general traumatic events (GTE). Confirmatory factor analysis showed that the original 4-factor model had adequate fit to the data obtained from the Italian sample. Criterion validity was partially confirmed as only DBPE and DDP positively correlated with dental anxiety. Similarly, convergent validity was also partially confirmed as DBPE, DDP, and ODDE correlated with negative beliefs towards the dentist and the dental treatment. Discriminant validity was fully confirmed, as all correlations were below 0.60. Finally, DDP was the factor most associated with high dental anxiety. This study offers evidence of the reliability and validity of the LOE-DEQ in the Italian context, providing Italian researchers and dentists with a tool to assess dental and general distressing experiences in dental patients.

Download Full-text

Measuring internal communication satisfaction: validating the internal communication satisfaction questionnaire

Corporate Communications An International Journal ◽

10.1108/ccij-01-2021-0006 ◽

2021 ◽

Vol ahead-of-print (ahead-of-print) ◽

Author(s):

Ana Tkalac Verčič ◽

Dubravka Sinčić Ćorić ◽

Nina Pološki Vokić

Keyword(s):

Construct Validity ◽

Psychometric Properties ◽

Discriminant Validity ◽

Factor Model ◽

Internal Communication ◽

Communication Satisfaction ◽

Cross Sectional ◽

Satisfaction Questionnaire ◽

Content Type ◽

Causal Direction

PurposeThe study examines the psychometric properties of internal communication satisfaction questionnaire (ICSQ), an instrument originally developed in Croatian. A need for a contemporary instrument validated among a non-English-speaking population of employees who use English as their second language motivated the authors to translate the scale.Design/methodology/approachICSQ was validated on a sample of 507 employees of a large Croatian subsidiary of a multinational bank, where English is the official corporate language.FindingsICSQ displayed satisfactory levels of psychometric properties, retaining the psychometric properties of the original version of the instrument. A confirmatory factor analysis revealed the acceptable model–data fit of the eight-factor model. Additionally, findings supported the reliability and construct validity of the English version of the instrument. Good internal consistencies of all eight internal communication satisfaction (ICS) dimensions and the total ICSQ and an adequate level of scale homogeneity according to the inter-item and inter-total correlations were found.Research limitations/implicationsIn order to generalize the study’s results to other business areas and industries, the study should be replicated in other contexts. Additionally, construct validity was tested by applying cross-sectional design, and therefore, no conclusion can be drawn on the causal direction of the relationship. Finally, the discriminant validity of ICSQ was not tested and should be examined in future studies.Practical implicationsThe resulting 32-item instrument, in English, can be used for empirical and practical purposes in improving internal communication.Originality/valueThe study confirms that internal communication is a multidimensional construct and should be measured as such.

Download Full-text

Construct validity of the enfranchisement scale of the community participation indicators

Clinical Rehabilitation ◽

10.1177/02692155211040930 ◽

2021 ◽

pp. 026921552110409

Author(s):

Jessica Kersey ◽

Lauren Terhorst ◽

Allen W Heinemann ◽

Joy Hammel ◽

Carolyn Baum ◽

...

Keyword(s):

Construct Validity ◽

Community Participation ◽

Convergent Validity ◽

Missing Values ◽

Discriminant Validity ◽

Secondary Analysis ◽

Cross Sectional Study ◽

Community Dwelling ◽

Cross Sectional ◽

Cord Injury

Objective: This study examined the construct validity of the Enfranchisement scale of the Community Participation Indicators. Design: We conducted a secondary analysis of data collected in a cross-sectional study of rehabilitation outcomes. Subjects: The parent study included 604 community-dwelling adults with chronic traumatic brain injury, stroke, or spinal cord injury. The sample had a mean age of 64.1 years, was two-thirds male, and included a high proportion of racial minorities ( n = 250, 41.4%). Main measures: The Enfranchisement scale contains two subscales: the Control subscale and the Importance subscale. We examined correlations between each Enfranchisement subscale and measures of participation, environment, and impairments. The current analyses included cases with at least 80% of items completed on each subscale (Control subscale: n = 391; Importance subscale: n = 219). Missing values were imputed using multiple imputation. Results: The sample demonstrated high scores, indicating poor enfranchisement (Control subscale: M = 51.7; Importance subscale: M = 43.0). Both subscales were most strongly associated with measures of participation (Control subscale: r = 0.56; Importance subscale: r = 0.52), and least strongly associated with measures of cognition (Control subscale: r = 0.03; Importance subscale: r = 0.03). The Importance subscale was closely associated with depression ( r = 0.54), and systems, services, and policies ( r = 0.50). Both subscales were associated with social attitudes (Control subscale: r = 0.44; Importance subscale: r = 0.44) and social support (Control subscale: r = 0.49; Importance subscale: r = 0.41). Conclusions: We found evidence of convergent validity between the Enfranchisement scale and measures of participation, and discriminant validity between the Enfranchisement scale and measures of disability-related impairments. The analyses also revealed the importance of the environment to enfranchisement outcomes.

Download Full-text