scholarly journals Improving Safety through Non-Technical Skills in Chemical Plants: The Validity of a Questionnaire for the Self-Assessment of Workers

2019 ◽  
Vol 16 (6) ◽  
pp. 992 ◽  
Author(s):  
Marco Mariani ◽  
Michela Vignoli ◽  
Rita Chiesa ◽  
Francesco Violante ◽  
Dina Guglielmi
Keyword(s):  
Decision Making ◽  
Construct Validity ◽  
Stress Management ◽  
Situational Awareness ◽  
Technical Skills ◽  
The Self ◽  
Chemical Plants ◽  
Validity And Reliability ◽  
Self Assessment ◽  
Organizational Hierarchy

This research is aimed at developing a questionnaire for the self-assessment of non-technical skills (NTS) leading to safety in the chemical sector and at analysing the properties of its scales in terms of construct validity. The research involved 269 Italian employees from three chemical plants of an international company, who occupied low–medium levels in the organizational hierarchy. Results showed a good level of validity and reliability of the instrument and suggested that communication, situational awareness, decision-making, and fatigue/stress management are the four most important NTS for safety in the chemical sector.

Does Repeated Exposure to Critical Situations in a Screen-Based Simulation Improve the Self-Assessment of Non-Technical Skills in Postpartum Hemorrhage Management?

2019 ◽  
Vol 50 (2) ◽  
pp. 102-123 ◽  
Author(s):  
Jessy Barré ◽  
Daphné Michelet ◽  
Anais Job ◽  
Jennifer Truchot ◽  
Philippe Cabon ◽  
...  
Keyword(s):  
Postpartum Hemorrhage ◽  
Technical Skills ◽  
Two Dimensions ◽  
Leadership Team ◽  
Repeated Exposure ◽  
The Self ◽  
Self Assessment ◽  
Team Working ◽  
Simulation Session ◽  
Nasa Tlx

Background. Postpartum hemorrhage (PPH) is the leading cause of maternal death in the world. Non-technical skills (e.g. communication) are now recognized as a contributing factor to medical safety. In the field of simulation, screen-based simulations are currently very popular with computer/technological development. This study evaluates a screen-based simulation device, PerinatSims, developed to improve technical and non-technical skills in PPH situation. This experiment hypothesized that exposure and repetition of training with PerinatSims would improve the self-assessment of non-technical skills, and therefore increase the ability to manage PPH. Methods. The primary endpoint was a self-assessment of non-technical skills during simulation session of PPH on a digital simulator. Twenty French midwives performed three of nine 25 minutes sessions of PPH screen-based simulation. Four self-assessment questionnaires were administered at the end of each simulation session: a leadership/team working questionnaire (BAT), a negative feelings/emotional questionnaire (DASS-21), a Flow questionnaire and a mental load questionnaire (NASA-TLX). Results between sessions were compared using a repeated measures ANOVA followed by a Bonferroni post hoc test. Results. The study showed a positive evolution during the three screen-based simulation sessions: an increase of leadership and team working self-assessment, an increase of Flow sense, and a decrease of negative emotions (anxiety and depression in the DASS-21 score). Significant decrease of stress was found only between the second and the third sessions, and significant differences in the NASA-TLX were observed only in two dimensions, Performance and Frustration. Conclusion. A repeated exposure to PPH situations with a screen-based simulation tool improved the midwives’ self-assessment, especially for leadership, team working, emotion management and Flow sense. Furthermore, midwives had a very positive feedback on the device. They highlighted the desire to use PerinatSims more often to be trained to PPH management, for technical as well as non-technical skills.

scholarly journals Validation of an Online Assessment of Orthopedic Surgery Residents' Cognitive Skills and Preparedness for Carpal Tunnel Release Surgery

2010 ◽  
Vol 2 (3) ◽  
pp. 435-441 ◽  
Author(s):  
Janet Shanedling ◽  
Ann Van Heest ◽  
Michael Rodriguez ◽  
Matthew Putnam ◽  
Julie Agel
Keyword(s):  
Construct Validity ◽  
Carpal Tunnel ◽  
Cognitive Skills ◽  
Carpal Tunnel Release ◽  
Technical Skills ◽  
Skills Assessment ◽  
Validity And Reliability ◽  
School Students ◽  
Internal Reliability ◽  
Carpal Tunnel Release Surgery

Abstract Background Surgical competence requires both cognitive and technical skills. Relatively little is found in the literature regarding the value of Web-based assessments to measure surgery residents' mastery of the competencies. Objective To determine the validity and reliability of 2 online instruments for predicting the cognitive preparedness of residents for performing carpal tunnel release surgery. Method Twenty-eight orthopedic residents and 2 medical school students responded to an online measure of their perception of preparedness and to an online cognitive skills assessment prior to an objective structured assessment of technical skills, in which they performed carpal tunnel release surgery on cadaveric specimens and received a pass/fail assessment. The 2 online assessments were analyzed for their internal reliability, external correlation with the pass/fail decision, and construct validity. Results The internal consistency of the perception of preparedness measure was high (α  =  .92) while the cognitive assessment was less strong (α  =  .65). Both instruments demonstrated moderately strong correlations with the pass/fail decision, with Spearman correlation of .606 (P  =  .000) and .617 (P  =  .000), respectively. Using logistic regression to analyze the predictive strength of each instrument, the perception of preparedness measure demonstrated a 76% probability (η2  =  .354) and the cognitive skills assessment a 73% probability (η2  =  .381) of correctly predicting the pass/fail decision. Analysis of variance modeling resulted in significant differences between levels at P < .005, supporting good construct validity. Conclusions The online perception of preparedness measure and the cognitive skills assessment both are valid and reliable predictors of readiness to successfully pass a cadaveric motor skills test of carpal tunnel release surgery.

scholarly journals Designing an Online Self-assessment for Informed Study Decisions: The User Perspective

2020 ◽  
pp. 74-86
Author(s):  
L. E. C. Delnoij ◽  
J. P. W. Janssen ◽  
K. J. H. Dirkx ◽  
R. L. Martens
Keyword(s):  
Decision Making ◽  
Online Education ◽  
Reference Group ◽  
The Self ◽  
Extensive Literature ◽  
Validity Evidence ◽  
Prospective Students ◽  
Self Assessment ◽  
User Perspective ◽  
Correlational Research

AbstractThis paper presents the results of a study, carried out as part of the design-based development of an online self-assessment for prospective students in higher online education. The self-assessment consists of a set of tests – predictive of completion – and is meant to improve informed decision making prior to enrolment. The rationale being that better decision making will help to address the ongoing concern of non-completion in higher online education. A prototypical design of the self-assessment was created based on an extensive literature review and correlational research, aimed at investigating validity evidence concerning the predictive value of the tests. The present study focused on investigating validity evidence regarding the content of the self-assessment (including the feedback it provides) from a user perspective. Results from a survey among prospective students (N = 66) indicated that predictive validity and content validity of the self-assessment are somewhat at odds: three out of the five tests included in the current prototype were considered relevant by prospective students. Moreover, students rated eleven additionally suggested tests – currently not included – as relevant concerning their study decision. Expectations regarding the feedback to be provided in connection with the tests include an explanation of the measurement and advice for further preparation. A comparison of the obtained scores to a reference group (i.e., other test-takers or successful students) is not expected. Implications for further development and evaluation of the self-assessment are discussed.

Construct Validity of the Self-Assessment Evaluation Form for the Olympic Education Training Program in Greece

2004 ◽  
Vol 99 (2) ◽  
pp. 737-738 ◽  
Author(s):  
Vasilios Grammatikopoulos ◽  
Vassilios Papacharisis ◽  
Athanasios Koustelios
Keyword(s):  
Construct Validity ◽  
Training Program ◽  
The Self ◽  
Self Assessment ◽  
Evaluation Form ◽  
Olympic Education ◽  
Education Training

Do surgeon non-technical skills correlate with teamwork-related outcomes during robot-assisted surgery?

BMJ Leader ◽  
2019 ◽  
Vol 3 (3) ◽  
pp. 69-74
Author(s):  
Youseff Ahmed ◽  
Zaeem Lone ◽  
Ahmed A Hussein ◽  
Yingdong Feng ◽  
Hijab Khan ◽  
...  
Keyword(s):  
Decision Making ◽  
Clinical Outcomes ◽  
Situational Awareness ◽  
Mental Workload ◽  
Pearson Correlation ◽  
Technical Skills ◽  
Robot Assisted ◽  
Perceived Performance ◽  
Nasa Tlx ◽  
The Impact

IntroductionTo evaluate the impact of non-technical skills (NTS) on team performance, workload and clinical outcomes.MethodsThe operating room (OR) environment of 20 robot-assisted radical prostatectomies performed by three different surgeons was recorded. Trained observers assessed NTS utilising the Non-Technical Skills for Surgeons (NOTSS) questionnaire. Associations between NOTSS scores, teamwork attributes (anticipation and inconveniences), workload (measured by National Aeronautics and Space Administration-Task Load Index (NASA-TLX)) and clinical outcomes (operative time, blood loss and surgical complexity) were determined using logistic regression and Pearson correlation.Results1780 requests were observed, 703 (39%) were non-verbal. Utilisation of non-verbal requests differed significantly among surgeons (26%, 36% and 44%, p<0.001). Anticipation was significantly associated with ‘Situational Awareness’ (OR 2.59, 95% CI 1.52 to 4.38, p<0.001), ‘Decision Making’ (OR 0.42, 95% CI 0.33 to 0.55, p<0.001) and ‘Communication and Teamwork’ (OR 0.43, 95% CI 0.25 to 0.74, p=0.002) domains. Inconveniences were significantly associated with ‘Situational Awareness’ (OR 0.21, 95% CI 0.08 to 0.59, p=0.003), ‘Decision Making’ (OR 2.73, 95% CI 1.53 to 4.86, p<0.001), and ‘Leadership’ (OR 0.62, 95% CI 0.41 to 0.94, p=0.03). There was a significant positive correlation between NOTSS scores and perceived physical and mental workload measures of NASA-TLX, as well as self-perceived performance. There was no significant association between NOTSS scores and any of the investigated clinical outcomes.ConclusionNTS in the OR were associated with team efficiency, fewer surgical flow disruptions and an improved self-perceived performance.

scholarly journals Evaluating Construct Validity and Reliability of Intention to Transfer Training Conduct Instrument Using Rasch Model Analysis

2021 ◽  
Vol 29 (2) ◽  
Author(s):  
Shaliza Shafie ◽  
Faizah Abd Majid ◽  
Teoh Sian Hoon ◽  
Siti Maftuhah Damio
Keyword(s):  
Construct Validity ◽  
Rasch Model ◽  
Mean Square ◽  
Validity And Reliability ◽  
Self Assessment ◽  
New Instrument ◽  
Transfer Training ◽  
Point Measure ◽  
The Impact ◽  
The Rasch Model

The impact of the Industry Revolution 4.0 (IR4.0) in the workplace requires organisations to ensure clerical employees can effectively transfer their newly acquired knowledge and skills learned in training back into the workplace. Hence, an instrument is required to identify factors influencing the intention to transfer training conduct amongst clerical employees. Thus, this paper presents the evaluation of construct validity and reliability of the new instrument to confirm its objectivity and clarity in measuring the constructs under study as intended. This four-point Likert-type scale instrument consists of 72 self-assessment items that represent 12 constructs. The Rasch Model was then employed to analyse the construct validity and reliability by evaluating the suitability of items in the respective constructs on the instrument. The item and person reliability and strata indices, point-measure correlation, and outfit mean square values were examined. The analysis found that three constructs in the item and person reliability index and eight constructs in the item and person reliability strata index were low but adequate and met the Rasch Model measurement acceptable level. Meanwhile, point-measure correlation values for all constructs fulfilled the criteria. Finally, the outfit mean square values established that 65 items in the constructs were found to be fit, whereas seven items were misfits which require improvement. Subsequently, the seven misfit items were improved as the item and person reliability values could be increased, thus the items were retained. Thereafter, the instrument was ready to be used for data collection in the actual study.

PP67 Validity Of A Questionnaire Assessing Patient Medication Experiences

2018 ◽  
Vol 34 (S1) ◽  
pp. 93-93
Author(s):  
Merel Kimman ◽  
Marlies Wijsenbeek ◽  
Remy Mostard ◽  
Nelleke Tak ◽  
Adrienne Rotteveel ◽  
...  
Keyword(s):  
Decision Making ◽  
Side Effects ◽  
Construct Validity ◽  
Content Validity ◽  
Atypical Hemolytic Uremic Syndrome ◽  
Intraclass Correlation ◽  
Patient Experiences ◽  
Validity And Reliability ◽  
Generic Module ◽  
The Impact

Introduction:The Patient Experiences and Satisfaction with Medications (PESaM) questionnaire was recently developed. It consists of two disease-specific modules for evaluating drug treatment of idiopathic pulmonary fibrosis (IPF) and atypical hemolytic uremic syndrome (aHUS): (i) a generic module applicable to any medication, and (ii) a patient expectations module. This study assessed the validity and reliability of the generic module in a large sample of patients in the Netherlands.Methods:In 2017, the PESaM-questionnaire was sent out to IPF patients on pirfenidone or nintedanib, aHUS patients receiving eculizumab, and patients using advagraf after kidney transplantation. The generic module consists of 16 items related to the domains effectiveness, side-effects and ease of use, and assesses patient experiences regarding the impact of the medication on daily life and health, and satisfaction. Mean scores for each domain were calculated using a scoring algorithm. Content validity, construct validity, and reliability were assessed using recommended methods.Results:Patients (n=188) completed the generic module of whom 48 percent used pirfenidone, 36 percent nintedanib, 11 percent advagraf, and 5 percent eculizumab. Content validity was established. Expected associations between patient experiences, satisfaction, and quality of life (QoL) were generally confirmed, demonstrating construct validity. For example, a moderate to strong positive association was found between patient experiences and satisfaction with side-effects (correlation coefficient 0.625, p < 0.05), and low (positive) associations were found between patient experiences and QoL. Importantly, the PESaM-questionnaire was able to discriminate between patients using different medications. Intraclass correlation coefficients, for test-retest reliability, ranged between good and excellent for most domains.Conclusions:The PESaM questionnaire is a promising tool to provide scientific evidence regarding the patient's perspective in health technology assessments and reimbursement decision-making regarding (expensive) medications, but can also support shared decision-making and appropriate use of medication at the individual patient level. Further research will assess the questionnaire's responsiveness and generalizability of results to other patient populations.

scholarly journals Participant perceptions of virtual simulation to develop non-technical skills in health professionals

2019 ◽  
Vol 24 (3-4) ◽  
pp. 167-180
Author(s):  
Monica Peddle
Keyword(s):  
Decision Making ◽  
Clinical Practice ◽  
Health Professionals ◽  
Situational Awareness ◽  
Technical Skills ◽  
Virtual Simulation ◽  
Professional Performance ◽  
Role Modelling ◽  
Exploratory Approach ◽  
Virtual Simulations

Background Research has identified that virtual simulations may be effective in developing non-technical skills including communication, teamwork and decision making. However, little is known about how participants perceive learning non-technical skills via engagement in virtual simulation. Aims The aim of this research was to investigate participant perceptions and the learning experiences when engaging in virtual simulations focused on developing non-technical skills. Method A descriptive exploratory approach was used. An online voluntary survey collected qualitative extended responses from participants after each virtual simulation. Ethics approval was obtained for the research and guidelines adhered to throughout the study. Results A total of 675 responses were obtained. Participants perceive that engaging with the virtual simulation made them aware of non-technical skills including communication, teamwork, decision making, critical thinking and problem solving, and, to a lesser extent, situational awareness. Additional categories of learning, clinical practice and limitations were identified. Conclusions Engaging in virtual simulation can develop awareness of non-technical skills, as well as confidence and vigilance in practice and mindfulness of a person-centred approach to healthcare. Engaging in virtual simulation may support change in the professional performance of the participants through role modelling and learning through error.

Sign in / Sign up

Export Citation Format

Share Document