scholarly journals Development and validation of the Hocus Focus Magic Performance Evaluation Scale for health professions personnel in the United States

2019 ◽  
Vol 16 ◽  
pp. 8 ◽  
Author(s):  
Kevin Spencer ◽  
Hon Keung Yuen ◽  
Max Darwin ◽  
Gavin Jenkins ◽  
Kimberly Kirklin
Keyword(s):  
Performance Evaluation ◽  
Construct Validity ◽  
Health Professions ◽  
The United States ◽  
Preliminary Evidence ◽  
Therapeutic Modality ◽  
Rater Reliability ◽  
Distinct Factor ◽  
Significant Difference ◽  
Development And Validation

Purpose: This study was conducted to describe the development and validation of the Hocus Focus Magic Performance Evaluation Scale (HFMPES), which is used to evaluate the competency of health professions personnel in delivering magic tricks as a therapeutic modality. Methods: A 2-phase validation process was used. Phase I (content validation) involved 16 magician judges who independently rated the relevance of each of the 5 items in the HFMPES and established the veracity of its content. Phase II evaluated the psychometric properties of the HFMPES. This process involved 2 magicians using the HFMPES to independently evaluate 73 occupational therapy graduate students demonstrating 3 magic tricks.Results: The HFMPES achieved an excellent scale-content validity index of 0.99. Exploratory factor analysis of the HFMPES scores revealed 1 distinct factor with alpha coefficients ≥0.8 across the 3 magic tricks. The construct validity of the HFMPES scores was further supported by evidence from a known-groups analysis, in which the Mann–Whitney U-test showed significant difference in HFMPES scores between participants with different levels of experience in delivering the 3 magic tricks. The inter-rater reliability coefficients were ≥0.75 across the 3 magic tricks, indicating that the competency of health professions personnel in delivering the 3 magic tricks could be evaluated precisely.Conclusion: Preliminary evidence supported the content and construct validity of the HFMPES, which was found to have good internal consistency and inter-rater reliability in evaluating health professions personnel’s competency in delivering magic tricks.

scholarly journals Validitas dan Reliabilitas Ujian SOCA (Students Oral Case Analysis): Studi di Salah Satu Fakultas Kedokteran di Indonesia

2016 ◽  
Vol 5 (3) ◽  
pp. 148
Author(s):  
Rizka Aries Putranti ◽  
Ova Emilia ◽  
Efrayim Suryadi
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Cognitive Complexity ◽  
Case Analysis ◽  
Medical Faculty ◽  
Validity And Reliability ◽  
Rater Reliability ◽  
Significant Difference ◽  
Kappa Value

Background: Medical faculty has to make sure that the students meet the minimal competence needed using apropriate exam. While the exam itself should facilitate students to learn. Oral examination has known for its ability to facilitate students learn but low in validity and reliability. Medical faculty of Lampung University (FK Unila) apply the student oral case analysis (SOCA) exam as one of block assessment component, as with MCQ, tutorial, and laboratory exam. This study aimed to evaluate validity and reliability of SOCA examination at FK UnilaMethod: Video of 65 students doing SOCA examination and 28 question rubrics had taken when odd semester exam year 2014-2015 has been carying out at FK Unila. Video and question rubrics were assessed by 5 panelis and analysed using Lawshe's content validity ratio (CVR) to determinate its content validity. Students performance on the video were re-assessed by another assessor to see inter-rater reliability, than analysed using kappa Cohen. Two expert in medical education assessed the cognitive comlpexity of the question rubrics. Data of SOCA's student's mark from year II, III, and IV were analysed for construct valdity and internal consistency.Results: 93,7% of the overall question in 65 video were valid (CVR>99%) and 71,8% question number in 28 question rubrics also valid according to 5 panelis. SOCA cognitive complexity were at level of analyse, know how and 4a. Inter-rater reliability analysis showed 0,549 (moderate agreement) kappa value. Mann Whitney analysis for construct validity showed no significant difference of all year. Cronbach alpha analysis showed internal consistency at the point 0,575.Conclusion: FK Unila's SOCA of odd semester examination year 2014-2015 has sufficient content validity, sufficient cognitive complexity and sufficent inter-rater reliability but lack in construct validity and internal consistency. Keywords: SOCA, validity, reliability

scholarly journals Improving handover competency in preclinical medical and health professions students: establishing the reliability and construct validity of an assessment instrument

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Meghan Michael ◽  
Andrew C. Griggs ◽  
Ian H. Shields ◽  
Mozhdeh Sadighi ◽  
Jessica Hernandez ◽  
...  
Keyword(s):  
Construct Validity ◽  
Health Professions ◽  
Preliminary Evidence ◽  
Assessment Instrument ◽  
Safe Patient Care ◽  
Professional Activities ◽  
Transition Care ◽  
Confirmatory Factor ◽  
Structured Communication ◽  
Patient Handovers

Abstract Background As part of the worldwide call to enhance the safety of patient handovers of care, the Association of American Medical Colleges (AAMC) requires that all graduating students “give or receive a patient handover to transition care responsibly” as one of its Core Entrustable Professional Activities (EPAs) for Entering Residency. Students therefore require educational activities that build the necessary teamwork skills to perform structured handovers. To date, a reliable instrument designed to assess teamwork competencies, like structured communication, throughout their preclinical and clinical years does not exist. Method Our team developed an assessment instrument that evaluates both the use of structured communication and two additional teamwork competencies necessary to perform safe patient handovers. This instrument was utilized to assess 192 handovers that were recorded from a sample of 229 preclinical medical students and 25 health professions students who participated in a virtual course on safe patient handovers. Five raters were trained on utilization of the assessment instrument, and consensus was established. Each handover was reviewed independently by two separate raters. Results The raters achieved 72.22 % agreement across items in the reviewed handovers. Krippendorff’s alpha coefficient to assess inter-rater reliability was 0.6245, indicating substantial agreement among the raters. A confirmatory factor analysis (CFA) demonstrated the orthogonal characteristics of items in this instrument with rotated item loadings onto three distinct factors providing preliminary evidence of construct validity. Conclusions We present an assessment instrument with substantial reliability and preliminary evidence of construct validity designed to evaluate both use of structured handover format as well as two team competencies necessary for safe patient handovers. Our assessment instrument can be used by educators to evaluate learners’ handoff performance as early as their preclinical years and is broadly applicable in the clinical context in which it is utilized. In the journey to optimize safe patient care through improved teamwork during handovers, our instrument achieves a critical step in the process of developing a validated assessment instrument to evaluate learners as they seek to accomplish this goal.

scholarly journals Protective Effectiveness of Long-Lasting Permethrin Impregnated Clothing Against Tick Bites in an Endemic Lyme Disease Setting: A Randomized Control Trial Among Outdoor Workers

2020 ◽  
Vol 57 (5) ◽  
pp. 1532-1538
Author(s):  
Cedar Mitchell ◽  
Megan Dyer ◽  
Feng-Chang Lin ◽  
Natalie Bowman ◽  
Thomas Mather ◽  
...  
Keyword(s):  
United States ◽  
Rhode Island ◽  
The United States ◽  
Amblyomma Americanum ◽  
Adverse Outcomes ◽  
Control Group ◽  
Tick Bites ◽  
Outdoor Workers ◽  
Significant Difference ◽  
Protective Effectiveness

Abstract Tick-borne diseases are a growing threat to public health in the United States, especially among outdoor workers who experience high occupational exposure to ticks. Long-lasting permethrin-impregnated clothing has demonstrated high initial protection against bites from blacklegged ticks, Ixodes scapularis Say (Acari: Ixodidae), in laboratory settings, and sustained protection against bites from the lone star tick, Amblyomma americanum (L.) (Acari: Ixodidae), in field tests. However, long-lasting permethrin impregnation of clothing has not been field tested among outdoor workers who are frequently exposed to blacklegged ticks. We conducted a 2-yr randomized, placebo-controlled, double-blinded trial among 82 outdoor workers in Rhode Island and southern Massachusetts. Participants in the treatment arm wore factory-impregnated permethrin clothing, and the control group wore sham-treated clothing. Outdoor working hours, tick encounters, and bites were recorded weekly to assess protective effectiveness of long-lasting permethrin-impregnated garments. Factory-impregnated clothing significantly reduced tick bites by 65% in the first study year and by 50% in the second year for a 2-yr protective effect of 58%. No significant difference in other tick bite prevention method utilization occurred between treatment and control groups, and no treatment-related adverse outcomes were reported. Factory permethrin impregnation of clothing is safe and effective for the prevention of tick bites among outdoor workers whose primary exposure is to blacklegged ticks in the northeastern United States.

scholarly journals Testing telediagnostic thyroid ultrasound in Peru: a new horizon in expanding access to imaging in rural and underserved areas

2021 ◽  
Author(s):  
T. J. Marini ◽  
S. L. Weiss ◽  
A. Gupta ◽  
Y. T. Zhao ◽  
T. M. Baran ◽  
...  
Keyword(s):  
Thyroid Nodule ◽  
Standard Of Care ◽  
The United States ◽  
Epidemiological Studies ◽  
Thyroid Ultrasound ◽  
Target Region ◽  
Experienced Radiologist ◽  
Significant Difference ◽  
Size Evaluation

Abstract Purpose Thyroid ultrasound is a key tool in the evaluation of the thyroid, but billions of people around the world lack access to ultrasound imaging. In this study, we tested an asynchronous telediagnostic ultrasound system operated by individuals without prior ultrasound training which may be used to effectively evaluate the thyroid and improve access to imaging worldwide. Methods The telediagnostic system in this study utilizes volume sweep imaging (VSI), an imaging technique in which the operator scans the target region with simple sweeps of the ultrasound probe based on external body landmarks. Sweeps are recorded and saved as video clips for later interpretation by an expert. Two operators without prior ultrasound experience underwent 8 h of training on the thyroid VSI protocol and the operation of the telemedicine platform. After training, the operators scanned patients at a health center in Lima. Telediagnostic examinations were sent to the United States for remote interpretation. Standard of care thyroid ultrasound was performed by an experienced radiologist at the time of VSI examination to serve as a reference standard. Results Novice operators scanned 121 subjects with the thyroid VSI protocol. Of these exams, 88% were rated of excellent image quality showing complete or near complete thyroid visualization. There was 98.3% agreement on thyroid nodule presence between VSI teleultrasound and standard of care ultrasound (Cohen’s kappa 0.91, P < 0.0001). VSI measured the thyroid size, on average, within 5 mm compared to standard of care. Readers of VSI were also able to effectively characterize thyroid nodules, and there was no significant difference in measurement of thyroid nodule size (P = 0.74) between VSI and standard of care. Conclusion Thyroid VSI telediagnostic ultrasound demonstrated both excellent visualization of the thyroid gland and agreement with standard of care thyroid ultrasound for nodules and thyroid size evaluation. This system could be deployed for evaluation of palpable thyroid abnormalities, nodule follow-up, and epidemiological studies to promote global health and improve the availability of diagnostic imaging in underserved communities.

scholarly journals Brief parental self-efficacy scales for promoting healthy eating and physical activity in children: a validation study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Åsa Norman ◽  
Julie Wright ◽  
Emma Patterson
Keyword(s):  
Physical Activity ◽  
Construct Validity ◽  
Sex Education ◽  
Self Efficacy ◽  
Parental Education ◽  
Weight Status ◽  
Preliminary Evidence ◽  
Objective Measures ◽  
Partial Metric ◽  
Invariance Testing

Abstract Background Brief scales to measure parental self-efficacy (PSE) in relation to children’s obesogenic behaviours have not been developed and validated using more rigorous methodology such as invariance testing, limiting their generalisability to sub-groups. This study aimed to assess the construct validity and measurement invariance of brief PSE scales for children’s intake of vegetables, soft drinks, and sweets, and physical activity. Methods Parents (n = 242) of five-to-seven-year-old children in disadvantaged and culturally diverse settings in Sweden responded to a questionnaire in Swedish with 12 items assessing PSE in relation to healthy and unhealthy behaviours. Construct validity was assessed with confirmatory factor analysis, invariance testing compared the scales by groups of parental sex, education, and child weight status. Criterion validity was evaluated using objective measures of children’s physical activity and semi-objective measures of diet. Results Two-factor models showed moderate to excellent fit to the data. Invariance was supported across all groups for healthy behaviour scales. Unhealthy behaviour scales were invariant for all groups except parental education where partial metric invariance was supported. Scales were significantly correlated with physical activity and diet. Conclusion This study provides preliminary evidence for the validity of brief PSE scales and invariance across groups suggesting their utility for research and clinical management of weight-related behaviours.

scholarly journals Examining concurrent validity between COMLEX-USA Level 2-Cognitive Evaluation and COMLEX-USA Level 2-Performance Evaluation

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Brandon Craig ◽  
Xiaolin Wang ◽  
Jeanne Sandella ◽  
Tsung-Hsun Tsai ◽  
David Kuo ◽  
...  
Keyword(s):  
Performance Evaluation ◽  
Concurrent Validity ◽  
Pearson Correlation ◽  
The United States ◽  
National Board ◽  
Cognitive Evaluation ◽  
Competency Domain ◽  
Medical Examiners ◽  
Pearson Correlations ◽  
Level 2

Abstract Context The Comprehensive Osteopathic Medical Licensing Examination of the United States of America (COMLEX-USA) is a three level examination used as a pathway to licensure for students in osteopathic medical education programs. COMLEX-USA Level 2 includes a written assessment of Fundamental Clinical Sciences for Osteopathic Medical Practice (Level 2-Cognitive Evaluation [L2-CE]) delivered in a computer based format and separate performance evaluation (Level 2-Performance Evaluation [L2-PE]) administered through live encounters with standardized patients. L2-PE was designed to augment L2-CE. It is expected that the two examinations measure related yet distinct constructs. Objectives To explore the concurrent validity of L2-CE with L2-PE. Methods First attempt test scores were obtained from the National Board of Osteopathic Medical Examiners database for 6,639 candidates who took L2-CE between June 2019 and May 2020 and matched to the students’ L2-PE scores. The sample represented all colleges of osteopathic medicine and 97.5% of candidates who took L2-CE during the complete 2019–2020 test cycle. We calculated disattenuated correlations between the total score for L2-CE, the L2-CE scores for the seven competency domains (CD1 through CD7), and the L2-PE scores for the Humanistic Domain (HM) and Biomedical/Biomechanical Domain (BM). All scores were on continuous scales. Results Pearson correlations ranged from 0.10 to 0.88 and were all statically significant (p<0.01). L2-CE total score was most strongly correlated with CD2 (0.88) and CD3 (0.85). Pearson correlations between the L2-CE competency domain subscores ranged from 0.17 to 0.70, and correlations which included either HM or BM ranged from 0.10 to 0.34 with the strongest of those correlations being between BM and L2-CE total score (0.34) as well as between HM and BM (0.28).The largest increase between corresponding Pearson and disattenuated correlations was for pairs of scores with lower reliabilities such as CD5 and CD6, which had a Pearson correlation of 0.17 and a disattenuated correlation of 0.68. The smallest increase in correlations was observed in pairs of scores with larger reliabilities such as L2-CE total score and HM, which had a Pearson correlation of 0.23 and a disattenuated correlation of 0.28. The reliability of L2-CE was 0.87, 0.81 for HM, and 0.73 for BM. The reliabilities for the L2-CE competency domain scores ranged from 0.22 to 0.74. The small to moderate correlations between the L2-CE total score and the two L2-PE support the expectation that these examinations measure related but distinct constructs. The correlations between L2-PE and L2-CE competency domain subscores reflect the distribution of items defined by the L2-PE blueprint, providing evidence that the examinations are performing as designed. Conclusions This study provides evidence supporting the validity of the blueprints for constructing COMLEX-USA Levels 2-CE and 2-PE examinations in concert with the purpose and nature of the examinations.

Development and Validation of an Instrument to Assess Horseback Mobility in Hippotherapy

2021 ◽  
pp. 003151252110365
Author(s):  
Alessandra V. Prieto ◽  
Kênnea Martins Almeida Ayupe ◽  
Ana C. A. Abreu ◽  
Paulo J. B. Gutierres Filho
Keyword(s):  
Correlation Coefficient ◽  
Factor Structure ◽  
Internal Consistency ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Exploratory Factor Analyses ◽  
Excellent Internal Consistency ◽  
Development And Validation ◽  
Functional Gain ◽  
Intra Class Correlation Coefficient

Improvement in rider mobility represents an important functional gain for people with disabilities undergoing hippotherapy. However, there is no validated measuring instrument to track and document the rider's progress in riding activities. In this study, we aimed to develop and establish validity evidence for an instrument to assess hippotherapy participants’ mobility on horseback. We report on this development through the stages of: (a) content validation, (b) construct validation, (c) inter- and intra-rater reliability and (d) internal consistency analysis. We evaluated its factor structure with exploratory factor analyses, calculated values for inter- and intra-rater reliability using the intra-class correlation coefficient, and calculated its internal consistency using Cronbach's alpha. We followed recommendations by the Guidelines for Reporting Reliability and Agreement Studies. We found good inter-rater reliability (intra-class correlation coefficient – ICC = 0.991–0.999) and good intra-rater reliability (ICC = 0.997–1.0), and there was excellent internal consistency (Cronbach's α = 0.937–0.999). The instrument’s factor structure grouped its three domains into one factor. As this instrument is theoretically consistent and has been found to be appropriate and reliable for its intended use, it is now available for the measurement of horseback mobility among hippotherapy riders.

A Meta-Analysis of Extracorporeal Anticoagulants in Pediatric Continuous Kidney Replacement Therapy

2021 ◽  
pp. 088506662199275
Author(s):  
Rupesh Raina ◽  
Nirav Agrawal ◽  
Kirsten Kusumi ◽  
Avisha Pandey ◽  
Abhishek Tibrewal ◽  
...  
Keyword(s):  
Replacement Therapy ◽  
Meta Analysis ◽  
Kidney Injury ◽  
Electrolyte Imbalance ◽  
Therapeutic Modality ◽  
Regional Citrate Anticoagulation ◽  
Increased Risk ◽  
Study Results ◽  
Significant Difference ◽  
Kidney Replacement Therapy

Objective: Continuous kidney replacement therapy (CKRT) is the primary therapeutic modality utilized in hemodynamically unstable patients with severe acute kidney injury. As the circuit is extracorporeal, it poses an increased risk of blood clotting and circuit loss; frequent circuit losses affect the provider’s ability to provide optimal treatment. The objective of this meta-analysis is to evaluate the safety and efficacy of the extracorporeal anticoagulants in the pediatric CKRT population. Data Sources: We conducted a literature search on PubMed/Medline and Embase for relevant citations. Study Selection: Studies were included if they involved patients under the age of 18 years undergoing CKRT, with the use of anticoagulation (heparin, citrate, or prostacyclin) as a part of therapy. Only English articles were included in the study. Data Extraction: Initial search yielded 58 articles and a total of 24 articles were included and reviewed. A meta-analysis was performed focusing on the safety and effectiveness of regional citrate anticoagulation (RCA) vs unfractionated heparin (UFH) anticoagulants in children. Data Synthesis: RCA had statistically significantly longer circuit life of 50.65 hours vs. UFH of 42.10 hours. Two major adverse effects metabolic alkalosis and electrolyte imbalance seen more commonly in RCA compared to UFH. There was not a significant difference in the risk of systemic bleeding when comparing RCA vs. UFH. Conclusion: RCA is the preferred anticoagulant over UFH due to its significantly longer circuit life, although vigilant circuit monitoring is required due to the increased risk of electrolyte disturbances. Prostacyclin was not included in the meta-analysis due to the lack of data in pediatric patients. Additional studies are needed to strengthen the study results further.

Selective Determination of Entecavir in the Presence of Its Oxidative Degradate by Spectrophotometric and Chromatographic Methods

2021 ◽  
Author(s):  
Heba M El-Sayed ◽  
Laila E Abdel Fattah ◽  
Hisham E Abdellatef ◽  
Maha A Hegazy ◽  
Mai M Abd El-Aziz
Keyword(s):  
High Selectivity ◽  
Oxidative Degradation ◽  
Hplc Method ◽  
Peak Amplitude ◽  
Quality Analysis ◽  
Official Method ◽  
Selective Determination ◽  
Significant Difference ◽  
Development And Validation

Abstract Background Entecavir (ENT) is an antiretroviral agent prescribed for treatment of HBV and HIV. Objective Development and validation of three simple, sensitive, selective, and precise methods for determination of ENT in presence of its oxidative degradation product (ENT deg.). Methods The first method was based on second derivative (D2) spectrophotometry through measuring the peak amplitude of D2 spectra at 293.6 nm. The second one is mean centering of the ratio spectra (MCR), which allowed measuring the peak amplitude at 280.0 nm. While the third method was HPLC; where ENT was separated from ENT deg. using Zobrax C18column and methanol: water (30:70, v/v), pH 3 as a mobile phase. The three developed methods were validated according to ICH guidelines. Results Linearity range of ENT was 5.00–50.00 μg/mL for both D2and MCR. However, higher sensitivity was achieved using HPLC (1.00–50.00 μg/mL). Accuracy of ENT were 100.60%±0.547, 101.55%±1.2071 and 100.61%±1.207 for D2, MCR and HPLC methods, respectively, and precision was within 1.280. Conclusions The developed methods were successfully applied for the determination of ENT in Tecavir® tablets without interference from ENT deg. They showed no significant difference compared with the official method as well as they could be applied in the quality analysis of ENT with high selectivity, accuracy, and precision. Highlights ENT was quantified using two spectrophotometric (D2 and MCR) methods and an HPLC method in presence of ENT deg. The proposed methods were applied to analysis of ENT tablets with high selectivity, sensitivity, and accuracy.

scholarly journals Assessing Diazinon Pollution in the Three Major Rivers Flowing into the Caspian Sea (Iran)

Water ◽  
2021 ◽  
Vol 13 (3) ◽  
pp. 335
Author(s):  
Reza Dahmardeh Behrooz ◽  
Abbas Esmaili-sari ◽  
Magdalena Urbaniak ◽  
Paromita Chakraborty
Keyword(s):  
High Risk ◽  
Organophosphorus Pesticides ◽  
Aquatic Organisms ◽  
The United States ◽  
The Caspian Sea ◽  
Worst Case ◽  
Pollution Levels ◽  
Haraz River ◽  
Significant Difference ◽  
Medium Risk

The aim of this study was to investigate the seasonal and spatial variations in the concentrations of a widely used organophosphorous pesticide (OPP), diazinon, and the associated risk posed by this OPP in the surface water from the three largest rivers located in the northern province of Iran: the Haraz, the Talar and the Babolrood rivers. These rivers are located in the agriculture province of Mazandaran, and are exposed to high doses of organophosphorus pesticides, especially diazinon. The concentration of diazinon was determined using gas chromatography, while the potential risk posed by diazinon was elucidated using a Risk Quotient (RQ) calculated for general (RQm) and worst-case (RQex) scenarios. The obtained results demonstrated that the average diazinon concentrations ranged from 41 ± 76 ng/L in the Talar River and 57 ± 116 ng/L in the Haraz River, to 76.5 ± 145 ng/L in the Babolrood River, with a significant difference noted between summer and autumn seasons for all three rivers. For some stations, the concentration of diazinon is higher than the standard guidelines of Australian/New Zealand Guidelines for Fresh and Marine Water Quality (FMWQ) and the United States Criteria Maximum Concentration (CMC). The calculated RQs indicated a medium risk of diazinon, RQm = 0.73 and RQex = 2.27, in the Talar River; RQm = 1.02 and RQex = 2.49 in the Haraz River; and RQm = 1.35 and RQex = 4.54 in the Babolrood River. The overall exposure of diazinon was defined to have a high risk (RQm and RQex > 1); however, the summer sampling revealed a high risk (RQm and RQex > 1), while the autumn had a medium risk (RQm and RQex < 1). The obtained results revealed not only elevated concentrations of diazinon in the studied rivers but most importantly the high risk posed by this OPP for the aquatic organisms and the wellbeing of the whole river ecosystem. The current study showed that development and implementation of appropriate standards and regulations toward diazinon in countries such as Iran are required to reduce the pollution levels and risks related to elevated concentrations of the studied pesticide.

Sign in / Sign up

Export Citation Format

Share Document