scholarly journals Nuance and Noise: Lessons Learned From Longitudinal Aggregated Assessment Data

2017 ◽  
Vol 9 (6) ◽  
pp. 724-729 ◽  
Author(s):  
Teresa M. Chan ◽  
Jonathan Sherbino ◽  
Mathew Mercuri
Keyword(s):  
Tertiary Care ◽  
Lessons Learned ◽  
Teaching Hospitals ◽  
Average Score ◽  
Global Rating ◽  
Multilevel Regression ◽  
Assessment Data ◽  
Workplace Based Assessment ◽  
Competency Based ◽  
The Relationship

ABSTRACT Background  Competency-based medical education requires frequent assessment to tailor learning experiences to the needs of trainees. In 2012, we implemented the McMaster Modular Assessment Program, which captures shift-based assessments of resident global performance. Objective  We described patterns (ie, trends and sources of variance) in aggregated workplace-based assessment data. Methods  Emergency medicine residents and faculty members from 3 Canadian university-affiliated, urban, tertiary care teaching hospitals participated in this study. During each shift, supervising physicians rated residents' performance using a behaviorally anchored scale that hinged on endorsements for progression. We used a multilevel regression model to examine the relationship between global rating scores and time, adjusting for data clustering by resident and rater. Results  We analyzed data from 23 second-year residents between July 2012 and June 2015, which yielded 1498 unique ratings (65 ± 18.5 per resident) from 82 raters. The model estimated an average score of 5.7 ± 0.6 at baseline, with an increase of 0.005 ± 0.01 for each additional assessment. There was significant variation among residents' starting score (y-intercept) and trajectory (slope). Conclusions  Our model suggests that residents begin at different points and progress at different rates. Meta-raters such as program directors and Clinical Competency Committee members should bear in mind that progression may take time and learning trajectories will be nuanced. Individuals involved in ratings should be aware of sources of noise in the system, including the raters themselves.

scholarly journals Developing a dashboard to meet Competence Committee needs: a design-based research project

2020 ◽  
Author(s):  
Brent Thoma ◽  
Venkat Bandi ◽  
Robert Carey ◽  
Debajyoti Mondal ◽  
Robert Woods ◽  
...  
Keyword(s):  
Decision Making ◽  
Research Process ◽  
Assessment Data ◽  
Design Based Research ◽  
Educational Environments ◽  
Integral Role ◽  
Learner Assessment ◽  
Workplace Based Assessment ◽  
Competency Based ◽  
The University

Background: Competency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based research allows the simultaneous development and study of educational environments. Methods: We utilized a design-based research process within the emergency medicine residency program at the University of Saskatchewan to identify the data, analytics, and visualizations needed by its Competence Committee, and developed a dashboard incorporating these elements. Narrative data were collected from two focus groups, five interviews, and the observation of two Competence Committee meetings. Data were qualitatively analyzed to develop a thematic framework outlining the needs of the Competence Committee and to inform the development of the dashboard. Results: The qualitative analysis identified four Competence Committee needs (Explore Workplace-Based Assessment Data, Explore Other Assessment Data, Understand the Data in Context, and Ensure the Security of the Data). These needs were described with narratives and represented through visualizations of the dashboard elements. Conclusions: This work addresses the practical challenges of supporting data-driven decision making by Competence Committees and will inform the development of dashboards for programs, institutions, and learner management systems.

Microprocessor Architecture Era for Development Cloud Computing of Ministry of Electricity and Energy of Egypt

2014 ◽  
Vol 13 (12) ◽  
pp. 5199-5209
Author(s):  
Heba A. El-Khobby ◽  
Mostafa M. AbdElnaby ◽  
Abdel-Aziz Ibrahim Mahmoud HASSANIN ◽  
Abdallah D. Maziad
Keyword(s):  
Information Technology ◽  
Cloud Computing ◽  
Theoretical Analysis ◽  
Organization Structure ◽  
Fixed Time ◽  
Organization Structures ◽  
Competence Evaluation ◽  
Competency Based ◽  
Services Evaluation ◽  
The Relationship

A development and evaluation the Cloud Computing (ClComp) of Ministry of Electricity and Energy of Egypt (MEEE) is presented in this paper. In order to be able to judge whether the ClComp of MEEE is competence, there is a need to develop criteria which performance can judged. Competency based standards and the ability to perform the activities within an occupation to the standard expected in the organization structure are presented. The key objective of Cloud Computing is to integrate Authorized Groups (AuthGs) development with the needs of the organization structures of MEEE. The ClComp of MEEE was developed jointly between the telecommunication information technology and ClComp services. Evaluation enables participant to distinguish between AuthGs centered view and a customer centered view of cloud computing of MEEE is competence evaluation. Recognize the main types of evaluation, explain the purpose of evaluation compare the approaches to cloud computing evaluation and review the relationship between the process and policy of evaluation are investigated. Microprocessor architecture presented an optimistic view of multicore scalability to develop the ClComp. Moreover this paper investigates the theoretical analysis of multiprocessor developing and scalability. The analysis was based on the laws of Amdahl's, Gustafson's, Hill's and Marty for fixed-workload condition. Moreover, challenged the difficulties to develop better cloud computing is taken into account. Also, multicore analysis of ClComp scalability, performance and power under fixed-time and memory-bound conditions are studied. These results complement existing studies and demonstrate that ClComp architectures are capable of extensive scalability and developing.

71. Are video interviews a good alternative to in person interviews in assessing international applicants' skills?

2007 ◽  
Vol 30 (4) ◽  
pp. 67
Author(s):  
M. Alameddine ◽  
K. Imrie ◽  
S. Akers ◽  
S. Verma
Keyword(s):  
Nursing Education ◽  
Pilot Study ◽  
Psychological Treatment ◽  
Cost Savings ◽  
Good Alternative ◽  
Average Score ◽  
Global Rating ◽  
Problem Solving Skills ◽  
Global Satisfaction ◽  
Personal Connection

We developed and administered two questionnaires to assess the interview experience of both interviewers and applicants during postgraduate medical selection interviews. Using a 5 point likert scale, the questionnaires assessed three areas (1) ability to show/assess communication, interpersonal and problem solving skills; (2) ability to know the other side well and (3) level of comfort with the interview. Interviewers and applicants were asked to provide a global rating for the interview. The questionnaires were administered to both candidates and applicants from 6 departments in 18 in-person and 12 video interviews. 30 applicant and 87 interviewer survey forms were collected and analyzed. T-tests were used to compare the means of the two groups and significance levels were analyzed. Both interviewers and applicants had a higher average global satisfaction for video interviews compared to in person interviews. No difference was indicated in the ability of interviewers to assess the applicants’ skills between the two types of interviews. For both interviewers and applicants, video interviews, compared to in person interview, had a lower average score for connecting personally & establishing rapport and for satisfaction with administrative arrangements. Video interviewed applicants had a 50% probability of getting accepted in a program compared to 22% of in person interviewed candidates. We conclude that video interviews appear to be a valuable alternative to in-person interviews, with some sacrifice in personal connection and rapport. Video interviews result in significant time and cost savings for international applicants and have potential implications for the CaRMS process as well. Sackett KM, Campbell-Heider N, Blyth JB. The evolution and evaluation of videoconferencing technology for graduate nursing education. Comput Inform Nurs. 2004 (Mar-Apr); 22(2):101-6. Shepherd L, Goldstein D, Whitford H, Thewes B, Brummell V, Hicks M. The utility of videoconferencing to provide innovative delivery of psychological treatment for rural cancer patients: results of a pilot study. J Pain Symptom Manage 2006 (Nov); 32(5):453-61. Arena J, Dennis N, Devineni T, Maclean R, Meador K. A pilot study of feasibility and efficacy of telemedicine-delivered psychophysiological treatment for vascular headache. Telemed J E Health 2004 (Winter); 10(4):449-54.

scholarly journals Online News and Protest Participation in a Political Context: Evidence from Self-Reported Cross-Sectional Data

2021 ◽  
Vol 7 (1) ◽  
pp. 205630512098445
Author(s):  
Nora Kirkizh ◽  
Olessia Koltsova
Keyword(s):  
Digital Media ◽  
Regression Models ◽  
Online News ◽  
Political Context ◽  
Government Control ◽  
Multilevel Regression ◽  
Traditional Media ◽  
Cross Sectional ◽  
Internet Media ◽  
The Relationship

Availability of alternative information through social media, in particular, and digital media, in general, is often said to induce social discontent, especially in states where traditional media are under government control. But does this relation really exist, and is it generalizable? This article explores the relationship between self-reported online news consumption and protest participation across 48 nations in 2010–2014. Based on multilevel regression models and simulations, the analysis provides evidence that those respondents who reported that they had attended a protest at least once read news online daily or weekly. The study also shows that the magnitude of the effect varies depending on the political context: surprisingly, despite supposedly unlimited control of offline and online media, autocratic countries demonstrated higher effects of online news than transitional regimes, where the Internet media are relatively uninhibited.

scholarly journals Community-Level Sports Group Participation and Health Behaviors Among Older Non-Participants in a Sports Group: A Multilevel Cross-Sectional Study

2021 ◽  
Vol 18 (2) ◽  
pp. 531
Author(s):  
Taishi Tsuji ◽  
Satoru Kanamori ◽  
Yasuhiro Miyaguni ◽  
Katsunori Kondo
Keyword(s):  
Behavior Change ◽  
Transtheoretical Model ◽  
Community Level ◽  
Older Individuals ◽  
Multilevel Regression ◽  
Cross Sectional ◽  
Partial Regression Coefficient ◽  
Group Participation ◽  
High Prevalence ◽  
The Relationship

This study validates the relationship between community-level sports group participation and the frequency of leaving the house and transtheoretical model stages of behavior change for exercise among older individuals who did not participate in a sports group. We used cross-sectional data from the 2016 Japan Gerontological Evaluation Study. The proportion of sports group participants at the community level was calculated using the data from 157,233 older individuals living in 1000 communities. We conducted a multilevel regression analysis to examine the relationship between the proportion of sports group participants and the frequency of leaving the house (1 day/week or less) and the transtheoretical model stages of behavior change for exercise. A statistically significant relationship was observed between a high prevalence of sports group participation and lower risk of homeboundness (odds ratio: 0.94) and high transtheoretical model stages (partial regression coefficient: 0.06) as estimated by 10 percentage points of participation proportion. Older individuals, even those not participating in a sports group, living in a community with a high prevalence of sports group participation are less likely to be homebound; they are highly interested and have numerous opportunities to engage in exercise.

scholarly journals Endoscopic Sphenopalatine Artery Ligation: General Applicability in a Teaching Unit

2019 ◽  
Vol 98 (2) ◽  
pp. 85-88 ◽  
Author(s):  
Shi Ying Hey ◽  
Nigel K. F. Koo Ng ◽  
Gerald W. McGarry
Keyword(s):  
Grade Level ◽  
Teaching Hospitals ◽  
Artery Ligation ◽  
General Applicability ◽  
Sphenopalatine Artery ◽  
The United Kingdom ◽  
Simulation Based ◽  
Teaching Unit ◽  
Competency Based ◽  
Nose And Throat

Background: Endoscopic sphenopalatine artery ligation (ESPAL) is the intervention of choice for refractory epistaxis in specialist ear, nose and throat (ENT)units and should be within the repertoire of competencies for all ENT trainees. Following its recent incorporation within the United Kingdom competency–based training syllabus as an explicit outcome standard, the ESPAL is not uncommonly being delivered by trainees under appropriate supervision. We assessed the efficacy and outcome of ESPAL in epistaxis management within our teaching hospitals. Methods: Retrospective, structured review of all ESPAL procedures performed for epistaxis between December 2005 and December 2013. The techniques of ligation, operator grade, and outcome were studied. Results: Sixty-five patients (41 male:24 female; average age of 58.2 years) were identified in whom 67 artery ligations were performed (63 unilateral; 2 bilateral). Overall, success rate of ESPAL was 92.3% (60/65), with 5 rebleed cases recorded within 30 days of the primary procedure. Sixteen (24.6%) underwent “clipping,” 26 (40.0%) had diathermy ligation, 18 (27.7%) had both clipping and diathermy, and in 5 (7.7%) patients, the ligation technique was not recorded. In 31 (47.7%) of 65 cases, a consultant was the principal surgeon. The remaining 34 (52.3%) of 65 cases were performed by trainees with (24, 70.6%) or without (10, 29.4%) supervision. There was no correlation between rebleed and operators’ grade, level of supervision, or ligation technique. Conclusion: With appropriate training, ESPAL can achieve hemostasis in teams of varying grades of operators without significant reduction in outcome. To further enhance the technical learning curve, the utility of simulation-based training could offer continuous and longitudinal development of skills.

Trosbaserade organisationer och professionsutveckling

2021 ◽  
Vol 8 ◽  
Author(s):  
Mikael Hallenius
Keyword(s):  
Professional Development ◽  
Practical Theology ◽  
Lessons Learned ◽  
Critical Reading ◽  
Religious Identities ◽  
Faith Based ◽  
Ibn Rushd ◽  
Is Theory ◽  
Faith Based Organizations ◽  
The Relationship

Faith-based organizations and professional development: A case for practical theology? The question discussed in this article is: “in what ways can perspectives from practical theology  contribute to the study of professional development within faith-based organizations? To an swer this question, I present my critical reading of the report, När tilliten prövas: En studie av  studieförbundet Ibn Rushd samhällsbidrag (2019) and the results are analyzed utilizing per spectives from practical theology. My method is theory-testing critical reading where I search  for and present concepts in the report concerning 1) What is said of religion in the relationship  between religion and society in the report? 2) Which perspectives are raised in the report con cerning stakeholders, staff, and visitors/participants behavior? Finally, using perspectives from  practical theology, I outline two answers addressing what professional development in faith based organizations is and how practical theology can contribute in this field. Firstly, I propose  that professional development in faith-based professions occurs when one’s own and other’s  expression of intentional religion is perceived as one of many positive assets from the onset.  Practical theology has the resources to both study and develop knowledge in these processes.  Secondly, I claim that practical theology has resources to identify and utilize lessons learned  from other professions with clear religious identities. Their experiences should be of interest  for actors dealing with similar challenges and for society in general. Professional development  in faith-based organizations is a case for practical theology.  

Regional government R&D investment and innovation performance: the moderating effect of geographical and organizational proximities

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Dongyun Zhu ◽  
Bingfen Xu
Keyword(s):  
Moderating Effect ◽  
Innovation Performance ◽  
Regional Government ◽  
Multilevel Regression ◽  
Regional Innovation ◽  
Government Investment ◽  
Content Type ◽  
Organizational Proximity ◽  
The Relationship ◽  
D Investment

Purpose This study aims to measure the moderating effect of geographical and organizational proximity by focusing on readily available Chinese regional economic data over a five-year period. Design/methodology/approach The authors used multilevel regression analysis to analyze the relationship. Findings Results show that increasing government investment in research and development (R&D) can improve innovation performance during this period, organizational proximity and geographic proximity have a positive moderate effect on the relationship between R&D investment and Innovation performance. Originality/value This study enriches the existing theories on government innovation input and output from the perspective of regional differences and provides meaningful guidance for current Chinese regional innovation policies.

Lessons Learned … About Curriculum: Five Years on and Half a World Away

2005 ◽  
Vol 24 (2) ◽  
pp. 111-126 ◽  
Author(s):  
Doune Macdonald ◽  
Lisa Hunter
Keyword(s):  
Physical Education ◽  
Lessons Learned ◽  
National Standards ◽  
Primary Field ◽  
Health And Physical Education ◽  
Construction Of Knowledge ◽  
The Social ◽  
Social Construction Of Knowledge ◽  
The Relationship ◽  
Selection Of

The knowledge, skills, and attitudes manifested in health and physical education school curricula are an arbitrary selection of that which is known and valued at a particular place and time. Bernstein’s (2000) theories of the social construction of knowledge offer a way to better understand the relationship between the production, selection, and reproduction of curricular knowledge. This article overviews contemporary knowledge in the primary field (production) upon which curriculum writers in the recontextualizing field may draw. It highlights tensions in the knowledge generated within the primary field and, using a case of the USA’s National Standards for Physical Education (NASPE), demonstrates how particular discourses become privileged when translated into curriculum documents in the recontextualizing field.

scholarly journals A search for entrustable professional activities for the 1st year pathology postgraduate trainees

2018 ◽  
Vol 10 (01) ◽  
pp. 026-030 ◽  
Author(s):  
Pooja Sharma ◽  
Nadeem Tanveer ◽  
Aditi Goyal
Keyword(s):  
Medical Education ◽  
Training Program ◽  
Paradigm Shift ◽  
Entrustable Professional Activities ◽  
Average Score ◽  
Professional Activities ◽  
The Past ◽  
Cumulative Score ◽  
Competency Based ◽  
The Right

Abstract INTRODUCTION: During the past decade, there has been a paradigm shift in medical education from the problem-based learning to competency-based training. This has forced a rethink on the way we evaluate the residents and finally give them the right to handle patients independently. This study makes the first attempt towards designing competency-based training program for pathology residents by formulating the entrustable professional activities (EPAs) for the 1st year pathology residents. MATERIALS AND METHODS: A questionnaire comprising 18 potential EPAs in histopathology and 12 potential EPAs in cytology were circulated among the residents of Pathology Department. The respondents were asked to grade the EPAs on a scale of 0–4 based on how important they considered that activity as EPA. The cumulative score of each EPA was divided by the number of respondents to arrive at the average score. The EPAs with an average score of 3 or more qualified to be shortlisted as consensus EPAs. RESULTS: Five activities each of histopathology and cytopathology had an average score of 3 or above and were shortlisted as EPAs for the 1st year pathology postgraduates. Each of these was also mapped to their respective competencies. CONCLUSION: There is an urgent need to restructure the postgraduate pathology curriculum in line with competency-based training. This study is the first step in this direction.

Sign in / Sign up

Export Citation Format

Share Document