scholarly journals Introducing a clerkship curriculum based on entrustable professional activities: a pilot study

2020 ◽  
Author(s):  
Severin Pinilla ◽  
Andrea Cantisani ◽  
Stefan Klöppel ◽  
Werner Strik ◽  
Christoph Nissen ◽  
...  

Abstract BackgroundGeneral clerkship quality criteria have not been studied after introducing a curriculum based on entrustable professional activities (EPAs). Therefore, we conducted a pilot study to explore educational outcomes of an EPA-based clerkship curriculum reform.MethodsWe collected multiple self-assessment and evaluation data on levels 1-3 of the New World Kirkpatrick model (KPM). For level 1 (reaction) we analyzed curriculum evaluations and verbal and written students’ feedback. For level 2 (learning) pre- and post-clerkship self-assessments of perceived need for supervision for each EPA and students’ written learning reflections based on patient mix exposure were analyzed. For level 3 (behavior) we evaluated workplace-based assessments.ResultsThe first student cohort in the new EPA-based clerkship completed 180 self-assessments (18 per student) of need for supervision and 63 documented workplace-based assessments (average of 6.3 per student in four weeks). On KPM level 1 we saw a high overall satisfaction with the clerkship (average of 4.9, range: 4.0-5.0 on a 5-point Likert scale). In written evaluations and feedback rounds students pointed out the importance of structured bedside teaching in the first clerkship week. On KPM level 2 the overall decrease of self-assessed need for supervision before and after the clerkship was two supervision levels (from direct to indirect supervision) and statistically significant (p < 0.05). For three EPAs students reached indirect supervision levels. Learning reflections and patient mix analysis indicated that students were exposed to a wide range of diagnostic categories (ICD-10: F0 – F6) and received actionable feedback for communication skills. On KPM level 3 clinical supervisors predominantly used EPAs 1 (History taking), 2 (Assessing mental status) and 8 (Documentation and presentation) for workplace-based assessments. We saw a decreasing need for supervision from the first to the last week in the clerkship according to the supervisors’ judgements.ConclusionStudents reacted positively to introducing an EPA-based clerkship curriculum. The EPA-oriented formative self-assessments and workplace-based assessments seemed to support achievement of competency-based learning goals. However, more in-depth understanding of the entrustment process in the clerkship context is necessary to fully leverage the potential of an EPA-based clerkship.

Author(s):  
Severin Pinilla ◽  
Andrea Cantisani ◽  
Stefan Klöppel ◽  
Werner Strik ◽  
Christoph Nissen ◽  
...  

Abstract Objective The authors evaluated a reformed psychiatry clerkship curriculum based on entrustable professional activities (EPAs). Methods The authors conducted an exploratory pilot study of a reformed clerkship curriculum based on EPAs. A novel workplace-based assessment format including an entrustment-supervision scale and curricular adaptations were introduced. The Kirkpatrick model was used to evaluate outcomes of the reformed clerkship curriculum on three levels (1 = acceptance, 2 = learning, 3 = change of behavior). Results The pilot student cohort (n = 10) completed a questionnaire, 180 self-assessments (18 per student) on need for supervision, and 63 workplace-based assessments (6.3 per student, in 4 weeks). Level 1: high overall satisfaction with the clerkship (five-point Likert item: average, 4.9; range: 4.0–5.0). Level 2: the overall significant decrease in self-assessed need for supervision before and after the clerkship was two supervision levels (direct to indirect supervision; p < 0.05). The most frequently documented admissions included schizophrenic disorders (n = 11; 28%), affective disorders (n = 10; 25%), substance abuse disorders (n = 5; 13%), and anxiety and stress-related disorders (n = 5; 13%). Level 3: clinical supervisors used history taking, assessing the mental status, and documentation and presentation for workplace-based assessments. According to supervisors’ ratings, there was a decreasing need for supervision from the first to last week of the clerkship. Conclusions Students reacted positively to the reformed clerkship curriculum. The workplace-based assessments with entrustment ratings appeared to support achievement of competency-based learning objectives. Better understanding of how to cover assessment of all core EPAs in the psychiatry clerkship is needed.


Author(s):  
Lania Muharsih ◽  
Ratih Saraswati

This study aims to determine the training evaluation at PT. Kujang Fertilizer. PT. Pupuk Kujang is a company engaged in the field of petrochemicals. Evaluation sheet of PT. Fertilizer Kujang is made based on Kirkpatrick's theory which consists of four levels of evaluation, namely reaction, learning, behavior, and results. At level 1, namely reaction, in the evaluation sheet is in accordance with the theory of Kirkpatrick, at level 2 that is learning should be held pretest and posttest but only made scale. At level 3, behavior, according to theory, but on assessment factor number 3, quantity and work productivity should not need to be included because they are included in level 4. At level 4, that is the result, here is still lacking to get a picture of the results of the training that has been carried out because only based on answers from superiors without evidence of any documents.   Keywords: Training Evaluation, Kirkpatrick Theory.    Penelitian ini bertujuan mengetahui evaluasi training di PT. Pupuk Kujang. PT. Pupuk Kujang merupakan perusahaan yang bergerak di bidang petrokimia. Lembar evaluasi PT. Pupuk Kujang dibuat berdasarkan teori Kirkpatrick yang terdiri dari empat level evaluasi, yaitu reaksi, learning, behavior, dan hasil. Pada level 1 yaitu reaksi, di lembar evaluasi tersebut sudah sesuai dengan teori dari Kirkpatrick, pada level 2 yaitu learning seharusnya diadakan pretest dan posttest namun hanya dibuatkan skala. Pada level 3 yaitu behavior, sudah sesuai teori namun pada faktor penilaian nomor 3 kuantitas dan produktivitas kerja semestinya tidak perlu dimasukkan karena sudah termasuk ke dalam level 4. Pada level 4 yaitu hasil, disini masih sangat kurang untuk mendapatkan gambaran hasil dari pelatihan yang sudah dilaksanakan karena hanya berdasarkan dari jawaban atasan tanpa bukti dokumen apapun.   Kata kunci: Evaluasi Pelatihan, Teori Kirkpatrick.


Atmosphere ◽  
2021 ◽  
Vol 12 (7) ◽  
pp. 869
Author(s):  
Xiuguo Zou ◽  
Jiahong Wu ◽  
Zhibin Cao ◽  
Yan Qian ◽  
Shixiu Zhang ◽  
...  

In order to adequately characterize the visual characteristics of atmospheric visibility and overcome the disadvantages of the traditional atmospheric visibility measurement method with significant dependence on preset reference objects, high cost, and complicated steps, this paper proposed an ensemble learning method for atmospheric visibility grading based on deep neural network and stochastic weight averaging. An experiment was conducted using the scene of an expressway, and three visibility levels were set, i.e., Level 1, Level 2, and Level 3. Firstly, the EfficientNet was transferred to extract the abstract features of the images. Then, training and grading were performed on the feature sets through the SoftMax regression model. Subsequently, the feature sets were ensembled using the method of stochastic weight averaging to obtain the atmospheric visibility grading model. The obtained datasets were input into the grading model and tested. The grading model classified the results into three categories, with the grading accuracy being 95.00%, 89.45%, and 90.91%, respectively, and the average accuracy of 91.79%. The results obtained by the proposed method were compared with those obtained by the existing methods, and the proposed method showed better performance than those of other methods. This method can be used to classify the atmospheric visibility of traffic and reduce the incidence of traffic accidents caused by atmospheric visibility.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Severin Pinilla ◽  
Alexandra Kyrou ◽  
Stefan Klöppel ◽  
Werner Strik ◽  
Christoph Nissen ◽  
...  

Abstract Background Entrustable professional activities (EPAs) in competency-based, undergraduate medical education (UME) have led to new formative workplace-based assessments (WBA) using entrustment-supervision scales in clerkships. We conducted an observational, prospective cohort study to explore the usefulness of a WBA designed to assess core EPAs in a psychiatry clerkship. Methods We analyzed changes in self-entrustment ratings of students and the supervisors’ ratings per EPA. Timing and frequencies of learner-initiated WBAs based on a prospective entrustment-supervision scale and resultant narrative feedback were analyzed quantitatively and qualitatively. Predictors for indirect supervision levels were explored via regression analysis, and narrative feedback was coded using thematic content analysis. Students evaluated the WBA after each clerkship rotation. Results EPA 1 (“Take a patient’s history”), EPA 2 (“Assess physical & mental status”) and EPA 8 (“Document & present a clinical encounter”) were most frequently used for learner-initiated WBAs throughout the clerkship rotations in a sample of 83 students. Clinical residents signed off on the majority of the WBAs (71%). EPAs 1, 2, and 8 showed the largest increases in self-entrustment and received most of the indirect supervision level ratings. We found a moderate, positive correlation between self-entrusted supervision levels at the end of the clerkship and the number of documented entrustment-supervision ratings per EPA (p < 0.0001). The number of entrustment ratings explained 6.5% of the variance in the supervisors’ ratings for EPA 1. Narrative feedback was documented for 79% (n = 214) of the WBAs. Most narratives addressed the Medical Expert role (77%, n = 208) and used reinforcement (59%, n = 161) as a feedback strategy. Students perceived the feedback as beneficial. Conclusions Using formative WBAs with an entrustment-supervision scale and prompts for written feedback facilitated targeted, high-quality feedback and effectively supported students’ development toward self-entrusted, indirect supervision levels.


Author(s):  
C. H. Luk ◽  
T. J. Wang

Engineering Criticality Assessment (ECA) is a procedure based on fracture mechanics that may be used to supplement the traditional S-N approach and determine the flaw acceptance and inspection criteria in fatigue and fracture design of risers and flowlines. A number of design codes provide guidance for this procedure, e.g. BS-7910:2005 [1]. However, more investigations and example studies are still needed to address the design implications for riser and flowline applications. This paper provides a review of the existing ECA methodology, presents a fracture mechanics design method for a wide range of riser and flowline fatigue problems, and shows flaw size results from steel catenary riser (SCR) and flowline (FL) examples. The first example is a deepwater SCR subjected to fatigue loads due to vessel motion and riser VIV. The second example is a subsea flowline subjected to thermal fatigue loads. The effects of crack re-characterization and material plasticity on the Level-2 and Level-3 ECA results of the SCR and flowline examples are illustrated.


2002 ◽  
Vol 6 (2) ◽  
pp. 185-219 ◽  
Author(s):  
Adam Ockelford

Like all fields of human artistic endeavour, music is constrained by our cognitive processing requirements and limitations (Swain, 1986; Lerdahl, 1988; Huron, 2001). This articleconsiders particular forms of constraint pertaining to the relationships that the structure-seeking mind (subconsciously) fabricates between perceived musical events. It is proposed that 2±1 may be a universal limitation pertaining to the level of relationships so ideated. That is, in terms of Lewin'S (1987) theoretical framework in which “intervals” can be intuited between the “elements” of musical “spaces”, it is posited that the cognition of musical structure occurs either through intervals (level 1), through intervals between these (level 2), or — in some circumstances — through intervals between these(level 3). This proposition is explored through the psychomusicological model developed by Ockelford (1991, 1993, 1999), which too analyses musical structure in terms of the relationships that may be cognised between its discrete perceptual components. In particular, the model identifies a type of cognitive link through which events (at any level) arefelt to imply others the same or similar — through so-called “zygonic” relationships. This theory suggests a further general principle: that the highest level of relationship inoperation at any given point must be zygonic if the music is to be structurally coherent. Evidence for this, and for the limit on the level of relationships of 2±1, is offeredthrough a series of musical examples, which illustrate a variety of musical organisation in action. Finally, empirical work is suggested to explore further the theoretical ideas that arepresented here.


2003 ◽  
Vol 31 (6) ◽  
pp. 1472-1473 ◽  
Author(s):  
A. Finney ◽  
M. Hucka

The SBML (systems biology markup language) is a standard exchange format for computational models of biochemical networks. We continue developing SBML collaboratively with the modelling community to meet their evolving needs. The recently introduced SBML Level 2 includes several enhancements to the original Level 1, and features under development for SBML Level 3 include model composition, multistate chemical species and diagrams.


1994 ◽  
Vol 79 (2) ◽  
pp. 975-993 ◽  
Author(s):  
Alberto Montare

Following successful inductive acquisition of procedural cognition of a discrimination-reversal learning task, 50 female and 50 male undergraduates articulated declarative cognizance of knowledge acquired from learning. Tests of four hypotheses showed that (1) increasingly higher levels of declarative cognizance were associated with faster learning rates, (2) six new cases of cognition-without-cognizance were observed, (3) students presumably using secondary signalization learned faster than those presumably using primary signalization, and (4) no sex differences in learning rates or declarative cognizance were observed. The notion that explicit levels of declarative cognizance may represent implicit hierarchical conceptualization comprised of four systems of knowledge acquisition led to the conclusions that primary signalization may account for inductive senscept formation at Level 1 and for inductive percept formation at Level 2, whereas emergent secondary signalization may account for inductive precept formation at Level 3 and for inductive concept formation at Level 4.


2021 ◽  
Vol 13 (19) ◽  
pp. 4012
Author(s):  
Panpan Xu ◽  
Nandin-Erdene Tsendbazar ◽  
Martin Herold ◽  
Jan G. P. W. Clevers

The monitoring of Global Aquatic Land Cover (GALC) plays an essential role in protecting and restoring water-related ecosystems. Although many GALC datasets have been created before, a uniform and comprehensive GALC dataset is lacking to meet multiple user needs. This study aims to assess the effectiveness of using existing global datasets to develop a comprehensive and user-oriented GALC database and identify the gaps of current datasets in GALC mapping. Eight global datasets were reframed to construct a three-level (i.e., from general to detailed) prototype database for 2015, conforming with the United Nations Land Cover Classification System (LCCS)-based GALC characterization framework. An independent validation was done, and the overall results show some limitations of current datasets in comprehensive GALC mapping. The Level-1 map had considerable commission errors in delineating the general GALC distribution. The Level-2 maps were good at characterizing permanently flooded areas and natural aquatic types, while accuracies were poor in the mapping of temporarily flooded and waterlogged areas as well as artificial aquatic types; vegetated aquatic areas were also underestimated. The Level-3 maps were not sufficient in characterizing the detailed life form types (e.g., trees, shrubs) for aquatic land cover. However, the prototype GALC database is flexible to derive user-specific maps and has important values to aquatic ecosystem management. With the evolving earth observation opportunities, limitations in the current GALC characterization can be addressed in the future.


Teknika ◽  
2021 ◽  
Vol 10 (1) ◽  
pp. 78-87
Author(s):  
Angga Maulana Nurhuda ◽  
Ervan Philipus ◽  
Ivan Gunawan
Keyword(s):  
Level 3 ◽  
Level 1 ◽  
Level 2 ◽  

Peran sistem pendataan keluarga dalam rangka mendukung pencapaian program BANGGAKENCANA pada BKKBN Propinsi Jawa Barat adalah untuk menyediakan data dasar sebagai perencanaan strategis, peta kerja, maupun pemetaan mekanisme operasional menjadi krusial untuk menopang keberhasilan program. Untuk memastikan delivery produk, layanan, dan dukungan yang dihasilkan perlu dilakukan evaluasi sehingga dapat menghasilkan tata kelola sistem pendataan keluarga yang lebih optimal. Penelitian ini bertujuan untuk memperoleh ukuran capability level proses TI saat ini kemudian dibandingkan dengan yang diharapkan sehingga dapat diperoleh kesenjangan guna penyusunan rekomendasi yang dapat diimplementasikan pada Siklus Sistem Pendataan Keluarga Tahun 2021 dengan menggunakan kerangka kerja COBIT 5. Data yang diperoleh bersumber dari responden yang berwenang dan kompeten berdasarkan pemetaan diagram RACI pada COBIT 5. Dari hasil penelitian, diketahui bahwa dari 6 proses terpilih pada domain DSS terdapat 4 proses yang mencapai level 1 (performed) dan 2 proses yang berhasil mencapai level 2 (managed process). Tingkat kemampuan manajemen TI yang diharapkan berada pada level 3 sehingga GAP muncul di semua domain yang bermakna saat ini organisasi belum sepenuhnya mengimplementasikan proses yang ditetapkan untuk mencapai tujuan proses. Dari seluruh rangkaian penelitian tersebut dapat disimpulkan bahwa diperoleh nilai level kapabilitas sebesar 1,33 dan terdapat GAP sebesar 1,67 untuk mencapai level yang diharapkan. Dalam penelitian ini disampaikan rekomendasi untuk meningkatkan kapabilitas proses sehingga BKKBN Propinsi Jawa Barat dapat mencapai tingkat kapabilitas yang diharapkan.


Sign in / Sign up

Export Citation Format

Share Document