scholarly journals Assessing professional competence: a critical review of the Annual Review of Competence Progression

2019 ◽  
Vol 112 (6) ◽  
pp. 236-244 ◽  
Author(s):  
Katherine Woolf ◽  
Michael Page ◽  
Rowena Viney

The Annual Review of Competence Progression is used to determine whether trainee doctors in the United Kingdom are safe and competent to progress to the next training stage. In this article we provide evidence to inform recommendations to enhance the validity of the summative and formative elements of the Annual Review of Competency Progression. The work was commissioned as part of a Health Education England review. We systematic searched the peer reviewed and grey literature, synthesising findings with information from national, local and specialty-specific Annual Review of Competence Progression guidance, critically evaluating the findings in the context of literature on assessing competence in medical education. National guidance lacked detail resulting in variability across locations and specialties, threatening validity and reliability. Trainees and trainers were concerned that the Annual Review of Competence Progression only reliably identifies the most poorly performing trainees. Feedback is not routinely provided, which can leave those with performance difficulties unsupported and high performers demotivated. Variability in the provision and quality of feedback can negatively affect learning. The Annual Review of Competence Progression functions as a high-stakes assessment, likely to have a significant impact on patient care. It should be subject to the same rigorous evaluation as other high-stakes assessments; there should be consistency in procedures across locations, specialties and grades; and all trainees should receive high-quality feedback.

2020 ◽  
Author(s):  
Aline Rissatto Teixeira ◽  
Daniela Bicalho ◽  
Betzabeth Slater ◽  
Tacio de Mendonça Lima

AbstractBackgroundCulinary skills and food practices are important objects of study in the field of Public Health. Studies that propose to develop instruments for assessing such constructs show lack of methodological uniformity to provide evidence of validity and reliability of their instruments.ObjectiveTo identify studies that have developed instruments to measure culinary skills and other related concepts in adult population, and critically assess their psychometric properties.DesignA systematic review was conducted. A literature search was performed in PubMed/Medline, Scopus, LILACS, and Web of Science databases until June 2019. The Directory of Open Access Journals and Google Scholar databases were searched to identify relevant grey literature. Searching, selecting and reporting were done according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Statement. Two reviewers were independently involved in study selection, data extraction, and instrument quality assessment. A third reviewer resolved all disagreements.ResultsThe search identified 1428 potentially relevant studies, out of which 18 had potentially relevant records and 8 met the inclusion criteria. Studies used literature, experts’ judgement, or qualitative interviews to develop the instruments. No studies received positive scores for all validity criteria. Although most studies received positive scores for internal consistency, none of them received positive scores for stability or presented evidence for content validity. One study showed positive results for construct validity. Two studies reported criterion validity, whose scores were deemed negative.ConclusionsMany studies that surveyed culinary skills and related latent phenomena were identified. The overall quality of the psychometric properties of most instruments was considered insufficient, especially for validity measures. A universal definition of culinary skills as an overarching construct is recommended. The flaws observed in these studies show that there is a need for ongoing research in the area of the psychometric properties of instruments assessing these constructs.


2021 ◽  
Vol 3 (2) ◽  
Author(s):  
Urbanus Ura Weruin ◽  
Lerbin Aritonang ◽  
Miharni Tjokro Saputro ◽  
Herlina Budiono

Classroom Action Research (CAR) is a scientific observation of classroom learning practices. As part of action research, research is intended as input, evaluation, and improvement of the quality of learning in the classroom. CAR training is important and relevant for the following reasons. First, CAR can improve the quality of education through improving the quality of the learning process. Second, motivating teachers to research and produce scientific works from the environment of daily learning activities. Third, improve the competency standards of teachers; especially pedagogical competence and professional competence. Fourth, stimulate the critical power and sensitivity of teachers to the dynamics of classroom learning. The Cycle of CAR starts from the planning, implementation, observation, and reflection stages. The instrument to analyze classroom action research data is SPSS. CAR Training using SPSS is needed because some teachers are not familiar using SPSS to measure the learning process in class. The teachers of SMK Santo Leo felt the need to receive this training. This PKM activity was carried out to enhanced teacher’s knowledge and skills to used SPSS in classroom action research. The results were that the teachers appreciated this activity and welcomed it positively. They are able to understand classroom action research procedures; able to compile a research proposal; compile a research questionnaire; and able to determine data analysis tools using SPSS. The following training stage is to provide assistance to teachers in conducting research practices and analyzing data so the theoretical knowledge and skills they acquire can be applied.  ABSTRAKPenelitian Tindakan Kelas (PTK) merupakan observasi ilmiah terhadap praktik pembelajaran di kelas. Sebagai bagian dari action research, penelitian terhadap kegiatan pembelajaran tersebut dimaksudkan sebagai masukan, evaluasi, perbaikan, dan peningkatan mutu pembelajaran dalam kelas. Pelatihan PTK merupakan sesuatu yang penting dan relevan karena alasan-alasan berikut. Pertama, PTK dapat meningkatkan mutu pendidikan melalui peningkatan mutu proses pembelajaran. Kedua, memotivasi para guru untuk meneliti dan menghasilkan karya-karya ilmiah dari lingkungan kegiatan pembelajaran sehari-hari dalam kelas. Ketiga, meningkatkan standar kompetensi para guru; khususnya kompetensi pedagogik dan kompetensi profesional. Keempat, merangsang daya kritis dan kepekaan para guru terhadap dinamika pembelajaran di kelas. Siklus PTK dimulai dari tahap perencanaan, pelaksanaan, observasi, dan refleksi. Instrumen yang dapat dipakai untuk menganalisis data PTK sehingga hasil yang diperoleh akurat adalah dengan menggunakan SPSS. Pelatihan PTK dengan menggunakan SPSS perlu dilakukan karena sebagian guru belum terbiasa menggunakan SPSS untuk mengukur proses belajar di kelas. Guru-guru SMK Santo Leo merasa perlu mendapatkan pelatihan tentang penelitian tindakan kelas dengan menggunakan SPSS. Maka kegiatan PKM ini dilakukan untuk memberikan pengetahuan dan keterampilan menggunakan SPSS dalam melakukan penelitian tindakan kelas. Hasilnya adalah guru-guru mengapresiasi kegiatan PKM ini dan menyambut positif. Mereka semakin mampu memahami prosedur penelitian tindakan kelas; mampu menyusun proposal penelitian; menyusun kuesioner penelitian; serta mampu menentukan alat analisis data dengan menggunakan SPSS. Tahap pelatihan berikut yang perlu dilakukan adalah melakukan pendampingan terhadap para guru dalam melakukan praktik penelitian dan menganalisis data sehingga pengetahuan dan keterampilan teoretis yang mereka peroleh dapat diaplikasikan.


PLoS ONE ◽  
2021 ◽  
Vol 16 (8) ◽  
pp. e0235182
Author(s):  
Aline Rissatto Teixeira ◽  
Daniela Bicalho ◽  
Betzabeth Slater ◽  
Tacio de Mendonça Lima

Background Culinary skills are important objects of study in the field of Public Health. Studies that propose to develop instruments for assessing such construct show lack of methodological uniformity to report validity and reliability of their instruments. Objective To identify studies that have developed instruments to measure culinary skills in adult population, and critically assess their psychometric properties. Design We conducted a systematic review according to the PRISMA statement. We searched literature PubMed/Medline, Scopus, LILACS, and Web of Science databases until January 2021, and consulted Google Scholar for relevant grey literature. Two reviewers independently selected the studies, conducted data extraction, and assessed the psychometric quality of the instruments. A third reviewer resolved any doubts or disagreements in all steps of the systematic review. Results The search identified 1148 potentially relevant studies, out of which 9 met the inclusion criteria. In addition, we included 3 studies by searching the related articles and the reference lists of these studies, totaling 12 included studies in this review. Ten studies reported the development of tools measuring culinary skills in adults and 2 studies performed cross-cultural adaptations of original instruments. We considered adequate quality of internal consistency reliability in four studies. One study received adequate rating for test-retest reliability. No studies presented adequate rating for content validity and four studies showed satisfactory results for at least one type of construct validity. One study reported criterion validity and the quality of this psychometric property was inadequate. Conclusions We identified many studies that surveyed culinary skills. Although the isolated measures appraised in this review show good promise in terms of quality of psychometric properties, no studies presented adequate measures for each aspect of reliability and validity. A more consistent and consensual definition of culinary skills is recommended. The flaws observed in these studies show that there is a need for ongoing research in the area of the psychometric properties of instruments assessing culinary skills.


Author(s):  
Susi Minarsih ◽  
Ary Sutrischastini

The aims of this study are to measure the level of service quality and how to improve the quality of service execution in re-measurement tera and tera of UTTP in Commerce On duty Co-Operation, Industrial and Commerce Of Sub-Province of Pacitan. This research’s object is traditional market of Minulyo Pacitan as mains market in Sub-Province of Pacitan with 100 perpetrator people of sample as user/owner of UTTP (ukur,timbang, takar, dan perlengkapannya) with method intake of sampel by Convenience Sampling. The technique of collecting data uses questionnaires and direct interview. This research use qualitative analysis instrument test of validity and reliability to know valid or not and reliabel or not about the questions of questionnaire. Then, this research was done with Servqual method as instrument to do measurement of service quality. The measurement of service quality in Servqual method pursuant to five service dimension that is tangibles, responsiveness, realibility, assurance, and empathy. This research will be measured of gap 5 that is difference among performance and its expectation. Ad for yielded gap from a enumeration of Servqual 5 gap, -146 progressively lower him mount the quality of given service activities. Therefore, its needs the existence of priority repair of service quality, in this case is service of remeasurement tera and tera of UTTP at biggest difference or gap that is at variable of Responsiveness ( Energy Listen carefully) and attribute that has smallest difference that is – 0.44 at dimension question of variable of Tangibles ( Evidence Physical). Keyword: Quality Of Service, Method of Service Quality.


1970 ◽  
Vol 6 (1) ◽  
pp. 232-241
Author(s):  
Марина Лапіна

Статтю присвячено проблемам професійного навчання соціальних працівників, зокрема розглянуто психолого-педагогічні аспекти процесу підготовки висококваліфікованих фахівців. Зазначено що в професійній психології та педагогіці набуває поширення компетентнісний підхід до сучасної освіти. Акцентовано увагу на особистісно-орієнтованому та психолого-акмеологічному напрямках професійної освіти та навчання. Особистісні якості фахівця розглядаються як метапрофесійні компетенції, що забезпечують якість праці майбутнього соціального працівника. На основі аналізу специфіки підготовки фахівців соціономічних професій окреслено загальні напрями формування професійних компетенцій соціальних працівників: пріоритет професійно-особистісного розвитку для досягнення високого рівня професіоналізму фахівця; формування психологічної, особистісної та рефлексивної компетентності; практична зорієнтованість процесу навчання. Розглянуто методи та технології активного формування психологічної та особистісної компетентності фахівця в процесі професійного навчання, а саме методика контекстного (знаково-контекстного) навчання та психолого-акмеологічні методи та процедури професійного розвитку. Стверджується, що включення до навчального процесу інноваційних, заснованих на взаємодії педагога та учня, психолого-педагогічних технологій активного навчання має формувати особистісні зони розвитку майбутніх фахівців, удосконалювати способи та засоби професійного становлення, що значно підвищує якість професійного навчання соціальних працівників. The article deals with the problems of vocational training of social workers. They are particularly considered with psychological and pedagogical aspects of training highly qualified specialists. It specifies that competence-based approach to modern education gets spreading in the professional psychology and pedagogy. The article is accented on personality-oriented and psycho-akmeological directions existing in the psychology of professional education and training. Personal qualities of the professional are considered as metaprofessional competences which ensure the future social worker’s quality of work. The general directions of formation professional competence of social workers are identified on the base of the analyses of the specific professional training socionomic professions: priority of vocational and personality development for achievement a high level of professionalism; formation of the psychological, personal and reflective competence; practical orientation of the learning process. The methods and technologies of active formation of psychological and personality’s competence of the specialist during the vocational training are reviewed in the article, specifically the method and technique of signed-contextual learning and psycho-akmeological methods and procedures of professional development. It is alleged that the inclusion in the educational process of preparation innovational, psychological and pedagogical techniques of active learning, based on the interaction between the teacher and the student, should generated personal’s development zones of the future professionals, refine the methods and means of the professional development that significantly improves the quality of social worker’s professional training.


2014 ◽  
Vol 4 (2) ◽  
pp. 84-89
Author(s):  
Inna Pododimenko

Abstract The problem of professional training of skilled human personnel in the industry of information communication technology, the urgency of which is recognized at the state level of Ukraine and the world, has been considered. It has been traced that constantly growing requirements of the labour market, swift scientific progress require the use of innovative approaches to the training of future ІТ specialists with the aim to increase their professional level. The content of standards of professional training and development of information technologies specialists in foreign countries, particularly in Japan, has been analyzed and generalized. On the basis of analysis of educational and professional standards of Japan, basic requirements to the engineer in industry of information communication technology in the conditions of competitive environment at the labour market have been comprehensively characterized. The competencies that graduate students of educational qualification level of bachelor in the conditions of new state policy concerning upgrading the quality of higher education have been considered. The constituents of professional competence in the structure of an engineer-programmer’s personality, necessary on different levels of professional improvement of a specialist for the development of community of highly skilled ІТ specialists, have been summarized. Positive features of foreign experience and the possibility of their implementation into the native educational space have been distinguished. Directions for modernization and upgrading of the quality of higher education in Ukraine and the prospects for further scientific research concerning the practice of specialists in information technologies training have been suggested


2021 ◽  
Vol 10 (1) ◽  
Author(s):  
Gabriela Elis Wachholz ◽  
Julia do Amaral Gomes ◽  
Juliano André Boquett ◽  
Fernanda Sales Luiz Vianna ◽  
Lavínia Schuler-Faccini ◽  
...  

Abstract Background Due to the diversity of studies in animal models reporting that molecular mechanisms are involved in the teratogenic effect of the Zika virus (ZIKV), the objective of the present study is to evaluate the methodological quality of these studies, as well as to demonstrate which genes and which molecular pathways are affected by ZIKV in different animal models. Methods This search will be performed in four databases: PubMed/MEDLINE, EMBASE, Web of Science, and Scopus, as well as in the grey literature. The studies selection process will be reported through the PRISMA Statement diagram model. All studies describing the molecular mechanisms possibly involved in the development of malformations caused by embryonic/fetal ZIKV exposure in animal models with an appropriate control group and methodology will be included (including, for instance, randomized and non-randomized studies). All animals used as experimental models for ZIKV teratogenesis may be included as long as exposure to the virus occurred during the embryonic/fetal period. From the selected studies, data will be extracted using a previously prepared standard form. Bias risk evaluation will be conducted following the SYRCLE’s Risk of Bias tool. All data obtained will be tabulated and organized by outcomes (morphological and molecular). Discussion With the proposed systematic review, we expect to present results about the methodological quality of the published studies with animal models that investigated the molecular mechanisms involved in the teratogenic effect of ZIKV, as well as to show the studies with greater reliability. Systematic review registration PROSPERO CRD42019157316


BMJ Open ◽  
2021 ◽  
Vol 11 (5) ◽  
pp. e047102
Author(s):  
Gemma Louch ◽  
Abigail Albutt ◽  
Joanna Harlow-Trigg ◽  
Sally Moore ◽  
Kate Smyth ◽  
...  

ObjectivesTo produce a narrative synthesis of published academic and grey literature focusing on patient safety outcomes for people with learning disabilities in an acute hospital setting.DesignScoping review with narrative synthesis.MethodsThe review followed the six stages of the Arksey and O’Malley framework. We searched four research databases from January 2000 to March 2021, in addition to handsearching and backwards searching using terms relating to our eligibility criteria—patient safety and adverse events, learning disability and hospital setting. Following stakeholder input, we searched grey literature databases and specific websites of known organisations until March 2020. Potentially relevant articles and grey literature materials were screened against the eligibility criteria. Findings were extracted and collated in data charting forms.Results45 academic articles and 33 grey literature materials were included, and we organised the findings around six concepts: (1) adverse events, patient safety and quality of care; (2) maternal and infant outcomes; (3) postoperative outcomes; (4) role of family and carers; (5) understanding needs in hospital and (6) supporting initiatives, recommendations and good practice examples. The findings suggest inequalities and inequities for a range of specific patient safety outcomes including adverse events, quality of care, maternal and infant outcomes and postoperative outcomes, in addition to potential protective factors, such as the roles of family and carers and the extent to which health professionals are able to understand the needs of people with learning disabilities.ConclusionPeople with learning disabilities appear to experience poorer patient safety outcomes in hospital. The involvement of family and carers, and understanding and effectively meeting the needs of people with learning disabilities may play a protective role. Promising interventions and examples of good practice exist, however many of these have not been implemented consistently and warrant further robust evaluation.


2021 ◽  
pp. 1476718X2096974
Author(s):  
Sara Cervantes ◽  
Anna Öqvist

Preschool teachers and caregivers have a close working relationship as part of a working team to benefit the children in Swedish preschools. In 2011, a new educational reform was introduced according to which preschools became a school form in their own right within the overall educational system in Sweden. The objective of the policy was to strengthen the profession of preschool teachers by affording them clearer responsibility over the quality of educational practices and curriculum work. It also entailed a division of labour between the preschool teachers and caregivers in the working team. The current study explored how Swedish preschool teachers and caregivers positioned themselves in response to these changes in responsibility. In this qualitative study, data were collected from 17 preschool teachers and caregivers via an open-ended questionnaire. Preschool teachers and caregivers viewed themselves as having equal responsibility in the working team. Specifically, preschool teachers upgraded the competence and position of caregivers while downgrading their own professional competence and position. Caregivers downgraded the profession and position of preschool teachers and upgraded their own competence and position to be equal to that of preschool teachers.


Sign in / Sign up

Export Citation Format

Share Document