Exploring valid and reliable assessment methods for care management education

2016 ◽  
Vol 29 (3) ◽  
pp. 240-250 ◽  
Author(s):  
Lokke Gennissen ◽  
Lorette Stammen ◽  
Jolien Bueno-de-Mesquita ◽  
Sietse Wieringa ◽  
Jamiu Busari

Purpose It is assumed that the use of valid and reliable assessment methods can facilitate the development of medical residents’ management and leadership competencies. To justify this assertion, the perceptions of an expert panel of health care leaders were explored on assessment methods used for evaluating care management (CM) development in Dutch residency programs. This paper aims to investigate how assessors and trainees value these methods and examine for any inherent benefits or shortcomings when they are applied in practice. Design/methodology/approach A Delphi survey was conducted among members of the platform for medical leadership in The Netherlands. This panel of experts was made up of clinical educators, practitioners and residents interested in CM education. Findings Of the respondents, 40 (55.6 per cent) and 31 (43 per cent) participated in the first and second rounds of the Delphi survey, respectively. The respondents agreed that assessment methods currently being used to measure residents’ CM competencies were weak, though feasible for use in many residency programs. Multi-source feedback (MSF, 92.1 per cent), portfolio/e-portfolio (86.8 per cent) and knowledge testing (76.3 per cent) were identified as the most commonly known assessment methods with familiarity rates exceeding 75 per cent. Practical implications The findings suggested that an “assessment framework” comprising MSF, portfolios, individual process improvement projects or self-reflections and observations in clinical practice should be used to measure CM competencies in residents. Originality/value This study reaffirms the need for objective methods to assess CM skills in post-graduate medical education, as there was not a single assessment method that stood out as the best instrument.

2016 ◽  
Vol 54 (10) ◽  
pp. 2433-2446 ◽  
Author(s):  
José M. Mateu ◽  
Isidre March-Chorda

Purpose The purpose of this paper is to provide a more useful business models assessment method than the traditional intuitive one. The paper also compares both methods, in order to display what does the intuitive assessment method really assess. Design/methodology/approach An experimental approach allows the authors to generate a set of business models, in order to assess them and to compare alternative assessment methods in a quantitative manner. Findings The work proposes a scale for ex ante business models assessment consisting on eight indicators. This provides an ex ante assessment that takes into consideration a wider range of factors than the traditional intuitive assessment. The comparison between both methods shows which factors are intuitively taken into account and which are not. Research limitations/implications The research contributes to expand the business model creation framework. Practical implications A more accurate assessment will show the most promising business models that will result in higher chances of success of new business ventures. Social implications As companies and entrepreneurs hardly have the possibility to implement more than one business model, to choose the best option becomes essential. This selection could mark the threshold between success and failure, and between wealth creation and destruction. Originality/value Little research has been conducted in a field that might be really fruitful, the field of business model ex ante assessment. The work faces the challenge using an experimental methodology that allows to broaden the range of situations to study.


2019 ◽  
Vol 33 (1) ◽  
pp. 73-84
Author(s):  
Kamal Gulati ◽  
Angel Rajan Singh ◽  
Sachin Kumar ◽  
Vivek Verma ◽  
Shakti Kumar Gupta ◽  
...  

Purpose The purpose of this study was to evaluate the impact of leadership development programme on enhancing leadership competencies of physicians in India. Assessment of leadership competencies of physicians is critical for designing suitable leadership development programmes. The previous studies of authors have revealed significant gaps in leadership competencies among physicians in India. Hence, authors have designed a programme incorporating various facets of health-care leadership and evaluated its impact on improvement of leadership competencies of top- and mid-career level professionals. Design/methodology/approach A six-day offsite residential programme incorporating a three-day component of leadership development was organized, in which 96 physicians participated. A mix of pedagogical approaches was used. A pre- and post-assessment of 30 medical leadership competencies was done using a self-administered questionnaire. Findings Majority of participants (69%) scored their competencies at Level 3 and Level 4 (Average to Good) with a mean score ranging from 3.20 ± 0.85 to 4.12 ± 0.71 in the pre-assessment group. In contrast, in post-assessment, this shifted to Level 4 and Level 5 (Good to Very good) in 72% with mean scores ranging from 3.8 to 4.24. Statistically significant differentiation was noted in pre- and post-assessment mean scores for all 30 competencies. The maximum improvement was noted in Competency 29 “Information management system planning and implementation”, whereas the least improvement was noted in Competency 12 “Holding self and others accountable and responsible for organizational goal attainment”. Originality/value The authors believe that this is the first study from India to assess effectiveness of leadership development programmes on enhancing medical leadership competencies demonstrating positive outcome. The findings of this study can provide a roadmap for designing of future medical leadership development programmes for physicians in India.


Kybernetes ◽  
2020 ◽  
Vol 49 (11) ◽  
pp. 2713-2735 ◽  
Author(s):  
Xiaomin Fan ◽  
Yingzhi Xu ◽  
Yongqing Nan ◽  
Baoli Li ◽  
Haiya Cai

Purpose The purpose of this paper is to analyse the impact of high-speed railway (HSR) on industrial pollution emissions using the data for 285 prefecture-level cities in China from 2004 to 2016. Design/methodology/approach The research method used in this paper is the multi-period difference-in-differences (DID) model, which is an effective policy effect assessment method. To further address the issue of endogeneity, the DID integrated with the propensity score matching (PSM-DID) approach is employed to eliminate the potential self-selection bias. Findings The results show that the HSR has significantly reduced industrial pollution emissions, which is validated by several robustness tests. Compared with peripheral cities, HSR exerts a greater impact on industrial pollution emissions in central cities. In addition, the mechanism test reveals that the optimised allocation of inter-city industries is an important channel for HSR to mitigate industrial pollution emissions, and this is closely related to the location of HSR stations. Originality/value Previous studies have paid more attention to evaluating the economic effects of HSR, however, most of these studies overlook its environmental effects. Consequently, the impact of HSR on industrial pollution emissions is led by using multi-period DID models in this paper, in which the environmental effects are measured. The results of this paper can provide a reference for the pollution reduction policies and also the coordinated development of economic growth and environmental quality.


2002 ◽  
Vol 29 (1) ◽  
pp. 66-71 ◽  
Author(s):  
S. L. Rideout ◽  
T. B. Brenneman ◽  
K. L. Stevenson

Abstract Southern stem rot (caused by the soilborne fungus Sclerotium rolfsii Sacc.) of peanut (Arachis hypogaea L.) traditionally has been assessed based on the percentage of infected 30.5-cm row segments, commonly referred to as disease incidence. Several alternative disease assessment methods were evaluated in four fungicide trials during the growing season (aboveground ratings) and immediately after peanut inversion (belowground ratings). Pearson's correlation coefficients compared disease assessments and yields for all trials. Across all disease assessment methods, belowground assessments at inversion showed a stronger correlation with yield than in-season aboveground assessments. Several of the alternative assessment methods showed a stronger negative correlation with yield than did the traditional disease incidence rating. However, none of the alternative methods were consistently more precise across all assessment dates and trials. There was a significant positive correlation between many of the alternative methods and the traditional disease incidence method. Furthermore, none of the alternative methods was better than the traditional method for detecting differences among fungicide treatments when subjected to ANOVA and subsequent Waller-Duncan mean separation tests (k-ratio = 100). Based on comparisons of the time required to assess disease intensity, the traditional disease assessment method was found to be the most time efficient method of those tested in this study.


2011 ◽  
Vol 71-78 ◽  
pp. 3868-3873
Author(s):  
Li Jin Ma ◽  
Hong Juan Zou ◽  
Jia Shun Zhu

According to the micro-climate environment outdoor of the region, wind environment outdoor which is under planning programming can be done analog computation using computational fluid mechanics PHOENICS software. A set of comprehensive prediction and assessment system which is mainly focused on outdoor environment composite index WBGT can be established combining with assessment method on wind environment outdoor of predecessors in order to more accurately and humanly predict and assess the wind environment outdoor, bring safe, comfortable and healthy outdoor environment and provide references for the assessment and design of green residential district.


Author(s):  
Frances Cooke ◽  
Ashley Ramos ◽  
Linda Herbert

Abstract Objective Food allergy (FA) management requires youth to avoid allergens and carry emergency medication which can impact participation in social activities. Previous research indicates that some youth experience FA-related bullying, but many studies are limited by single-item assessment methods and a narrow definition of bullying. This study describes FA-related bullying among a diverse cohort of youth with FA and evaluates parent–child disagreement and bullying assessment methods. Methods Youth ages 9–15 years (n = 121) diagnosed with an IgE-mediated FA and their primary caregivers were recruited from pediatric FA clinics to complete surveys about their FA-related bullying experiences. Descriptive statistics were conducted to assess overall FA-related bullying and McNemar tests were utilized to assess disagreement among parent–child report and between multi-item and single-item assessment methods. Results Seventeen percent and 31% of youth reported FA-related bullying on single-item and multi-item assessments, respectively. Twelve percent of parents reported their child had experienced FA-related bullying. Youth reported overt physical (51%), overt non-physical (66%), and relational FA-related bullying (20%). FA-related bullying was most common among classmates. Assessment method significantly affected the rates of FA-related bullying reported by youth, and parents and youth only agreed on FA-bullying experiences when assessed via the single-item measure. Conclusions A subset of a diverse sample of youth with FA reported FA-related bullying. Clinicians should use multi-item assessment methods and ask both parents and children about their experiences to fully capture the experiences of families managing FA. School policies that facilitate FA safety and social inclusion should be promoted. Clinical Trial Registration N/A.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Guy Major Ngayo Fotso

Purpose The proliferation of studies on leadership competencies have not yet provided a consistent set to guide the work of researchers and practitioners. This paper aims to generate a clear, literature-based overview of the relevant leadership competencies for the twenty-first century. Design/methodology/approach The paper is an integrative literature review and identifies four strands of literature on leadership, reaching back to traditional works. It reviews each strand to establish which leadership competencies remain relevant for the twenty-first century. Findings This paper shows it is essential to clarify and harmonize terminology used in leadership literature. It identifies 18 groups of leadership competencies required for the twenty-first century. The research reveals that leaders of the twenty-first century must be able to combine a strong concern for people, customer experience, digitalization, financialization and the general good. Research limitations/implications This paper is based on a non-exhaustive list of literature derived from studies published in Western journals, written in English. Future research should include papers beyond the confines of Western academia and entail fieldwork to test the comprehensive framework derived here. Practical implications This paper will help practitioners develop leadership training curricula and transform the leadership culture in their organizations. The competency list can be useful in recruitment and selection processes for leadership positions. Professionals will find it helpful as an index in self-diagnosis and personal development for their career decision choices. Originality/value The paper addresses the growing need for clarity on the required leadership competencies for the twenty-first century.


2018 ◽  
Vol 39 (8) ◽  
pp. 995-1009
Author(s):  
Todd C. Harris

PurposeThe purpose of this paper is twofold: first, to examine George Washington’s approach to leadership through the lens of contemporary leadership theory and practice; and second, to help modern managers further reflect upon and develop their own leadership capabilities through a historiographic examination of Washington’s leadership traits and skills.Design/methodology/approachCombining three different academic disciplines, management, psychology and history, the author utilized a historiographic and interdisciplinary research methodology, conducting a detailed exploration of the life of George Washington through an examination of a wide range of original archival materials, books, journal articles and other sources.FindingsThe present analysis reveals that Washington demonstrated a variety of well-validated leadership competencies (e.g. emotional intelligence, resilience, integrity, etc.) that are largely consistent with leader-centered theoretical conceptions of leadership.Originality/valueThis is the first historiographic study of George Washington’s approach to leadership within the management literature. Additionally, through the development of a competency model, the study demonstrates how Washington employed tools and techniques from a host of modern leadership theories to achieve critically important results.


2017 ◽  
Vol 18 (2) ◽  
pp. 148-157 ◽  
Author(s):  
Karine Fournier ◽  
Lindsey Sikora

Purpose Though we live in a digital era, libraries offer significant hours of in-person reference services, in combination with online reference services. Nevertheless, an increase in requests for in-person, individualized research consultations (IRCs) over the last few years has been observed. IRCs between librarians and students are common practice in academic institutions. While these sessions can be deemed useful for patrons, as they are tailored to their specific needs, however, they can also be time consuming for the librarians. Therefore, it is important to evaluate this service, and assess its impact in order to ensure that the users are getting the most out of their sessions. The purpose of this paper is to gather information on the evaluation and assessment tools that Canadian institutions are using to obtain feedback, measure their impact and improve their consultation services. Design/methodology/approach A bilingual (French and English) web-based questionnaire was issued, with a generic definition of IRCs provided. The questionnaire included general demographics and background information on IRC practices among Canadian academic librarians, followed by reflective questions on the assessment process of such practices. The questionnaire was sent to Canadian academic librarians via e-mail, using professional librarian associations’ listservs, and Twitter was used for dissemination as well. Findings Major findings of the survey concluded that the disciplines of health sciences and medicine, as well as the arts and humanities are the heaviest users of the IRC service model. On average, these sessions are one hour in length, provided by librarians who often require advanced preparation time to adequately help the user, with infrequent follow-up appointments. It was not surprising that a lack of assessment methods for IRCs was identified among Canadian academic libraries. Most libraries have either no assessment in place for IRCs, or they rely heavily on informal feedback from users, comments from faculty members and so on. A small portion of libraries use usage statistics to assess their IRCs service, but other means of assessment are practically non-existent. Research limitations/implications The survey conducted was only distributed to Canadian academic libraries. Institutions across the USA and other countries that also perform IRCs may have methods for evaluating and assessing these sessions which the authors did not gather; therefore, the evidence is biased. As well, each discipline approaches IRCs very differently; therefore, it is challenging to compare the evaluation and assessment methods between each discipline. Furthermore, the study’s population is unknown, as the authors did not know the exact number of librarians or library staff providing IRCs by appointment in academic Canadian institution. While the response rate was reasonably good, it is impossible to know if the sample is representative of the population. Also, it needs to be acknowledged that the study is exploratory in nature as this is the first study solely dedicated at examining academic librarians’ IRC practices. Further research is needed. As future research is needed to evaluate and assess IRCs with an evidence-based approach, the authors will be conducting a pre-test and post-test to assess the impact of IRC on students’ search techniques. Originality/value Evidence-based practice for IRCs is limited. Very few studies have been conducted examining the evaluation and assessment methods of these sessions; therefore, it was believed that a “lay of the land,” so to speak, was needed. The study is exploratory in nature, as this is the first study solely dedicated at examining the evaluation and assessment methods of academic librarians’ IRC practices.


2015 ◽  
Vol 28 (3) ◽  
pp. 173-184 ◽  
Author(s):  
Peter Spurgeon ◽  
Paul Long ◽  
John Clark ◽  
Frank Daly

Purpose – The purpose of this paper is to address issues of medical leadership within health systems and to clarify the associated conceptual issues, for example, leadership versus management and medical versus clinical leadership. However, its principle contribution is to raise the issue of the purpose or outcome of medical leadership, and, in this respect, it argues that it is to promote medical engagement. Design/methodology/approach – The approach is to provide evidence, both from the literature and empirically, to suggest that enhanced medical engagement leads to improved organisational performance and, in doing so, to review the associated concepts. Findings – Building on current evidence from the UK and Australia, the authors strengthen previous findings that effective medical leadership underpins the effective organisational performance. Research limitations/implications – There is a current imbalance between the size of the databases on medical engagement between the UK (very large) and Australia (small but developing). Practical implications – The authors aim to equip medical leaders with the appropriate skill set to promote and enhance greater medical engagement. The focus of leaders in organisations should be in creating a culture that fosters and supports medical engagement. Social implications – This paper provides empowerment of medical professionals to have greater influence in the running of the organisation in which they deliver care. Originality/value – The paper contains, for the first time, linked performance data from the Care Quality Commission in the UK and from Australia with the new set of medical engagement findings.


Sign in / Sign up

Export Citation Format

Share Document