Is the empirical validity of prior experience for performance affected by rating approach?

2014 ◽  
Vol 43 (3) ◽  
pp. 438-463 ◽  
Author(s):  
Dan Baugher ◽  
Ellen Weisbord ◽  
Chris Ramos
Keyword(s):  
Prior Experience ◽  
Meta Analysis ◽  
Reliability And Validity ◽  
Job Applicants ◽  
Validity Data ◽  
Content Type ◽  
The Public ◽  
Supervisory Ratings ◽  
The One

Purpose – In the public sector, Training and Experience (T & E) exams assess prior experience and are one of the most often used methods for selecting job applicants. This study uses a KSA approach, where raters judge the quality of job relevant prior experience, not its duration or quantity. It was hypothesized that an additional rater and a consensus meeting between raters would increase reliability and validity. Design/methodology/approach – T & E and supervisory ratings were obtained over a 12-year period for 166 candidates seeking promotion to a budget analyst position. Validity was measured by the correlation between T & E scores and supervisory ratings. Consensus was required only for T & E scores differing by a specific amount (hybrid consensus). Findings – Intraclass reliability was 0.73, 0.84, and 0.95 in the one-rater, two-rater, and hybrid consensus conditions with each coefficient greater than the next (p < 0.05) showing the benefit of multiple raters and consensus for reliability. Validity was significant at 0.21, 0.26, and 0.251 for each rating condition, respectively (two-tail test; p < 0.01). Validity was greater in the two-rater condition than in the one-rater condition (one-tail test; p < 0.05). Consensus did not improve validity beyond that of two raters. For consensus T & Es (n=76), two raters improved validity (one-tail test; p < 0.05), moving from 0.112 to 0.231 but not reliability; consensus improved reliability (two-tail test; p < 0.05) but not validity. Originality/value – There has been a vacuum in T & E research for close to 20 years. Validity data are difficult to obtain but critical for meta-analysis. T & Es showed validity. Use of two raters improved validity but consensus did not increase the gain.

Projectification in the public sector – the case of the European Union

2015 ◽  
Vol 8 (2) ◽  
pp. 324-348 ◽  
Author(s):  
Sebastian Godenhjelm ◽  
Rolf A. Lundin ◽  
Stefan Sjöblom
Keyword(s):  
European Union ◽  
Public Sector ◽  
Meta Analysis ◽  
The European Union ◽  
Management Skills ◽  
Content Type ◽  
The Public ◽  
Public Context ◽  
Transfer Mechanisms

Purpose – The purpose of this paper is to establish an understanding of what projectification means, how projectification is driven forward, as well as what the consequences of projectification are in an European Union (EU) context, and in the public sector in general. Design/methodology/approach – The research methods consist of a literature review as well as a meta-analysis of key EU policy documents related to the functioning of regional development and projects. The paper shows that structural developments brought forth by a projectification in a public sector context have significant consequences. Findings – Without contextually sensitive interlinking mechanisms between temporary and permanent structures projects risk losing their flexible and innovative qualities, and may fragment the ability of permanent organisations for maintaining coordination and continuity. The findings suggests that the proximity of permanent organisations, the discretion of entrepreneurship, the political priority of the task, the inclusion of competencies and interests, and the quality of transfer mechanisms are essential variables in explaining the outcome of temporary organisations in a politico-administrative context. Research limitations/implications – The paper contributes to the literature on projects in a public sector context and suggests that comparative research on the drivers and consequences of public sector projectification in supranational as well as national contexts is needed. Practical implications – The increasing requirements for applied project management skills and methods as criteria for project selection in the public sector highlight the importance of a broader theoretical and practical understanding of projectification. Originality/value – The paper adds a new dimension to the projectification debate by presenting a descriptive and conceptual discussion about the consequences of public sector projectification in an EU context. It complements an existing theory of the temporary organisation and takes the first steps towards a theory applicable to projectification in a public context.

Measuring the quality of the “comply or explain” approach

2015 ◽  
Vol 30 (4/5) ◽  
pp. 373-412 ◽  
Author(s):  
Michail Nerantzidis
Keyword(s):  
Content Analysis ◽  
Web Sites ◽  
Stock Exchange ◽  
The Body ◽  
Content Type ◽  
Athens Stock Exchange ◽  
Recent Financial Crisis ◽  
The One ◽  
Comply Or Explain

Purpose – This paper provides evidence regarding the efficacy of the “comply or explain” approach in Greece and has three objectives: to improve our knowledge of the concept of this accountability mechanism, to elevate auditors’ potential role in the control of corporate governance (CG) statements and to contribute to the discussion about the reform of this principle; a prolonged dialogue that has been started by European Commission in the light of the recent financial crisis. Design/methodology/approach – The approach taken is a content analysis of CG statements and Web sites of a non-probability sample of 144 Greek listed companies on the Athens Stock Exchange for the year 2011. Particularly, 52 variables were evaluated from an audit compliance perspective using a coding scheme. From this procedure, the level of compliance with Hellenic Federation of Enterprises (SEV) code, as well as the content of the explanations provided for non-compliance, were rated. Findings – The results show that although the degree of compliance is low (the average governance rating is 35.27 per cent), the evaluation of explanations of non-compliance is even lower (from the 64.73 per cent of the non-compliance, the 40.95 per cent provides no explanation at all). Research limitations/implications – The research limitations are associated with the content analysis methodology, as well as the reliability of CG statements. Practical implications – This study indicates that companies on the one hand tend to avoid the compliance with these recommendation practices, raising questions regarding the effectiveness of the SEV code; while on the other, they are not in line with the spirit of the CG code, as they do not provide adequate explanations. These results assist practitioners and/or policy-makers in perceiving the efficacy of the “comply or explain” approach. Originality/value – While there is a great body of research that has looked into the compliance with best practices, this study is different because it is the first one that rates not only the degree of the compliance with the code’s practices but also the content of the explanations provided for non-compliance. This is particularly interesting because it adds to the body of research by providing a new approach in measuring the quality of the “comply or explain” principle in-depth.

ISO 9001 and the public service: an investigation of the effect of the QMS on the quality of public service organizations

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Jorge Armando López-Lemus
Keyword(s):  
Public Sector ◽  
Service Quality ◽  
Public Service ◽  
Public Services ◽  
The State ◽  
Iso 9001 ◽  
Knowledge Generation ◽  
Content Type ◽  
The Public

Purpose The purpose of this paper is to identify the influence exerted by a quality management system (QMS) under ISO 9001: 2015 on the quality of public services organizations in Mexico. Design/methodology/approach The methodological design was quantitative, explanatory, observational and transversal, for which a sample of 461 public servants from the state of Guanajuato, Mexico was obtained. To test the hypotheses, a structural equation model (SEM) was developed through the statistical software Amos v.21. For the analysis of the data, software SPSS v.21 was used. Regarding the goodness and adjustment indices of the SEM (χ2 = 720.09, df = 320, CFI = 0.933, TLI = 0.926 and RMSEA = 0.05) which, therefore, proved to be acceptable. Findings According to the results obtained through the SEM model, the QMS under ISO 9001: 2015 is positively and significantly influenced tangible aspects (β1 = 0.79, p < 0.01), reliability (β2 = 0.90, p < 0.01), related to response quality (β3 = 0.93, p < 0.01), guarantees (β4 = 0.91, p < 0.01) and empathy (β5 = 0.88, p < 0.01) of the quality related to public services in Mexico. The study’s key contribution is that it discovered that implementing a QMS in accordance with the ISO 9001: 2015 standard has an impact on the quality of public services, with the most influential quality of response. Similarly, the assurance and dependability of service quality turned out to be important in providing public service quality. Research limitations/implications In this paper, the QMS was only evaluated as a variable that intervenes in the process of obtaining quality in public service under the ISO 9001 standard in its 2015 version. In this regard, the results’ trustworthiness is limited to the extent that the findings may be generalized in the state of Guanajuato, Mexico’s public service. As a result, the scientific community is left primarily focused on service quality to promote new future research. Practical implications The ISO 9001: 2015 standard’s QMS is one of the tools for success in both the commercial and government sectors. However, there are practical limitations, which focus on the time during which managers exercise their vision in the public sector: first, the dynamics that managers play in public policy; second, the length of time they have served in public office; and third, the interest of directors of public institutions to improve the quality of service provided by the government. Other practical consequences concern organizational culture and identity, public servant commitment, senior management or secretaries of government, as well as work and training. Originality/value The findings of this paper are important and valuable because they foster knowledge generation in the public sector through the ISO 9000 quality area. A model that permits the adoption and implementation of a QMS based on the ISO 9001: 2015 standard in public organizations that seek to provide quality in their services offered to the user is also presented to the literature. Similarly, the paper is important because there is currently insufficient research focusing on the variables examined in the context of public service in Mexico.

scholarly journals Design for Disassembly and the rehabilitation of public housing stock. A case study

2021 ◽  
pp. 181-191
Author(s):  
Lidia Errante ◽  
Alberto De Capua
Keyword(s):  
Public Housing ◽  
Design Research ◽  
Housing Stock ◽  
Design For Disassembly ◽  
Sustainable Building ◽  
The Public ◽  
Principles Of Design ◽  
The One

This contribution presents the meta-design research scenario of the sustainable building redevelopment of the INA Casa “Sbarre Inferiori” district in Reggio Calabria based on a twofold reflection. On the one hand, the transformative potential, both technological and formal, of the public housing stock created under the INA Casa Plan. On the other, the extension of the life cycle of the buildings and the improvement of the spatial quality of the housing according to a circular, low-tech and ecological approach. The result is an abacus of technological additions in bio-xlam conceived according to the principles of Design for Disassembly, which allows the reuse of the modules in new spatial and functional configurations, and the remanufacturing and recycling of the elements at the end of their life.

scholarly journals KINERJA LEMBAGA PERWAKILAN RAKYAT DAERAH (Studi Deskriptif Kualitatif Di DPRD Kota Bengkulu)

2015 ◽  
Vol 1 (2) ◽  
Author(s):  
Harius Eko saputra
Keyword(s):  
Mass Media ◽  
Public Service ◽  
Public Services ◽  
Research Seminar ◽  
Factors Affecting ◽  
The Public ◽  
Current Implementation ◽  
The One ◽  
The Right

Almost every day, in various mass media, especially in newspapers, it is found that there are so many complaints and unsatisfactory opinions from the community, as the customer, towards the current implementation of public service. These complaints and unsatisfactory opinions can describe how bad the quality of the current public service is, which is benefited by the community. It may be the right time for the community to be treated as citizens, who will have rights and give priority to their rights for being served afterwards. They are not anymore being considered as clients who previously have no any choice in choosing and in determining what kind of service that they really want to. There are so many results from research, seminar and writings that are conducted by experts in which their works talk about the implementation of a good and qualified public service. Currently, however, the qualified public service has not yet implemented as should have been. The implementation of public service still acts as however it please to be and only emphasize on its own interest without considering the consumer’s importance as the party that should really be served as well as possible. For this reason, a research, which is done in Service Integrated Unit of the Jember Regency, tries to find out any factors affecting quality of the public services. The main core of the public service implementation is the quality of norm of the service executor. The matter that should be realized is that the executor is the person who should serve for the community, and the community is the one who should be served as well as possible.Keywords: Implementation of public service, legislatif

Is auditing the new evaluation? Can it be? Should it be?

2018 ◽  
Vol 31 (6) ◽  
pp. 726-739 ◽  
Author(s):  
Jon Pierre ◽  
B. Guy Peters ◽  
Jenny de Fine Licht
Keyword(s):  
Comparative Research ◽  
Qualitative Method ◽  
Time Perspective ◽  
Extensive Literature ◽  
Public Programs ◽  
Content Type ◽  
The Public ◽  
The Past ◽  
Practical Implications

Purpose The purpose of this paper is to study the changing relationship between auditing and evaluation. Over the past several years, supreme auditing institutions (SAIs) in a number of advanced democracies have evolved from conventional auditing institutions to becoming increasingly concerned with assisting policy change and administrative reform in the public sector; tasks that are traditionally associated with evaluation. The paper discusses the potential consequences of this development for the SAIs themselves as well as for the audited and reforming institutions and for policy-making. Design/methodology/approach The paper uses qualitative method and draws on the extensive literature on auditing and evaluation. The analysis has also benefitted from the authors’ recent comparative research on SAIs. Findings The findings, summarized in six points, are that the growth of auditing in areas previously assigned to evaluators, has led to a shortened time perspective; stronger emphasis on the administration of policies; increased focus on efficiency of the audited entity; greater independence from the evaluated organizations; a shift in receiver of information toward the legislature and/or the public; and improved communication. Practical implications Evaluation as a professional and scholarly field has developed theories and advanced methods to assess the effectiveness of public programs. The growth of auditing may thus change the focus and quality of policy evaluation. Originality/value The paper speaks to both scholars and practitioners. To the best of the knowledge a similar analysis has not been done before.

IMPLEMENTACIJA KVALITETA U SISTEMU MENADžMENTA JAVNIH USLUGA

2021 ◽  
pp. 233-250
Author(s):  
Milan Palević ◽  
Keyword(s):  
Public Administration ◽  
Local Governments ◽  
Service Management ◽  
Service Providers ◽  
Management Systems ◽  
Quality Management Systems ◽  
The Public ◽  
Legitimate Expectations ◽  
The One

The work and work of public administration should strive to continuously improve the quality of its services, as well as to improve the overall quality of public administration as an organization. It is necessary to constantly set new goals and gradually, over time, get closer to those goals. In this way, the effectiveness and efficiency of the organization, that is, the entire system, would be improved. The new concept of management in public administration should improve the functioning of the public sector, which means that administrative bodies operate in accordance with the legitimate expectations of the users of their services. This paper presents a review of the current state of eGovernment and eServices that local governments in Serbia provide to citizens and the economy, from the aspect of service providers on the one hand and service users on the other. The author intends to point out the areas in which there is room for improvement, but also the challenges that local governments face every day in their work. The contribution of the paper is in the theoretical presentation of the importance of the implementation of quality management systems in public service management systems in order to improve them.

Medical visit time and predictors in health facilities: a mega systematic review and meta-analysis

2019 ◽  
Vol 12 (5) ◽  
pp. 373-402 ◽  
Author(s):  
Sakineh Hajebrahimi ◽  
Ali Janati ◽  
Morteza Arab-Zozani ◽  
Mobin Sokhanvar ◽  
Elaheh Haghgoshayie ◽  
...  
Keyword(s):  
Systematic Review ◽  
Meta Analysis ◽  
Visit Time ◽  
Medical Visit ◽  
High Quality ◽  
Content Type ◽  
Face To Face ◽  
Significant Difference ◽  
Meta Analyses

Purpose Visit time is a crucial aspect of patient–physician interaction; its inadequacy can negatively impact the efficiency of treatment and diagnosis. In addition, visit time is a fundamental demand of patients, and it is one of the rights of every patient. The purpose of this paper is to determine factors influencing the consultation length of physicians and to compare consultation length in different countries. Design/methodology/approach MEDLINE (PubMed), Web of Science, Cochrane, ProQuest, Scopus, and Google Scholar were searched. In addition, references of references were checked, and publication lists of individual scholars in the field were examined. We used data sources up to June 2018, without language restriction. We used a random-effects model for the meta-analyses. Meta-analyses were conducted using Comprehensive Meta-Analysis Version (CMA) 3.0. Findings Of 16,911 identified studies, 189 studies were assessed of which 125 cases (67 percent) have been conducted in the USA. A total of 189 studies, 164 (86.77 percent) involved face-to face-consultations. The effects of three variables, physician gender, patient gender, and type of consultation were analyzed. According to moderate and strong evidence studies, no significant difference was found in the consultation lengths of female and male doctors (Q=42.72, df=8, I2=81.27, p=0.891) and patients’ gender (Q=55.98, df=11, I2=80.35, p=0.314). In addition, no significant difference was found in the telemedicine or face-to-face visits (Q=41.25, df=5, I2=87.88, p=0.170). Originality/value In this systematic review and meta-analysis, all of physicians’ visits in 34 countries were surveyed. The evidence suggests that specified variables do not influence the length of consultations. Good relationship is essential to a safe and high-quality consultation and referral process. A high-quality consultation can improve decisions and quality of visits, treatment effectiveness, efficiency of service, quality of care, patient safety and physician and patient satisfaction.

scholarly journals Matching in the Kolm triangle: interiority and participation constraints of matching equilibria

2020 ◽  
Vol 47 (5) ◽  
pp. 1039-1050
Author(s):  
Wolfgang Buchholz ◽  
Richard Cornes ◽  
Dirk Rübbelke
Keyword(s):  
Public Good ◽  
Future Research ◽  
Content Type ◽  
The Public ◽  
Income Distributions ◽  
Good Economy ◽  
Triangle Method ◽  
Matching Mechanism ◽  
Good Provision ◽  
The One

PurposeIn this paper we show how the Kolm triangle method, which is a standard tool for visualizing allocations in a public good economy, can also be used to provide a diagrammatical exposition of matching mechanisms and their effects on public good supply and welfare. In particular, we describe, on the one hand, for which income distributions interior matching equilibria result, and on the other hand, for which income distributions the agents voluntarily participate in a matching mechanism. As a novel result, we especially show that the “participation zone” is larger than the “interiority zone”Design/methodology/approachWe employ the Kolm triangle approach, which has – compared to most other graphical methods for representing allocations in a public good economy – the advantage that it allows for showing the aggregate budget constraint, the levels of considered agents' private consumption, and the level of public good supply directly in the same diagram.FindingsThe Kolm triangle method can be used to visualize important effects of matching in an elegant way, so basically the increase of public good supply through matching. The interiority of matching depends on the income distribution and especially, on how the “interiority zone” is shrinking when the matching rate increases. Moreover, we were able to delimit the “participation zone” in the Kolm triangle. An important and novel insight is that the participation zone is larger than the interiority zone, which means that also corner matching equilibria in which only one agent makes a positive flat contribution to the public good may make both considered agents better off.Research limitations/implicationsCorner matching equilibria in which only one agent makes a positive flat contribution to the public good may improve all considered agents' welfare. How this welfare effect can be generalized to the case of different utility functions and matching rates will be an issue of future research.Practical implicationsThe examined matching mechanism finds application in many policy fields where public good undersupply is pending. International climate policy is one of these fields of application, for example.Originality/valueThe Kolm triangle method has been particularly helpful to describe the Nash equilibrium in the case of non-cooperative public good provision and to compare this outcome with Pareto efficient public good allocations. Furthermore, the Kolm triangle approach facilitates the analysis of mechanisms for attaining an efficient public good allocation like the Lindahl equilibrium as well as the study of preconditions and limitations faced by such mechanisms. An important and novel insight of our study is that the participation zone is larger than the interiority zone.

Sign in / Sign up

Export Citation Format

Share Document