Exploring the temporal dimension in policy evaluation studies

2012 ◽  
Vol 46 (1) ◽  
pp. 23-37 ◽  
Author(s):  
Nanny Bressers ◽  
Mark van Twist ◽  
Ernst ten Heuvelhof
2009 ◽  
Vol 101 (3-4) ◽  
pp. 427-445 ◽  
Author(s):  
Constanze Haug ◽  
Tim Rayner ◽  
Andrew Jordan ◽  
Roger Hildingsson ◽  
Johannes Stripple ◽  
...  

2017 ◽  
Vol 78 ◽  
pp. 89-96 ◽  
Author(s):  
Mariësse A.E. van Sluisveld ◽  
Andries F. Hof ◽  
Detlef P. van Vuuren ◽  
Pieter Boot ◽  
Patrick Criqui ◽  
...  

Author(s):  
Songphan Choemprayong

One of the objectives of the Association of Southeast Asian Nations (ASEAN) is to promote scientific and research collaboration in order to raise the level of competitiveness in Southeast Asia. Bibliometrics can play an important role in informing science and scholarship policy evaluation and recommendations in this region. Bibliometric researchers have been observing scholarly activities in this region since the 1980s. However, the number of scholarly publications in this region has been relatively low compared to the rest of the world. Most of these bibliometric studies focus on benchmarking research performance between these countries, although they vary in many regards, for instance, in the countries/regions of interest, data sources, and analytical techniques. Evaluation studies of collaboration within this region are evidently rare and mostly focus on collaborations with non-ASEAN countries. By connecting the results of these studies through different periods and methodological perspectives, this chapter discusses the challenges and knowledge gaps in this research area in order to identify potential research topics and approaches for future studies.


foresight ◽  
2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Katarzyna Szkuta ◽  
Blagoy Stamenov ◽  
Paul Cunningham

Purpose The purpose of this paper is to identify the impact of public support through equity instruments on firm performance, as measured by growth in employment, turnover and innovative activities. Design/methodology/approach The paper draws on available academic literature and policy evaluation studies and using a mixed-method approach based on evaluation synthesis. Findings The key findings reflect positive, albeit quantifiably small, outcomes for this type of policy intervention for employment and turnover and no effect on innovation. There is some concentration of positive results, which is also dependent on the number and quality of the available target companies. Research limitations/implications The evaluations used in this study vary considerably in their design, nature and the input and output variables used and, thus, limit a robust comparison of their outputs. Most of the evaluations examined in this paper did not control for multiple simultaneous treatment effects and/or subsequent funding rounds. Practical implications The evaluations are rarely designed to compare the treatment effects of alternative policy choices. Only seldom is an evaluation designed to assess the impact of the scheme in the context of the broader policy mix (with its framework conditions, etc.) which would provide more fine-grained policy implications. Originality/value The recent literature (Duruflé et al., 2017, Da Rin et al., 2011) highlights the dearth of studies exploring the role of government policies supporting venture and, more broadly, equity investments beyond comparisons of the efficiency of independent venture capital and government-backed venture capital. Most studies explore the impact in terms of exits, initial public offering and leverage effects whereas fewer studies look at output effects on companies such as turnover and employment growth. The paper aims to collect the existing evidence including less analysed policy evaluation studies and draw lessons for public policy.


2019 ◽  
Vol 60 (4) ◽  
pp. 701-717 ◽  
Author(s):  
Valérie Pattyn ◽  
Bart De Peuter ◽  
Marleen Brans

AbstractPolicy evaluations can be set up for multiple purposes including accountability, policy learning and policy planning. The question is, however, how these purposes square with politics itself. To date, there is little knowledge on how government ministers present the rationale of evaluations. This article is the first to provide a diachronic study of discourse about evaluation purposes and encompass a wide range of policy fields. We present an analysis of evaluation announcements in so-called ministerial policy notes issued between 1999 and 2019 by the Flemish government in Belgium. The research fine-tunes available evidence on catalysts for conducting evaluations. The Flemish public sector turns out to be a strong case where New Public Management brought policy evaluation onto the agenda, but this has not resulted in a prominent focus on accountability-oriented evaluations. We further show that policy fields display different evaluation cultures, albeit more in terms of the volume of evaluation demand than in terms of preferences for particular evaluation purposes.


Author(s):  
Harald Klingemann ◽  
Justyna Klingemann

Abstract. Introduction: While alcohol treatment predominantly focuses on abstinence, drug treatment objectives include a variety of outcomes related to consumption and quality of life. Consequently harm reduction programs tackling psychoactive substances are well documented and accepted by practitioners, whereas harm reduction programs tackling alcohol are under-researched and met with resistance. Method: The paper is mainly based on key-person interviews with eight program providers conducted in Switzerland in 2009 and up-dated in 2015, and the analysis of reports and mission statements to establish an inventory and description of drinking under control programs (DUCPs). A recent twin program in Amsterdam and Essen was included to exemplify conditions impeding their implementation. Firstly, a typology based on the type of alcohol management, the provided support and admission criteria is developed, complemented by a detailed description of their functioning in practice. Secondly, the case studies are analyzed in terms of factors promoting and impeding the implementation of DUCPs and efforts of legitimize them and assess their success. Results: Residential and non-residential DUCPs show high diversity and pursue individualized approaches as the detailed case descriptions exemplify. Different modalities of proactively providing and including alcohol consumption are conceptualized in a wider framework of program objectives, including among others, quality of life and harm reduction. Typically DUCPs represent an effort to achieve public or institutional order. Their implementation and success are contingent upon their location, media response, type of alcohol management and the response of other substance-oriented stake holders in the treatment system. The legitimization of DUCPs is hampered by the lack of evaluation studies. DUCPs rely mostly – also because of limited resources – on rudimentary self-evaluations and attribute little importance to data collection exercises. Conclusions: Challenges for participants are underestimated and standard evaluation methodologies tend to be incompatible with the rationale and operational objectives of DUCPs. Program-sensitive multimethod approaches enabled by sufficient financing for monitoring and accompanying research is needed to improve the practice-oriented implementation of DUCPs. Barriers for these programs include assumptions that ‘alcohol-assisted’ help abandons hope for recovery and community response to DUCPs as locally unwanted institutions (‘not in my backyard’) fuelled by stigmatization.


2002 ◽  
Vol 18 (3) ◽  
pp. 229-241 ◽  
Author(s):  
Kurt A. Heller ◽  
Ralph Reimann

Summary In this paper, conceptual and methodological problems of school program evaluation are discussed. The data were collected in conjunction with a 10 year cross-sectional/longitudinal investigation with partial inclusion of control groups. The experiences and conclusions resulting from this long-term study are revealing not only from the vantage point of the scientific evaluation of new scholastic models, but are also valuable for program evaluation studies in general, particularly in the field of gifted education.


2018 ◽  
Vol 49 (1) ◽  
pp. 3-15 ◽  
Author(s):  
Malte Schott ◽  
Jule Wolf

Abstract. We examined the effect of presenting unknown policy statements on German parties’ election posters. Study 1 showed that participants inferred the quality of a presented policy from knowledge about the respective political party. Study 2 showed that participants’ own political preferences influenced valence estimates: policy statements presented on campaign posters of liked political parties were rated significantly more positive than those presented on posters of disliked political parties. Study 3 replicated the findings of Study 2 with an additional measure of participants’ need for cognition. Need for cognition scores were unrelated to the valence transfer from political parties to policy evaluation. Study 4 replicated the findings of Studies 2 and 3 with an additional measure of participants’ voting intentions. Voting intentions were a significant predictor for valence transfer. Participants credited both their individually liked and disliked political parties for supporting the two unknown policies. However, the credit attributed to the liked party was significantly higher than to the disliked one. Study 5 replicated the findings of Studies 2, 3, and 4. Additionally, participants evaluated political clubs that were associated with the same policies previously presented on election posters. Here, a second-degree transfer emerged: from party valence to policy evaluation and from policy evaluation to club evaluation. Implications of the presented studies for policy communications and election campaigning are discussed.


Sign in / Sign up

Export Citation Format

Share Document