Science and technology metrics for research policy evaluation: some insights from a Moroccan experience

2014 ◽  
Vol 101 (1) ◽  
pp. 899-915 ◽  
Author(s):  
Hamid Bouabid
2020 ◽  
Vol 3 (2) ◽  
pp. 277-294
Author(s):  
Rachel Minto ◽  
Lut Mergaert ◽  
María Bustelo

This article assesses the ability of the European Commission’s current approach to policy evaluation to evaluate gender mainstreaming and, in turn, other cross-cutting social agendas (Articles 8–10 TFEU). Taking European Union research policy as a case study, through our analysis, we reveal mismatches between current evaluation standards adopted within the Better Regulation framework and requirements for effectively assessing progress towards cross-cutting social objectives, such as gender equality. The article concludes with a series of recommendations to overcome the identified shortcomings. Our analysis constitutes a key contribution to the development of feminist scholarship on the post-implementation phase of the policy process.


2020 ◽  
Vol 12 (2) ◽  
Author(s):  
Choirul Mahfud ◽  
Dyah Satya Yoga Agustin

Abstrak Artikel ini membahas tentang evaluasi kebijakan tentang publikasi di ITS yang perlu terus memperoleh dukungan dan perhatian kita bersama. Lebih khusus lagi dalam hubungan publikasi internasional dalam aspek Sosial Humaniora. Pasalnya, perguruan tinggi sekarang dituntut untuk menaruh perhatian pada kajian multidisipliner yang memungkinkan adanya keberhasilan lembaga penelitian bisa menangkap peluang dan mengatasi tantangan yang dipengaruhi oleh banyak factor, aspek dan pendekatan. Oleh karena itu, memahami dan melakukan evaluasi kebijakan yang lebih komprehensif selalu penting untuk dilakukan. Dalam hal ini, evaluasi kebijakan dilihat dari bagaimana capaian-capaian penelitian dan publikasi internasional yang dilakukan atau yang sudah dihasilkan. Bagaimana factor pendukung dan penghambat dari kegiatan publikasi bereputasi internasional yang dilakukan di kampus ITS Surabaya. Hasil penelitian menunjukkan bahwa capaian-capaian dan kontribusi dosen ITS dalam publikasi internasional di bidang sosial humaniora patut diapresiasi dan didukung dengan kebijakan-kebijakan yang sistematis, komprehensif dan berkelanjutan. Pasalnya, melihat jumlah dosen di bidang sosial humaniora juga bisa dibilang tidak sedikit, meskipun juga tidak terlalu banyak. Oleh karena itu, solusi untuk membuat kebijakan berbasis penelitian dalam bidang sosial humaniora perlu ditingkatkan. Hal ini merupakan kunci untuk mendukung langkah publikasi. Tanpa adanya kebijakan penelitian, maka publikasi akan sulit dilakukan secara terorganisir dan berkelanjutan. Hambatan memang ada dari internal dan eksternal yang bisa dipahami oleh stakeholders terkait untuk dilakukan langkah alternatif pemecahannya dengan cara kolaborasi dan sinergi dalam publikasi.   Kata kunci: Kebijakan, Publikasi Internasional dan Bidang Sosial Humaniora   Abstract This article discuses on policy evaluation research of publication at ITS campus. More specifically, concerning international publications in the aspect of Social Humanities. It is because universities are now required to pay attention to multidisciplinary studies that enable research institutions to seize opportunities and overcome challenges influenced by many factors, aspects, and approaches. Therefore, understanding and conducting a more comprehensive policy evaluation is always essential to do. In this case, policy evaluation is seen as a simple way of evaluation. From the achievements of research and international publications that have been carried out or have been produced. What are the supporting and inhibiting factors of internationally reputable publication activities carried out on the ITS Surabaya campus? The study results show that ITS lecturers' achievements and contributions in international publications in the social and humanities field should be appreciated and supported by systematic, comprehensive, and sustainable policies. The reason is, seeing the number of lecturers in the social and humanities field is also not small, although not too many. Therefore, solutions for making research-based policies in the social and humanities field need to be improved. It is the key to supporting the publication step. Without a research policy, the publication will be challenging to do in an organized and sustainable manner. Obstacles exist from internal and external that can be understood by relevant stakeholders to take alternative steps to solve them through collaboration and synergy in publications.   Keywords: Policy; International Publications; Social Humanities.


2016 ◽  
Vol 7 (1) ◽  
pp. 101-131
Author(s):  
Gerardo Reyes Ruiz ◽  
Jordi Suriñach Caralt ◽  
Alejandro Barragán Ocaña

Purpose – Mexico is an OECD member country that historically has allocated less than half a per cent of its gross domestic product to spend on research and experimental development. The purpose of this paper is to evaluate the country’s science and technology policy through its main program, the National System of Researchers (SNI), an attempt made for the first time. The results obtained make it possible to see whether the SNI has succeeded in improving research in Mexico. The authors also look at whether the program provides ways of improving and strengthening the science policy model adopted by Mexico and whether it could be extended and/or introduced into other nearby countries with levels of development or characteristics similar to those of Mexico. Design/methodology/approach – After that, the authors will analyze the scientific productivity of SNI members in comparison to Mexican researchers as a whole so as to assess both whether the SNI selects the best researchers and whether these researchers carry out more research and of a higher quality. Finally, the authors will check whether the selection criteria of the assessment committees are internally consistent. To do this, the authors will carry out a bibliometric analysis of Mexican scientific production (overall and specifically of SNI members) and an analysis of the groups of researchers belonging to the SNI. Findings – The aim of this paper is to discover the impact and importance of the best program in Mexico as regards research policy, known as the SNI. Analyzing it will, in short, enable the authors to detect whether the program has been of use in improving the investigation potential and capacity for science and technology transfer of the research elite in Mexico; check whether the levels assigned to these researchers within the SNI are justified, based on research indicators (inputs and outputs); and assess the pros and cons of the SNI program with an eye to reviewing it in Mexico. Research limitations/implications – A limitation of using cross-sectional data is that information is not the same in each period analyzed. However, the SNI of Mexico has used the same information in all its evaluations. Therefore, the authors believe that using longitudinal data allows us to compare the evolution of SNI for various periods. This certainly is helpful for making decisions and, above all, provides first-hand information to the authorities who, in turn, should strengthen and make more efficient remedial measures regarding public policies on science and technology in Mexico. Practical implications – SNI assessment program will know the science and technology of Mexico and whether it is advisable to implement this program of science policy in similar economies or the same level of development as Mexico. Social implications – The contributions of this study are relevant to the extent that the evaluation system of researchers from Mexico is the basis for allocating research resources, making proposals to help improve the system for evaluating researchers and contributing to efficiency in the allocation of resources for research. Originality/value – This paper has also applied different techniques that have made it possible to look more thoroughly into the classification of all the researchers who were assessed positively by the SNI for period 1996-2003. These techniques have enabled us to obtain alternative classifications based on statistical algorithms and to gauge the level of internal consistency of the classifications made by the SNI, based strictly on the quantitative information supplied.


Sign in / Sign up

Export Citation Format

Share Document