scholarly journals Innovation Suppression and Clique Evolution in Peer-Review-Based, Competitive Research Funding Systems: An Agent-Based Model

2015 ◽  
Vol 18 (2) ◽  
Author(s):  
Pawel Sobkowicz
Keyword(s):  
Peer Review ◽  
Research Funding ◽  
Agent Based Model ◽  
Agent Based

A SIMULATION OF DISAGREEMENT FOR CONTROL OF RATIONAL CHEATING IN PEER REVIEW

2013 ◽  
Vol 16 (07) ◽  
pp. 1350004 ◽  
Author(s):  
FRANCISCO GRIMALDO ◽  
MARIO PAOLUCCI
Keyword(s):  
Peer Review ◽  
Review Process ◽  
Peer Review Process ◽  
Empirical Validation ◽  
Agent Based Model ◽  
Agent Based ◽  
Programme Committee ◽  
Shed Light ◽  
Better Than

Understanding the peer review process could help research and shed light on the mechanisms that underlie crowdsourcing. In this paper, we present an agent-based model of peer review built on three entities — the paper, the scientist and the conference. The system is implemented on a BDI platform (Jason) that allows to define a rich model of scoring, evaluating and selecting papers for conferences. Then, we propose a programme committee update mechanism based on disagreement control that is able to remove reviewers applying a strategy aimed to prevent papers better than their own to be accepted ("rational cheating"). We analyze a homogeneous scenario, where all conferences aim to the same level of quality, and a heterogeneous scenario, in which conferences request different qualities, showing how this affects the update mechanism proposed. We also present a first step toward an empirical validation of our model that compares the amount of disagreements found in real conferences with that obtained in our simulations.

Sign in / Sign up

Export Citation Format

Share Document