Saint Matthew strikes again: An agent-based model of peer review and the scientific community structure

2012 ◽  
Vol 6 (2) ◽  
pp. 265-275 ◽  
Author(s):  
Flaminio Squazzoni ◽  
Claudio Gandelli
Keyword(s):  
Community Structure ◽  
Peer Review ◽  
Scientific Community ◽  
Agent Based Model ◽  
Agent Based

A SIMULATION OF DISAGREEMENT FOR CONTROL OF RATIONAL CHEATING IN PEER REVIEW

2013 ◽  
Vol 16 (07) ◽  
pp. 1350004 ◽  
Author(s):  
FRANCISCO GRIMALDO ◽  
MARIO PAOLUCCI
Keyword(s):  
Peer Review ◽  
Review Process ◽  
Peer Review Process ◽  
Empirical Validation ◽  
Agent Based Model ◽  
Agent Based ◽  
Programme Committee ◽  
Shed Light ◽  
Better Than

Understanding the peer review process could help research and shed light on the mechanisms that underlie crowdsourcing. In this paper, we present an agent-based model of peer review built on three entities — the paper, the scientist and the conference. The system is implemented on a BDI platform (Jason) that allows to define a rich model of scoring, evaluating and selecting papers for conferences. Then, we propose a programme committee update mechanism based on disagreement control that is able to remove reviewers applying a strategy aimed to prevent papers better than their own to be accepted ("rational cheating"). We analyze a homogeneous scenario, where all conferences aim to the same level of quality, and a heterogeneous scenario, in which conferences request different qualities, showing how this affects the update mechanism proposed. We also present a first step toward an empirical validation of our model that compares the amount of disagreements found in real conferences with that obtained in our simulations.

Sign in / Sign up

Export Citation Format

Share Document