Computer Simulations of Scientific Peer Reviewing

This is an instance of the LabPal experimental environment. It contains experiments aimed at studying the peer reviewing process by simulating randomly-generated "papers" and "reviewers", and submitting the papers for evaluation to a large number of times and varying a few parameters controlling the way papers are scored and accepted by the fake program committees.

The author of this archive has set up a set of experiments, which typically involve running scripts on input data, processing their results and displaying them in tables and plots. LabPal is a library that wraps around these experiments and displays them in an easy-to-use web interface. The principle behind LabPal is that all the necessary code, libraries and input data should be bundled within a single self-contained JAR file, such that anyone can download and easily reproduce someone else's experiments.

All the plots and other data values mentioned in the paper are automatically generated by the execution of this lab. The lab also provides additional tables and plots that could not fit into the manuscript.

This artifact is made of two files:

1. A file called Readme.txt, which explains how to use the LabPal instance
2. A file called review-simulator.jar, which is a runnable JAR file that also contains all the source code and documentation for the laboratory.