JULIELab/trec-pm: SIGIR 2020 Camera Ready

This is the repository state used to create the final paper version for the SIGIR2020 conference titled What Makes a Top-Performing Precision Medicine Search Engine? Tracing Main System Features in a Systematic Way.

The statistical testing has been redone with a more appropriate paired randomization test in contrast to the unpaired used before. The tests are done in Jupyter notebooks, found under notebooks/sigir2020-notebooks/testing in this repository. Also contained are the notebooks and data used to create the plots in the result section of the paper.

The ElasticSearch 5.4. indexes used for the experiments described in the paper and the complete results of the SMAC runs can be obtained from https://doi.org/10.5281/zenodo.3854458.