Published April 12, 2024 | Version v1
Dataset Open

Benchmarking Dynamic Binary Value Problems with IOHprofiler -- Reproducibility files

  • 1. ROR icon Sorbonne Université
  • 2. ROR icon Leiden University
  • 3. CNRS Délégation Paris B

Description

This repository contains the code, data and scripts to reproduce the results from the paper "Empirical Analysis of the Dynamic Binary Value Problem with IOHprofiler".

The files are split into 3 parts:


Part 1: Data collection

The data can be collected using the data_collection.py file. In its default state, this will collect the full set of experimental data used in the paper. This can be modified by adjusting the main to only execute the relevant parts of the experiments. Note that the data location and number of parallell processes can be adjusted at the top of this file.

To run the data collection, the only requirement is to install multiprocessing (any version from pip) and iohexperimenter. The version of ioh should be installed from github https://github.com/IOHprofiler/IOHexperimenter/tree/dynamic-bin-val (installation instructions can be found on the github page). Alternatively, the future pip-release 0.3.16 will include these changes as well.

Part 2: Data

Instead of rerunning the full experimental data collection, the results of this have also been made available. Each set of experiments is provided as a 'SetX.zip' file.

Part 3: Visualization

To analyze and visualize the data, the provided notebook can be used. This notebook takes the data from either step 1 or 2 and uses it to create the figures presented in the paper (plus some variations).
The resulting figures are also provided on Figshare: doi.org/10.6084/m9.figshare.25592904

 

Files

README.md

Files (1.0 GB)

Name Size Download all
md5:a56c1beeacf0a5d6a8fc7a2924e1e2eb
12.6 kB Download
md5:29f04201d58083f7facfe0f25df16d9e
1.4 kB Preview Download
md5:05dbe6e3933002b55e097cc280fb3b0c
21.4 MB Preview Download
md5:7b6ed508cbbed9661180de9bad0488ef
128.0 MB Preview Download
md5:672af8fa946d27a16f25eaa818ee80ed
308.5 MB Preview Download
md5:780e26da1db0374b722b9b836275d557
566.0 MB Preview Download
md5:d537a5b00f0e0a9e0873f9dd4725f5bb
13.9 MB Preview Download
md5:3c4e37419c6ef9fb415f30aaf0e47b7c
2.8 MB Preview Download