Published February 10, 2023 | Version v1
Dataset Open

Computing Star Discrepancies with Numerical Black-Box Optimization Algorithms - Code and Data

  • 1. Sorbonne Université, CNRS
  • 2. Leiden Institute for Advanced Computer Science
  • 3. University of Coimbra, CISUC, DEI

Description

This repository contains the code and data for reproducibility of the paper 'Computing Star Discrepancies with Numerical Black-Box
Optimization Algorithms'. 

The following files are included:

- TA.zip and DEM.zip: The code used for the TA and DEM algorithms respectively.

- experiment_runner: Python file which was used to run the black-box optimization algorithms on the discrepancy problems from IOHexperimenter (requires package 'ioh', version 0.3.6 or higher). This generates data in IOH-format, which is included in 'raw_data.zip'

- process_stardicr.R: R script which uses IOHanalyzer to extract the performance from the raw data into csv files for visualization. The resulting csvs are included in 'csv_with_pos' for the final results including the corresponding coordinates and 'csv_perf.zip', which contains the convergence information.

- Found_Values: The discrepancy values found by TA and DEM, separated by sampler.

- A csv file of the relative performance of each of the optimizers compared to the values found by TA is included in 'final_precision_table.csv'

- Plot_StarDiscr: the python notebook used to generate all figures, except figure 3 which was created using the IOHanalyzer GUI (iohanalyzer.liacs.nl). The full dataset is available on the website under the source 'star_discrepancy'

- Figures: some additional figures which were not included in the paper because of space constraints + higher quality versions of some of the landscape plots.

Files

csv_perf.zip

Files (1.2 GB)

Name Size Download all
md5:1ab94fbbe66335765af2fd772aed7871
13.4 MB Preview Download
md5:7934f19830e6c485054d388d37f340ad
15.1 MB Preview Download
md5:5bc10c637d40c325b64f0ea4eacd3f1a
80.7 kB Preview Download
md5:a292ed67554b59865aa1cb2630ba227e
2.9 kB Download
md5:8da32fe8924bb619e128ddbeae0da044
4.6 kB Preview Download
md5:d956cb93ccbbe7c4724ce05506978dc1
1.1 GB Preview Download
md5:6254e6d2ce1749aceb712ca0b2d30ed0
13.1 MB Preview Download
md5:934328b2bca0d4b1598d278d3fa4d215
25.5 MB Preview Download
md5:9dd2f05888bfcc475837218955d8021d
13.5 MB Preview Download
md5:32533c6c24c22a55f2490133a05fcd29
1.7 kB Download
md5:ee5a092cb82d7369fbaaabab434ae714
54.1 MB Preview Download
md5:5efaaeb95f41f15e9650ee57c8fe8e83
37.4 kB Preview Download
md5:8d79cbc14b430f3efa3ba40066bc4977
30.9 kB Preview Download