Planned intervention: On Wednesday April 3rd 05:30 UTC Zenodo will be unavailable for up to 2-10 minutes to perform a storage cluster upgrade.
Published February 20, 2020 | Version 1
Dataset Open

An Empirical Comparison of Meta-Modeling Techniques for Robust Design Optimization

  • 1. University of Leiden
  • 2. Honda Research Institute Europe GmBH

Description

This is the data and source code used in the paper below:

Sibghat Ullah, Hao Wang, Stefan Menzel, Bernhard Sendhoff and Thomas Bäck, “An Empirical Comparison of Meta-Modeling Techniques for Robust Design Optimization”, in 2019 IEEE Symposium Series on Computational Intelligence (SSCI), Xiamen, China, 6-9 December 2019, doi: 10.1109/SSCI44817.2019.9002805

This research investigates the potential of using meta-modeling techniques in the context of robust optimization namely optimization under uncertainty/noise. A systematic empirical comparison is performed for evaluating and comparing different meta-modeling techniques for robust optimization. The experimental setup includes three noise levels, six meta-modeling algorithms, and six benchmark problems from the continuous optimization domain, each for three different dimensionalities. Two robustness definitions: robust regularization and robust composition, are used in the experiments. The meta-modeling techniques are evaluated and compared with respect to the modeling accuracy and the optimal function values. The results clearly show that Kriging, Support Vector Machine and Polynomial regression perform excellently as they achieve high accuracy and the optimal point on the model landscape is close to the true optimum of test functions in most cases.

Files

MetaModelComparison-ContinuousBlackBoxFunction-Code-190601-Open.zip

Additional details

Funding

ECOLE – Experience-based Computation: Learning to Optimise 766186
European Commission