Epistimio/orion: Plotting API and Database commands

Important changes New plotting API

Plotting capability is being added to experiment clients. You can now plot the regret (curve of best objective found during optimization) with simply experiment.plot.regret(). You can find an example here.

Web API (REST server)

A web API was added for v0.1.9 in order to support the visualization dashboard that is currently under work. See full documentation here.

Database commands rm & set

Command line helpers have been added to simplify the process of deleting experiments and trials as well as modifying trials in the database. See full documentation for both commands here.

Detailed list of changes New features

• New plotting API (#400, #426)
• REST server (#437, #438, #441, #446)
• New command orion db rm (#425)
• New command orion db set (#428)

Breaking changes

• Drop support for orion < 0.1.6 (#420)
• Deprecate init_only and add hunt --init-only (#436)

Bug Fixes

• Fix backward compatibility tests in master - Drop support for orion < 0.1.6 (#420)
• Fix test using 'in' to assert equality (#427)
• Avoid side effects in setup_storage (#444)
• Return onehot interval instead of categorical (#447)
• Adjust OneHotEncoding interval shape (#449)
• Support non existing user script conf files (#452)
• Support load yaml config for dict items (#453)
• Fix fetch_lost_trials (Causing random FailedUpdate when using many workers) (#445)

Other improvements

• Improve CI - Convert functional algo tests to python API (#418)
• Monitor code change between trial execution (#429)
• Add info about working_dir when using orion info CLI (#430)
• Enable is_broken for ExperimentView (#432)
• Specialized properties for Trials (#433)
• Add completed field to info cmd (#435)
• Add orion.client.get_experiment() (#439)
• Sort modules and extensions alphabetically (#443)
• Print user friendly err msg if script inexecutable (#445)
• Migrate from Travis to Github-actions (#458, #459, #461)

Documentation improvements

• Add a code of conduct (#353)
• Refresh database documentation (#413)
• Merging Sequential and Service API (#416)
• CLI documentation improvements (#440)
• Remove outdated branch_from parameter documentation in experiment_builder.build() (#442)
• Changed variable name in docs to reflect the correct name (#448)
• Fix config of EvolutionaryES (#451)