Published April 8, 2024 | Version v0.2.0

proxystore/benchmarks: Benchmarks v0.2.0

  • 1. University of Chicago

Description

<!-- Release notes generated using configuration in .github/release.yml at v0.2.0 -->

Highlights

This release is a complete refactor of the benchmark suite with the aim of improving consistent and ease of introducing new benchmarks.

  • Three new benchmarks have been created as a part of the SC24 artifacts.
  • All package dependencies have been pinned to their latest versions.
  • Benchmark readmes have been updated.

What's Changed

Breaking Changes

  • Prototype new benchmark protocols and runner by @gpauloski in https://github.com/proxystore/benchmarks/pull/118
  • Refactor and bug fixes in task-pipelining benchmark by @gpauloski in https://github.com/proxystore/benchmarks/pull/123
  • Refactor workflow-memory benchmark by @gpauloski in https://github.com/proxystore/benchmarks/pull/124

Enhancements

  • Add Executor abstraction by @gpauloski in https://github.com/proxystore/benchmarks/pull/113
  • Add task pipelining benchmark by @gpauloski in https://github.com/proxystore/benchmarks/pull/114
  • Add DAOS ProxyStore backend support by @gpauloski in https://github.com/proxystore/benchmarks/pull/115
  • Add the workflow simulation benchmark by @gpauloski in https://github.com/proxystore/benchmarks/pull/116
  • Assorted minor improvements after #119 by @gpauloski in https://github.com/proxystore/benchmarks/pull/120
  • Add stream scaling benchmark by @gpauloski in https://github.com/proxystore/benchmarks/pull/121
  • Improve various aspects of new benchmarks for production runs by @gpauloski in https://github.com/proxystore/benchmarks/pull/125
  • Add manual memory management to workflow memory benchmark by @gpauloski in https://github.com/proxystore/benchmarks/pull/126
  • Fix bugs and improve workflow memory benchmark. by @gpauloski in https://github.com/proxystore/benchmarks/pull/127
  • Improve benchmarks for Polaris runs by @gpauloski in https://github.com/proxystore/benchmarks/pull/129
  • Add --stage-repeat to workflow-memory benchmark by @gpauloski in https://github.com/proxystore/benchmarks/pull/132
  • Switch executor model to concurrent.futures.Executor by @gpauloski in https://github.com/proxystore/benchmarks/pull/135
  • Migrate benchmarks to new harness by @gpauloski in https://github.com/proxystore/benchmarks/pull/136

Documentation

  • Add zenodo badge by @gpauloski in https://github.com/proxystore/benchmarks/pull/73

Package Changes

  • Drop Python 3.7 support by @gpauloski in https://github.com/proxystore/benchmarks/pull/76
  • Update copyright year by @gpauloski in https://github.com/proxystore/benchmarks/pull/111
  • Update to ProxyStore v0.6 and other dependencies by @gpauloski in https://github.com/proxystore/benchmarks/pull/112
  • Update Colmena and ProxyStore dependencies by @gpauloski in https://github.com/proxystore/benchmarks/pull/122
  • Bump Globus Compute, Parsl, and ProxyStore versions by @gpauloski in https://github.com/proxystore/benchmarks/pull/137
  • Bump to Benchmarks v0.2.0 by @gpauloski in https://github.com/proxystore/benchmarks/pull/138

Development Workflows

  • Bump actions/checkout from 3 to 4 by @dependabot in https://github.com/proxystore/benchmarks/pull/85
  • Bump actions/setup-python from 4 to 5 by @dependabot in https://github.com/proxystore/benchmarks/pull/99
  • Bump actions/cache from 3 to 4 by @dependabot in https://github.com/proxystore/benchmarks/pull/105

New Contributors

  • @dependabot made their first contribution in https://github.com/proxystore/benchmarks/pull/85

Full Changelog: https://github.com/proxystore/benchmarks/compare/v0.1.1...v0.2.0

Files

proxystore/benchmarks-v0.2.0.zip

Files (125.2 kB)

Name Size
md5:cfb08e4c4b7052fb789979bf7666a42c
125.2 kB Preview Download

Additional details

Related works