Published March 26, 2021
| Version 0.3.0
Software
Open
ropensci/targets: HPC performance and infrastructure refactor
Authors/Creators
- 1. Eli Lilly and Company @EliLillyCo
- 2. University of Toronto
- 3. Manaaki Whenua
- 4. University of Cambridge
- 5. University of Leeds
Description
targets 0.3.0
Bug fixes
- Fix the "write target at cursor" RStudio addin and move cursor between the parentheses.
- Add a
backoffoption intar_option_set()to set the maximum upper bound (seconds) for the polling interval (#333). - Add a new
tar_github_actions()function to write a GitHub Actions workflow file for continuous deployment of data analysis pipelines (#339, @jaredlander). - Add a new
TAR_MAKE_REPORTERenvironment variable to globally set the reporter of thetar_make*()functions (#345, @alexpghayes). - Support new storage formats "feather", "parquet", "aws_feather", and "aws_parquet" (#355, @riazarbi).
- Implement an exponential backoff algorithm for polling the priority queue in
tar_make_clustermq()andtar_make_future()(#333). - In
tar_make_future(), try to submit a target every time a worker is polled. - In
tar_make_future(), poll workers in order of target priority. - Avoid the time delay in exiting on error (from https://github.com/r-lib/callr/issues/185).
- Clone target objects for the pipeline and scrape more
targetsinternal objects out of the environment in order to avoid accidental massive data transfers to workers.
- Use
rlang::check_installed()insideassert_package()(#331, @malcolmbarrett). - Allow
tar_destroy(destroy = "process"). - In
tar_watch(), increase defaultsecondsto 15 (previously 5). - In
tar_watch(), debounce instead of throttle inputs. - In
tar_watch(), add an action button to refresh the outputs. - Always deduplicate metadata after
tar_make(). Will help compute a cache key on GitHub Actions and similar services. - Deprecate
tar_deduplicate()due to the item above. - Reorder information in timestamped messages.
- Document RNG seed generation in
tar_target_raw(),tar_meta(), andtar_seed()(#357, @alexpghayes). - Switch meaning of
%||%and%|||%to conform to historical precedent. - Only show a command line spinner if
reporter = "silent"(#364, @matthiasgomolka). - Target and pipeline objects no longer have an
envirelement.
Files
ropensci/targets-0.3.0.zip
Additional details
Related works
- Is supplement to
- https://github.com/ropensci/targets/tree/0.3.0 (URL)