Published August 17, 2019
| Version v7.6.0
Software
Open
ropensci/drake: Big data formats
Creators
- Will Landau
- Will Landau1
- Ben Bond-Lamberty2
- Alex Axthelm3
- Miles McBain4
- Kirill Müller
- TJ Mahr
- Noam Ross5
- brendanf
- Kendon Bell6
- Patrick Schratz7
- Tim Mastny
- Rainer M Krug8
- Garrick Aden-Buie9
- Chris Muir10
- Brianna McHorse
- Xianying Tan11
- Xavier Laviron12
- Tiernan Martin
- Shinya Uryu13
- Maëlle Salmon14
- Mauro Lepore15
- Jasper
- Hugo Gruson
- BruceZhao
- Bill Denney16
- 1. Eli Lilly and Company @EliLillyCo
- 2. PNNL/UMD
- 3. Indiana Commission for Higher Education
- 4. Queensland Fire and Emergency Services
- 5. EcoHealth Alliance
- 6. Manaaki Whenua
- 7. University of Jena, LMU Munich
- 8. University of Zürich
- 9. @GerkeLab at Moffitt Cancer Center
- 10. Capital One
- 11. Generali China AMC @GCAMC
- 12. LECA Grenoble
- 13. NIES
- 14. @ropensci @lockedata
- 15. https://2degrees-investing.org/
- 16. Human Predictions LLC
Description
Version 7.6.0 New features
- Support specialized data storage via a decorated cache and
format
argument oftarget()
(#971). This allows users to leverage faster ways to save and load targets, such aswrite_fst()
for data frames andsave_model_hdf5()
for Keras models. It also improves memory because it preventsstorr
from making a serialized in-memory copy of large data objects. - Add
tidyselect
functionality for...
inprogress()
, analogous toloadd()
,build_times()
, andclean()
. - Support S3 for user-defined generics (#959). If the generic
do_stuff()
and the methodstuff.your_class()
are defined inenvir
, and ifdo_stuff()
has a call toUseMethod("stuff")
, thendrake
's code analysis will detectstuff.your_class()
as a dependency ofdo_stuff()
. - Add authentication support for
file_in()
URLs. Requires the newcurl_handles
argument ofmake()
anddrake_config()
(#981).
- Make
drake_plan(transform = slice())
understand.id
and grouping variables (#963). - Repair
clean(garbage_collection = TRUE, destroy = TRUE)
. Previously it destroyed the cache before trying to collect garbage. - Ensure that
r_make()
passes informative error messages back to the calling process (#969). - Avoid downloading full contents of URLs when rehashing (#982)
- Retain upstream grouping variables of
map()
andcross()
on topologically side-by-side targets (#983). - Manually enforce the correct ordering in
dsl_left_outer_join()
socross()
selects the right combinations of existing targets (#986). This bug was probably introduced in the solution to #983. - Make the output of
progress()
more consistent, less dependent on whethertidyselect
is installed.
- Document DSL keywords as if they were true functions:
target()
,map()
,split()
,cross()
, andcombine()
(#979). - Do garbage collection between the unloading and loading phases of memory management.
- Keep
file_out()
files inclean()
unlessgarbage_collection
isTRUE
. That way,make(recover = TRUE)
is a true "undo button" forclean()
.clean(garbage_collection = TRUE)
still removes data in the cache, as well as anyfile_out()
files from targets currently being cleaned. - The menu in
clean()
only appears ifgarbage_collection
isTRUE
. Also, this menu is added torescue_cache(garbage_collection = TRUE)
. - Reorganize the internal code files and functions to make development easier.
- Move the history inside the cache folder
.drake/
. The old.drake_history/
folder was awkward. Old histories are migrated duringdrake_config()
, anddrake_history()
. - Add lifecycle badges to exported functions.
Files
ropensci/drake-v7.6.0.zip
Files
(1.2 MB)
Name | Size | Download all |
---|---|---|
md5:b567e69435658a92f73b73fd0c65e46b
|
1.2 MB | Preview Download |
Additional details
Related works
- Is supplement to
- https://github.com/ropensci/drake/tree/v7.6.0 (URL)