Report Open Access

Efficient unpacking of required software from CERNVM-FS

Samuel Teuber

In recent times a tool for efficient unpacking of software work-flows from CernVM File System (CVMFS) into standalone images has become necessary. There are two types of use cases for such images: On the one hand they can be used to deliver HEP software to compute nodes which do not support the traditional CVMFS delivery architecture (in particular HPC compute nodes). On the other hand the images can be used for benchmarks in which the network connectivity should not influence the benchmark results.
We present a new software utility which allows CVMFS-sourced image creation and synchronization. The resulting standalone images can run HEP applications independently from an internet connection. We further provide a methodology for automatically extracting the resource requirements from a given software work-flow through file access tracing.
In first experimental evaluations the new tool outperformed mechanisms traditionally used for this task like rsync and provides finer grained unpack functionalities than uncvmfs.

Files (293.8 kB)
Name Size
Report_Samuel Teuber.pdf
md5:55b7f89dbeba30fa27790a8ef43aae72
293.8 kB Download
132
107
views
downloads
All versions This version
Views 132132
Downloads 107107
Data volume 31.4 MB31.4 MB
Unique views 123123
Unique downloads 102102

Share

Cite as