Presentation Open Access

Distributed statistical inference with pyhf powered by funcX

Feickert, Matthew

In high energy physics (HEP) a core component of analysis of data collected at the Large Hadron Collider is performing statistical inference for binned models to extract physics information. The statistical fitting tools used in HEP have traditionally been implemented in C++, but in recent years pyhf, a pure-Python library with automatic differentiation and hardware acceleration, has grown in use for analysis related statistical inference problems. The fitting of multiple different hypotheses for new physics signatures (signals) is a computational problem that lends itself easily to parallelization, but is hampered on HPC environments by the additional tooling overhead required, which can be very difficult to master. Through use of funcX, a pure-Python high performance function serving system designed to orchestrate scientific workloads across heterogeneous computing resources, pyhf can be used as a highly scalable (fitting) function as a service (FaaS) on HPCs.

Files (17.6 MB)
Name Size
pyhf-funcx-talk-scipy2021.pdf
md5:4cd6af131082029923561d201804dc65
17.6 MB Download
3,479
41
views
downloads
Views 3,479
Downloads 41
Data volume 720.5 MB
Unique views 3,474
Unique downloads 40

Share

Cite as