Published August 1, 2021 | Version v1
Presentation Open

Distributed statistical inference with pyhf powered by funcX

  • 1. University of Illinois at Urbana-Champaign

Description

In high energy physics (HEP) a core component of analysis of data collected at the Large Hadron Collider is performing statistical inference for binned models to extract physics information. The statistical fitting tools used in HEP have traditionally been implemented in C++, but in recent years pyhf, a pure-Python library with automatic differentiation and hardware acceleration, has grown in use for analysis related statistical inference problems. The fitting of multiple different hypotheses for new physics signatures (signals) is a computational problem that lends itself easily to parallelization, but is hampered on HPC environments by the additional tooling overhead required, which can be very difficult to master. Through use of funcX, a pure-Python high performance function serving system designed to orchestrate scientific workloads across heterogeneous computing resources, pyhf can be used as a highly scalable (fitting) function as a service (FaaS) on HPCs.

Files

pyhf-funcx-talk-scipy2021.pdf

Files (17.6 MB)

Name Size Download all
md5:4cd6af131082029923561d201804dc65
17.6 MB Preview Download