Speaker
Galewsky, Ben
(University of Illinois)
Description
We will describe how ServiceX, an IRIS-HEP project, generates C++ or python code from user queries and orchestrates thousands of experiment-provided docker containers to filter and select event data. The source datafiles are identified using Rucio. We will show how the service encapsulates best practice for using Rucio and helps inexperienced analysers get up to speed quickly. The data is returned as flat root or parquet files in an object store. We will show how ServiceX is deployed into a modern analysis facility as part of a scalable analysis workflow. Recent work includes support for CMS MiniAOD files, robust failover across file replicas, CERN OpenData support, Autoscaling of worker pods.
| Consider for long presentation | No |
|---|
Primary authors
Galewsky, Ben
(University of Illinois)
Watts, Gordon
(University of Washington)
Dr
Vukotic, Ilija
(University of Chicago)
