Indico is back online after maintenance on Tuesday, April 30, 2024.
Please visit Jefferson Lab Event Policies and Guidance before planning your next event: https://www.jlab.org/conference_planning.

May 8 – 12, 2023
Norfolk Waterside Marriott
US/Eastern timezone

Towards a distributed heterogeneous task scheduler for the ATLAS offline software framework

May 11, 2023, 2:30 PM
15m
Hampton Roads Ballroom VI (Norfolk Waterside Marriott)

Hampton Roads Ballroom VI

Norfolk Waterside Marriott

235 East Main Street Norfolk, VA 23510
Oral Track 3 - Offline Computing Track 3 - Offline Computing

Speaker

Esseiva, Julien (Lawrence Berkeley National Laboratory)

Description

With the increased data volumes expected to be delivered by the HL-LHC, it becomes critical for the ATLAS experiment to maximize the utilization of available computing resources ranging from conventional GRID clusters to supercomputers and cloud computing platforms. To be able to run its data processing applications on these resources, the ATLAS software framework must be capable of efficiently executing data processing tasks in heterogeneous distributed computing environments. Today with the use of Gaudi Avalanche Scheduler, a central component of the multithreaded Athena framework whose implementation is based on Intel TBB, we can efficiently schedule Athena algorithms to multiple threads within a single compute node. Our goal is to develop a new framework scheduler capable of supporting distributed heterogeneous environments, based on technologies like HPX and Ray. After the initial evaluation phase of these technologies, we began the actual development of prototype distributed task schedulers and their integration with the Athena framework. This contribution will describe these prototype schedulers , as well as the preliminary results of performance studies of these prototypes within ATLAS data processing applications.

Consider for long presentation No

Primary authors

Esseiva, Julien (Lawrence Berkeley National Laboratory) Calafiura, Paolo (LBNL) Ju, Xiangyang (Lawrence Berkeley National Laboratory) Leggett, Charles (Lawrence Berkeley National Laboratory) Dr Stanislaus, Beojan (Lawrence Berkeley National Laboratory) Tsulaia, Vakho (LBNL)

Presentation materials

Peer reviewing

Paper