Please visit Jefferson Lab Event Policies and Guidance before planning your next event: https://www.jlab.org/conference_planning.
May 8 – 12, 2023
Norfolk Waterside Marriott
US/Eastern timezone

Integrating FTS in the Fenix HPC infrastructure

May 11, 2023, 12:30 PM
15m
Norfolk Ballroom III-V (Norfolk Waterside Marriott)

Norfolk Ballroom III-V

Norfolk Waterside Marriott

235 East Main Street Norfolk, VA 23510
Oral Track 1 - Data and Metadata Organization, Management and Access Track 1 - Data and Metadata Organization, Management and Access

Speaker

Ms Long, Shiting (Forschungszentrum Jülich)

Description

HPC systems are increasingly often used for addressing various challenges in high-energy physics. But often the data infrastructures used in the latter area are not well integrated with infrastructures that include HPC resources. Here we will focus on a specific infrastructure, namely Fenix, which is based on a consortium of 6 leading European supercomputing centres. The Fenix sites are integrated into a common AAI and provide a so-called Archival Data Repository that can be accessed through a Swift API. Fenix was initiated through the Human Brain Project (HBP) but also provides resources to other research communities in Europe.

In this talk, we will report on our efforts to enable the support of Swift in FTS3 and its dependencies GFAL2 and DaviX. We will, in particular, discuss how FTS3 has been integrated into the Fenix AAI, which largely follows the architectural principles of the European Open Science Cloud (EOSC). Furthermore, we show how end-users can use this service through a WebFTS service that has been integrated into the science gateway of the HBP, which is also known as the HBP Collaboratory. Finally, we discuss how transfer commands are automatically distributed over several FTS3 instances to optimise transfer between different Fenix sites.

Consider for long presentation Yes

Primary authors

Ms Long, Shiting (Forschungszentrum Jülich) Prof. Pleiter, Dirk (KTH Royal Institute of Technology) Mr Patrascoiu, Mihai (CERN) Mr Padrin, Cristiano (CINECA) Mr Carpene, Michele (CINECA) Mr More, Sergi (Barcelona Supercomputing Center) Mr Carpio, Miguel (Barcelona Supercomputing Center)

Presentation materials

Peer reviewing

Paper