Please visit Jefferson Lab Event Policies and Guidance before planning your next event: https://www.jlab.org/conference_planning.

May 8 – 12, 2023
Norfolk Waterside Marriott
US/Eastern timezone

Creating a Grid Storage Element Using S3-compatible Object Storage and Dynamic Federation at the University of Melbourne

Not scheduled
1h
Hampton Roads Ballroom and Foyer Area (Norfolk Waterside Marriott)

Hampton Roads Ballroom and Foyer Area

Norfolk Waterside Marriott

235 East Main Street Norfolk, VA 23510
Poster Poster Poster Session

Speaker

Dossett, David (University of Melbourne)

Description

Until now the grid storage at Melbourne was provided by the DPM storage system which is now reaching the end of support, as well as the end of the disk lifetimes. Continuing to provide grid storage for the ATLAS and Belle II experiments requires that we move to a new solution; one that can be supported long term with minimal manpower by taking advantage of existing resources at Melbourne. Over the last decade Australian institutions have increasingly invested in centrally supported cloud services to provide computing infrastructure across research institutions and disciplines. At Melbourne the Research Computing Services (RCS) provides scalable common resources across the university, including an OpenStack Melbourne Research Cloud (MRC) and a separate S3-compatible endpoint powered by a RADOS Gateway (RGW) on top of a Ceph cluster object store. Based on experience from the University of Victoria we have created a Dynamic Federations project (Dynafed) frontend server to provide a WebDAV interface and WLCG compatible authentication and authorisation. This model leaves the installation and maintenance of all hardware, the Ceph cluster, and the RADOS Gateway under the control of the RCS team while the grid group maintains the virtual machines handling grid requests. We describe the implementation details, challenges for the future, and the performance of this storage element.

Consider for long presentation No

Primary author

Dossett, David (University of Melbourne)

Co-authors

Ebert, Marcus (University of Victoria) Sevior, Martin

Presentation materials