Please visit Jefferson Lab Event Policies and Guidance before planning your next event: https://www.jlab.org/conference_planning.

May 8 – 12, 2023
Norfolk Waterside Marriott
US/Eastern timezone

Multidatabase

Not scheduled
1h
Hampton Roads Ballroom and Foyer Area (Norfolk Waterside Marriott)

Hampton Roads Ballroom and Foyer Area

Norfolk Waterside Marriott

235 East Main Street Norfolk, VA 23510
Poster Poster Poster Session

Speaker

Hrivnac, Julius (IJCLab)

Description

Particle Physics experiments and Astronomy telescopes store a large amount of data, most of those data are usually stored in simple files in various format. Databases are used only to a limited extend, while database technology has made a tremendous progress in recent years, offering a large spectrum of applications in all possible domains. Those possibilities are still largely underused.

The presentation will demonstrate the data access architecture transparently using multiple database types, namely SQL database, NoSQL database and Graph database. Each database is used for the domain where it is the most appropriate and the cross-technology access is offered to users. The strong and week points of all three technologies will be discussed. Several possible ways of organizing interaction between databases will be described. The seamless and fast user access from wide range of languages and frameworks, as well as from the Web services and Notebooks to all data will be demonstrated.

The architecture will be illustrated on the concrete implementation of the data storage of the Fink project, using JanusGraph and HBase technologies to store alerts from the LSST telescope. HBase is used to store the bulk data and the structural information is stored in Graphs, allowing transparent access to all data and deep analyses of relation between alerts and other objects.

Ways for implementing heterogeneous database architecture in general HEP applications will be outlined with use of the modern multi-language environment.

Consider for long presentation No

Primary author

Presentation materials

Peer reviewing

Paper