Speaker
Description
Particle Physics experiments and Astronomy telescopes store a large amount of data, most of those data are usually stored in simple files in various format. Databases are used only to a limited extend, while database technology has made a tremendous progress in recent years, offering a large spectrum of applications in all possible domains. Those possibilities are still largely underused.
The presentation will demonstrate the data access architecture transparently using multiple database types, namely SQL database, NoSQL database and Graph database. Each database is used for the domain where it is the most appropriate and the cross-technology access is offered to users. The strong and week points of all three technologies will be discussed. Several possible ways of organizing interaction between databases will be described. The seamless and fast user access from wide range of languages and frameworks, as well as from the Web services and Notebooks to all data will be demonstrated.
The architecture will be illustrated on the concrete implementation of the data storage of the Fink project, using JanusGraph and HBase technologies to store alerts from the LSST telescope. HBase is used to store the bulk data and the structural information is stored in Graphs, allowing transparent access to all data and deep analyses of relation between alerts and other objects.
Ways for implementing heterogeneous database architecture in general HEP applications will be outlined with use of the modern multi-language environment.
| Consider for long presentation | No |
|---|
