Speaker
Smith, Nick
(Fermilab)
Description
In this talk, we present a novel data format design that obviates the need for data tiers by storing individual event data products in column objects. The objects are stored and retrieved through Ceph S3 technology, and a companion metadata system handles tracking of the object lifecycle. Performance benchmarks of data storage and retrieval will be presented, along with scaling tests of the data and metadata system.
| Consider for long presentation | No |
|---|
Primary authors
Smith, Nick
(Fermilab)
Gutsche, Oliver
(Fermi National Accelerator Laboratory)
Jayatilaka, Bo
(Fermilab)
