30 September 2019 to 4 October 2019
Montenegro, Budva, Becici
Europe/Podgorica timezone

Distributed Data Management System for LHAASO

3 Oct 2019, 15:30
15m
Splendid Conference & SPA Resort, Conference Hall Petroviċa

Splendid Conference & SPA Resort, Conference Hall Petroviċa

Sectional Research Data Infrastructures Research Data Infrastructures

Speaker

Dr Haibo Li (Institute of High Energy Physics,Chinese Academy of Sciences)

Description

The LHAASO(Large High Altitude Air Shower Observatory) experiment of IHEP will generate 6 PB per year in the future. The massive data processing faces many challenges in the distributed computing environment. Take one for example, some sites may have no local HEP storage which makes the distributed computing unavailable. Our goal is to make the data accessible for LHAASO members from any remote site. To make it work, we use EOS as our local storage system, and use LEAF as the data federation system. LEAF is a data cache and access system across remote sites proposed by IHEP. LEAF presents a unified File System view for both local and remote sites, and supports direct data access on demand. In this report, we will present the system architecture, data workflow and performance evaluation of LEAF in LHAASO.

Primary author

Dr Haibo Li (Institute of High Energy Physics,Chinese Academy of Sciences)

Presentation materials