Sep 23 – 27, 2024
ESRF Auditorium
Europe/Paris timezone

A scientific data analysis software framework for exabyte scale data challenges from HEPS

Sep 24, 2024, 6:15 PM
45m
Hybrid event (ESRF Auditorium)

Hybrid event

ESRF Auditorium

EPN Campus ESRF - ILL 71 Av. des Martyrs, 38000 Grenoble
Poster Data Analysis Posters

Speaker

Yu Hu (IHEP, CAS)

Description

Recent advances in X-ray beamline technologies, including the advent of very high brilliance beamlines at next generation synchrotron sources and advanced detector instrumentation, have led to an exponential increase in the speed of data collection. As a consequence, there is an increasing need for a data analysis platform that can refine and optimize data collection strategies in real time and effectively analyse data in large volumes after the data collection. The increased volume and rate of data push the demand for computing resources to the edge of current workstation capabilities. Advanced data management and analysis methods are required to keep up with the anticipated data rates and volumes.
To address the data challenges at High Energy Photon Source in China, we proposed a software framework and system for the full life cycle of the advanced light source experiment. In this talk, we will focus on the data analysis software framework software framework in this system. We will introduce the design of this framework and the scientific software developed based on the framework. The future plan will also be presented.

Abstract publication I agree that the abstract will be published on the web site

Primary author

Yu Hu (IHEP, CAS)

Presentation materials

There are no materials yet.