Sep 23 – 27, 2024
ESRF Auditorium
Europe/Paris timezone

The Daisy Workflow Management System for High Energy Photon Source

Sep 24, 2024, 6:00 PM
2h
ESRF Entrance Hall

ESRF Entrance Hall

Poster Workflow engines Posters

Speaker

Hao-Kai Sun (Computing Center, Institute of High Energy Physics, Chinese Academy of Sciences)

Description

The High Energy Photon Source (HEPS), currently under construction, represents an advanced experimental platform facilitating breakthroughs in fundamental scientific research. Boasting over fourteen experimental beamlines, HEPS offers a rich array of research domains and employs complex analytical methodologies. Consequently, it faces formidable data processing challenges, including managing high-throughput multi-modal data and accommodating diverse scientific methodologies. Historically, a dearth of comprehensive, user-friendly data processing systems has plagued both China and international research communities. As part of the Daisy project, we endeavor to address these challenges by leveraging the concept of "workflow" to develop a suite of graphical, general-purpose management systems. Our aims include facilitating rapid data processing method dissemination among beam-line scientists, experiment users, and methodology developers, empowering researchers to customize and monitor complex data processing workflows, and enabling batch application of experimental analyses to similar experiments for reproducible results. Through these efforts, we aspire to establish a robust framework for streamlined data processing in the HEPS research ecosystem.

Abstract publication I agree that the abstract will be published on the web site

Primary authors

Hao-Kai Sun (Computing Center, Institute of High Energy Physics, Chinese Academy of Sciences) Yu Hu (IHEP, CAS)

Co-authors

Fazhi Qi (Institute of High Energy Physics, CAS) Mr Jianli Liu (IHEP, CAS) Lei Wang (IHEP) Rui Liu (IHEP) Shiyuan Fu (IHEP)

Presentation materials