Sep 23 – 27, 2024
ESRF Auditorium
Europe/Paris timezone

Automated data processing with Ewoks for ESRF beamlines and users

Sep 26, 2024, 4:25 PM
15m
Hybrid event (ESRF Auditorium)

Hybrid event

ESRF Auditorium

EPN Campus ESRF - ILL 71 Av. des Martyrs, 38000 Grenoble
Talk Workflow engines Workflow engines

Speaker

Loic Huder (ESRF)

Description

The increasing complexity and speed of experiments at synchrotrons call for the need of efficient and well-established automated data processing pipelines. Workflows are the ideal approach for defining these pipelines given their ability to describe data processing recipes. This led to the emergence of many workflow systems, such as tomwer at tomography beamlines and pypushflow at MX beamlines at ESRF.

Ewoks aims at unifying these workflow systems via a "meta workflow" approach. By decoupling the actual recipe (the workflow) from the workflow system, we can ensure that the processing remains independent from the underlying technologies and can be replicated in other contexts or at later times.

In this presentation, I will show how we have used this "meta workflow" approach to provide ESRF beamlines, but also ESRF users, with consistent automated data processing, in line with FAIR data principles.

Abstract publication I agree that the abstract will be published on the web site

Primary authors

Presentation materials