Speaker
Description
The Data And Metadata iNspection Interactive Thing (DAMNIT) is a tool developed by the Data Analysis group at the European XFEL (EuXFEL) to help scientists and users effortlessly create overviews of their experiments.
Traditionally, at EuXFEL, many user groups and beamline scientists use spreadsheets and electronic logbooks to track experimental settings, metadata, and analysis results. This manual process is time-consuming, error-prone, and lacks reproducibility. DAMNIT aims to replace these spreadsheets with an automated solution.
Integrated into the EuXFEL data system, DAMNIT collects metadata automatically and manages data analysis workflows during experiments, giving users a real-time overview of their progress.
DAMNIT offers a simple frontend application with a spreadsheet-like interface showing all tracked quantities for each data measurement. It allows users to set up complex data analysis workflows on large computing clusters using the Slurm scheduling system. This streamlines data analysis during experiments, with results saved for later use through an accessible API and displayed in the overview table. DAMNIT also makes it easy to update computed and collected data using a simple Python API and re-processing features.
| Abstract publication | I agree that the abstract will be published on the web site |
|---|
