Speaker
Description
ALBA Synchrotron [1] is actively implementing FAIR data management principles [2] across all operational beamlines. Data is cataloged in ICAT, [3] preferably using the NeXus data format [4], alongside metadata sourced from various information systems.
To ensure all metadata is accessible for data interpretation and reuse, gathering beamline and experimental conditions during data collection is essential. Most ALBA beamlines utilize Sardana [5] as the data acquisition framework, built atop a TANGO Control System [6].
To standardize the process as much as possible without disrupting scientists' habits and needs, an additional layer of processing is considered between the control system and ICAT ingestion. This involves publishing necessary information to a Redis [7] database, enabling consumers to retrieve it for relevant operations. The published information and operations vary depending on the beamline and technique and two general scenarios are considered:
-
For beamlines generating NeXus files, most metadata is encapsulated within these files, and only the file location details are published to Redis. A NeXus recorder, configurable for different Application Definitions, has been developed for beamlines that use Sardana.
-
In cases where NeXus files are not generated (e.g., some proprietary software), the folder containing collected files is published to Redis, along with additional processing information if needed. The intermediate layer is responsible for NeXus file generation tailored to each technique before ICAT publication.
Publication to Redis can be achieved directly from Sardana macros or via a Tango Device Server. Using Redis as the message broker aligns with Sardana's roadmap, which considers publishing scans data to Redis to decouple acquisition from storage. ICAT pubication will also benefit of this feature when available.
[1] Alba Synchrotron, http://www.cells.es
[2] Wilkinson, M., et al. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Sci Data 3, 160018. https://doi.org/10.1038/sdata.2016.18
[3] Collaboration, T. I. C. A. T. (2014). The ICAT Project. The ICAT Collaboration. https://doi.org/10.5286/SOFTWARE/ICAT
[4] Konnecke, M., et al. (2015). The NeXus data format. J. Appl. Cryst. 48, 301-305.
[5] Sardana, https://sardana-controls.org/
[6] Tango Control System, http://www.tango-controls.org
[7] Redis, https://redis.io/
| Abstract publication | I agree that the abstract will be published on the web site |
|---|
